RCE an HPC Podcast
Brock Palen and Jeff Squyres speak with the creators of Julia. Julia is a high-level, high-performance dynamic programming language for technical computing, with syntax that is familiar to users of other technical computing environments. It provides a sophisticated compiler, distributed parallel execution, numerical accuracy, and an extensive mathematical function library. Julia’s Base library, largely written in Julia itself, also integrates mature, best-of-breed open source C and Fortran libraries for linear algebra, random number generation, signal processing, and string processing.
Jeff Bezanson, Alan Edelman, Stefan Karpinski and Viral Shah are all co-creators of the Julia language. They are also co-founders of Julia Computing, Inc., a company that builds products for data scientists to accelerate the cycle of innovation, from discovery to production. Their first blog post announcing Julia to the world captures the essence of what they set out to do.
Julia is a modern and easy to use high performance programming language. Parallel computing is fundamental to Julia rather than being an afterthought. It is a vibrant open source project with a diverse community of 500 contributors around the world. Research on Julia is anchored at Alan Edelman’s Julia Lab at MIT. The Julia community has contributed over 1,000 open source packages to date. A number of universities and MOOCs use Julia for teaching and research. It is also used by businesses in areas as diverse as finance, engineering, aerospace, automotive, robotics, healthcare, and e-commerce, to name a few. All these applications and research have been presented over time in four JuliaCons held over the last several years in the US and India.
Prof. Alan Edelman: http://www-math.mit.edu/~edelman/
Alan Edelman is a professor of applied mathematics and a member of the Computer Science and AI Laboratories at MIT. He has won numerous prizes including the Gordon Bell Prize, the Householder prize, various SIAM and AMS prizes, and is a fellow of SIAM and the AMS. He was CTO of Interactive Supercomputing, a startup in the area of software for high performance and big data computing, which was later acquired by Microsoft. He has consulted or worked for companies such as Microsoft, Akamai, Pixar, IBM, and others most recently working on numerical verification. Before that he worked on “big data” analysis tools, even before “big data” became a household term. He currently leads the MIT group on the Julia project as well as working on practical algorithms and theoretical mathematics.
Dr. Viral B. Shah: https://www.linkedin.com/in/viralbshah
Viral Shah is computer scientist with a keen interest in the interaction of technology with public policy. He has had a long-term track record of building open-source software. Apart from Julia, he is also co-creator of Circuitscape, an open-source program which borrows algorithms from electronic circuit theory for ecological conservation. Prior to founding Julia Computing, he founded FourthLion Technologies in India to build India’s first data-driven political campaigns. In the Government of India, he was an early member of the country’s national ID project - Aadhaar, where his work on re-architecting India’s social security systems led to a significant increase in social and financial inclusion, while simultaneously saving the exchequer over a billion dollars in slippage. The experiences of implementing technology at such scale for a billion people are collected in his book: Rebooting India. Viral has a Ph. D. from the University of California at Santa Barbara, in Computer Science.
Stefan Karpinski: https://www.linkedin.com/in/stefankarpinski
Prior to founding Julia Computing, Stefan previously worked as a software engineer and data scientist at Akamai, Citrix Online, and Etsy. In addition to running Julia Computing, he has a part-time appointment as a Research Engineer at New York University as part of the Moore-Sloan Data Science Initiative. Stefan received a B.A. in mathematics from Harvard University in 2000.
Dr. Jeff Bezanson: https://www.linkedin.com/in/jeffbezanson
Jeff Bezanson is a serial programming language designer. Prior to designing Julia, Jeff wrote compilers at Interactive Supercomputing. He is also the author of a particularly tiny Scheme implementation called femtolisp. He is an alumnus of the Massachusetts Institute of Technology and the MIT Computer Science and Artificial Intelligence Laboratory (CSAIL), where his thesis was centred on building high performance dynamic languages for technical computing. He received a B.A. in computer science from Harvard in 2004, and a PhD from MIT in 2015.
Brock Palen and Jeff Squyres speak with Gregory Kurtzer about Singularity a container solution for HPC and research environments. Singularity allows a non-privileged user to "swap out" the operating system on the host for one they control. So if the host system is running RHEL6 but your application runs in Ubuntu, you can create an Ubuntu image, install your applications into that image, copy the image to another host, and run your application on that host in it's native Ubuntu environment.
Gregory Kurtzer has created many open source initiatives related to HPC namely: Centos Linux, Warewulf, Perceus, and most recently Singularity. Currently Gregory serves as a member of the OpenHPC Technical Steering Committee and is the IT HPC Systems Architect and Software Developer for Lawrence Berkeley National Laboratory.
Brock Palen and Jeff Squyres speak with Marcel Kornacker about Impala. Impala brings scalable parallel database technology to Hadoop, enabling users to issue low-latency SQL queries to data stored in HDFS and Apache HBase without requiring data movement or transformation. Impala is integrated with Hadoop to use the same file and data formats, metadata, security and resource management frameworks used by MapReduce, Apache Hive, Apache Pig and other Hadoop software.
Marcel Kornacker is the Chief Architect for database technology at Cloudera and creator of the Cloudera Impala project. Following his graduation in 2000 with a PhD in databases from UC Berkeley, he held engineering positions at several database-related start-up companies. Marcel joined Google in 2003 where he worked on several ads serving and storage infrastructure projects, then became tech lead for the distributed query engine component of Google's F1 project.