Apache Spark 2.0 - Matei Zaharia

September 23, 2016 Matei Zaharia

Apache Spark 2.0

Matei Zaharia talks about the computations he believes people care about – Project Tungsten. Project Tungsten is meant to bring Spark closer to bare metal for most of the computations through native memory management and on-time code generation. Project Tungsten focuses on substantially improving the efficiency of memory and CPU for Spark applications. 

About the Author

Matei Zaharia

Matei Zaharia is the creator of Apache Spark and the chief technology officer at Databricks. While earning his PhD at UC Berkeley, he created the Apache Spark, co-created the Apache Mesos and designed the core scheduling algorithms used in Apache Hadoop. He is currently an assistant professor at Stanford University.

Follow on Twitter Follow on Linkedin Visit Website More Content by Matei Zaharia
Previous Video
Apache Kafka and the Stream Data Platform - Jay Kreps
Apache Kafka and the Stream Data Platform - Jay Kreps

Learn about Apache Kafka from Jay Kreps. View more Big Data Think Tank videos at: http://www.zaloni.com/big...

Next Video
Ground: Managing Metadata - Vikram Sreekanti
Ground: Managing Metadata - Vikram Sreekanti

Learn what it takes to manage metadata in a big data ecosystem from Vikram Sreekanti. View more Big Data Th...