Apache Spark 2.0 - Matei Zaharia

September 23, 2016 Matei Zaharia

Apache Spark 2.0

Matei Zaharia talks about the computations he believes people care about – Project Tungsten. Project Tungsten is meant to bring Spark closer to bare metal for most of the computations through native memory management and on-time code generation. Project Tungsten focuses on substantially improving the efficiency of memory and CPU for Spark applications. 

About the Author

Matei Zaharia

Matei Zaharia is the creator of Apache Spark and the chief technology officer at Databricks. While earning his PhD at UC Berkeley, he created the Apache Spark, co-created the Apache Mesos and designed the core scheduling algorithms used in Apache Hadoop. He is currently an assistant professor at Stanford University.

Follow on Twitter More Content by Matei Zaharia
Previous Video
Apache Kafka and the Stream Data Platform - Jay Kreps
Apache Kafka and the Stream Data Platform - Jay Kreps

To view the entire Big Data Think Tank series, please visit: http://www.zaloni.com/big-data-think-tank/

Next Video
Ground: Managing Metadata - Vikram Sreekanti
Ground: Managing Metadata - Vikram Sreekanti

To view the entire Big Data Think Tank series, please visit: http://www.zaloni.com/big-data-think-tank/