Apache Spark 2.0 - Matei Zaharia

Apache Spark 2.0

Matei Zaharia talks about the computations he believes people care about – Project Tungsten. Project Tungsten is meant to bring Spark closer to bare metal for most of the computations through native memory management and on-time code generation. Project Tungsten focuses on substantially improving the efficiency of memory and CPU for Spark applications. 

About the Author

Matei Zaharia is the creator of Apache Spark and the chief technology officer at Databricks. While earning his PhD at UC Berkeley, he created the Apache Spark, co-created the Apache Mesos and designed the core scheduling algorithms used in Apache Hadoop. He is currently an assistant professor at Stanford University.

Follow on Twitter Follow on Linkedin Visit Website More Content by Matei Zaharia