Zaloni Zip: Using Transient Clusters and Keeping Your Metadata

December 6, 2016 Parth Patel


As the name suggests, transient clusters are compute clusters that automatically shut down and stop billing when processing is finished. However, using this cost-effective approach has been an issue because metadata is automatically deleted by the cloud provider when a transient cluster is shut down.

This is noteworthy because metadata is the key to getting value from big data. Therefore, most enterprises have opted to pay for persistent compute across the board in order to maintain the metadata. How can enterprises leverage transient clusters for cost-savings and maintain their metadata?


To solve this challenge, enterprises either choose a persistent cloud presence or deploy an intelligent data lake management platform like Zaloni's. Learn even more about how our platform can help leverage transient clusters or contact us for more information.


About the Author

Parth  Patel

Big Data Solutions Engineer - RTP Raleigh NC

More Content by Parth Patel
Previous Article
Data Lake Archiving: Hadoop or the Cloud?
Data Lake Archiving: Hadoop or the Cloud?

The storage layer of the data lake is evolving. A few years ago, when we talked about the data lake, it was...

Next Article
Zaloni Zip: Data Lineage
Zaloni Zip: Data Lineage

Maintaining a lineage of data in your data lake is not just a “nice to have” feature. Many organizations fr...

Want a governed, self-service data lake?

Contact Us