Thoughts from Ben: The Hadoop 2.x Update and What It Means for Bedrock

November 28, 2013 Ben Sharma

Earlier this month Hadoop released their latest version, 2.x. This, of course, has resulted in a flurry of commentary and questions. Rather than make you wade through that deluge, I’d like to  explain what Hadoop 2.0 is all about, and how Zaloni is already way ahead of the curve in utilizing this new version.

Zaloni has been prepared for the 2.x release since June of this year, and we’ve already updated our Bedrock Data Management Platform. I think Bedrock 2.0 is defining how to best utilize Hadoop 2.0 for the industry. Bedrock 2.0 builds on a comprehensive set of features that enable customers to efficiently collect, organize, analyze, and visualize data in Hadoop.

Later this quarter, we’re planning to release additional support for new features, such as multi-tenancy and federated namespaces, so that enterprises can utilize Hadoop as a shared services data platform.

Now, let’s get into the nitty-gritty of the Hadoop update:

First off, what does the Hadoop 2.x update change or improve? The Hadoop 2.0 platform can run multiple applications simultaneously to enable users to quickly and efficiently leverage data in multiple ways at scale. New in Hadoop 2.0 is the addition of YARN that sits on top of HDFS and serves as a Resource Manager for big data applications, enabling multiple applications to run simultaneously for more efficient support of data throughout its entire lifecycle.

We at Zaloni are thrilled about these enhanced capabilities. With the improvements in HDFS and the new architecture for resource management, we expect Hadoop to gain wider acceptance as a data platform for diverse workloads running on the same physical infrastructure, leveraging the benefits of HDFS. With features such as capacity scheduler, enterprises can facilitate workload isolation for multi-tenant environments.

Some of the enterprise features include:

  • High availability for namenode
  • Federated namespaces
  • Snapshots and NFS support

These features allow enterprises to integrate Hadoop into their existing architecture to provide scale out, cost effective data platforms. These features also open up new possibilities and uses for our Bedrock Data Management Platform.

If you’re wondering how Hadoop 2.x can be used in your own enterprise, the team at Zaloni is happy to go into greater detail. Hadoop is cutting edge and in my opinion, no question is too big or small.

~Ben Sharma, CEO

About the Author

Ben Sharma

Ben Sharma, is CEO and co-founder of Zaloni. He is a passionate technologist with experience in business development, solutions architecture, and service delivery of big data, analytics and enterprise infrastructure solutions. Having previously worked in management positions for NetApp, Fujitsu and others, Ben’s expertise ranges from business development to production deployment in a wide array of technologies including Hadoop, HBase, databases, virtualization and storage. Ben is the co-author of Java in Telecommunications and holds two patents. He received his MS in Computer Science from the University of Texas at Dallas.

Follow on Twitter More Content by Ben Sharma
Previous Article
Thoughts from Ben: 2013 Was an Incredible Year for Zaloni

After the ball drops in New York and the chorus of Auld Lang Syne has been sung, most people promptly turn ...

Next Article
Using Globs and Wildcards with MapReduce
Using Globs and Wildcards with MapReduce

A typical question we face while writing MapReduce jobs is how to include multiple source files to the job....

×

Get the latest tips and how-to's delivered straight to your inbox!

First Name
Last Name
Zaloni Blog Email Subscription
Thank you!
Error - something went wrong!