It’s my great pleasure to announce that the Apache Hadoop community has declared Hadoop 2.x as Beta with the vote closing over the weekend for the hadoop-2.1.0-beta release.
As noted in the announcement to the mailing lists, this is a significant milestone across multiple dimensions: not only is the release chock-full of significant features (see below), it also represents a very stable set of APIs and protocols on which we can continue to build for the future. In particular, the Apache Hadoop community has spent an enormous amount of time paying attention to stability and long-term viability of our APIs and wire protocols for both HDFS and YARN. This is very important as we’ve already seen a huge interest in other frameworks (open-source and proprietary) move atop YARN to process data and run services *in* Hadoop.
For folks who know me, it won’t come as a surprise when I say that I could not be more excited to see Apache Hadoop YARN achieve the beta moniker – personal highlight of the year! This means that applications besides MapReduce such as Apache Tez, HBase on YARN (HOYA), Storm-on-YARN, Apache Samza etc. can now be confident that they are building on a very stable base.
Since the last major release in the Hadoop 2.x series, hadoop-2.1.0-beta represents a significant set of enhancements:
With Hadoop 2.x achieving beta status, the community is now fully focused on ironing out the last of the minor issues to prepare for Hadoop 2.x GA release in the next few weeks.
Currently, we have a handful of issues we are working on fixing through a follow up hadoop-2.1.1-beta release in the next few days. Once we get that release done, the plan is to put it through another wringer of a test-cycle before we release a hadoop-2.2.0 release which would be the first GA release of Apache Hadoop 2.x – hopefully by the middle of September, 2013. Exciting times, stay tuned!
As always, it’s an honor and pleasure to work with the wider Apache Hadoop community – thanks to everyone who contributed! A special note of thanks to Vinod K. V. who has been very instrumental in helping shepherd both YARN API stability work and the MapReduce Binary Compatibility features for this release.