Delivering the Next Generation of Apache Hadoop
Today we announced our plans to release a public preview of the Hortonworks Data Platform (HDP) version 2. HDP v2 will leverage Apache Hadoop 0.23, which is the first major update to Hadoop in more than three years. Among other advancements, HDP v2 will include the NextGen MapReduce architecture, HDFS NameNode HA and HDFS Federation. It will also include the most up-to-date stable components including HCatalog, HBase, Hive and Pig; all fully integrated and tested at scale.
In order to avoid confusion, let me explain the two versions of HDP:
- HDP v1 is based upon Apache Hadoop 1.0 (which comes from the 0.20.205 branch). It the most stable, production-ready version of Hadoop that is currently found in many large enterprise deployments. HDP v1 is currently available as a private technology preview. A public technology preview will be made available later this quarter.
- HDP v2 is based upon Apache Hadoop 0.23, which includes the next generation advancements mentioned above. It’s an important step forward in terms of scalability, performance, high availability and data integrity. A technology preview will also be made publicly available in the second half of 2012.
Keep in mind that the individual project downloads are always available on apache.org. Hortonworks Data Platform leverages these components and adds additional value by integrating and testing the components to ensure interoperability. HDP also helps to streamline and simplify the download and installation process. Plus, we provide some additional materials to improve the overall user experience.
I highly recommend that you view Arun Murthy’s recent webcast “What’s In Store for Hadoop.Next” in which he covers many of the details of HDP v2. We are also in the process of rolling out a series of webcasts on “The Future of Hadoop”, which will provide much more detail into popular topics such as HDFS HA, HCatalog, importing data into Hadoop and many other topics. You can register for future webcasts and/or view previous webcasts on-demand by visiting our Webcasts page.
We’re excited about the innovation coming from the Apache Hadoop community and are proud to have played an important role in making Hadoop 0.23 happen. Stay tuned as always for Hortonworks and Hadoop-related news and please consider giving Hortonworks Data Platform a try. Visit the Technology Preview Program page for more details, including signing up for alerts when new technology previews are available.