Once a month, receive latest insights, trends, analytics information and knowledge of Big Data.
AVAILABLE NEWSLETTERS:
Thank you for subscribing!
Once a month, receive latest insights, trends, analytics information and knowledge of Big Data.
Thank you for subscribing!
The last couple of weeks have been a period of intense activity around the Apache projects that comprise the Hadoop ecosystem. While most of the headlines were accorded to Apache Hadoop 2 going GA, it would be remiss not to pay attention to the great progress being made in the Apache projects that complement Hadoop.
We have blogged about these over the course of the past week and the list below provides a quick summary of the phenomenal work contributed in the open by the folks driving these diverse and vital communities.
Release Date: 15th October, 2013
Over five years in the making, Hadoop 2 represents a major, stable release off the mainline trunk and represents the future of this important project. While there are many new features in the 2.0 GA release, here are some highlights:
YARN
High Availability for HDFS
HDFS Federation
HDFS Snapshots
NFSv3 access to data in HDFS
Binary Compatibility for MapReduce applications between Hadoop v1 and Hadoop v2 to ease migration
Performance
Support for running Hadoop on Microsoft Windows
Integration testing for the entire Apache Hadoop ecosystem at the ASF.
Release Date: 18th October, 2013
With 2,134 Jira tickets closed HBase 0.96 represents 14 months of development and a major step forward for this important project. Some of the notable new features include:
Reduced Mean Time to Recovery (MTTR)
Snapshots for HBase tables
Support for Microsoft Windows
Compaction Improvements
Wire Compatibility with Protocol Buffers
Data Type flexibility
Overhaul of Metrics framework
Release Date: 15th October, 2013
Only five months in the making, Apache Hive 0.12 comprises over 420 closed JIRA tickets contributed by ten companies, with nearly 150.000 lines of code! Below are some highlights of the release, which represents delivery of phase 2 of the Stinger initiative.
Faster query planning including Metastore improvements
Predicate pushdown for ORC files
Performance enhancements such as parallel ORDER BY, LIMIT pushdown etc.
Enhanced SQL with support for VARCHAR, DATE and macros
Release Date: 21st October, 2013
Over 760 JIRAs have been resolved the Ambari 1.4.1 release by more than 40 engineers. The following are the highlights of the Apache Ambari 1.4.1 release this week:
Support for Apache Hadoop 2 stack including Apache HBase 0.96, Apache Pig 0.12, Apache Hive 0.12 and Apache Oozie 4.0
Support for High Availability for HDFS NameNode
Added support for enabling Kerberos security for Hadoop 2
Support to work with SSL enabled Hadoop daemons
Support to work with web authentication enabled for Hadoop daemons
Added support for JDK 7 (and maintained support for JDK 6)
Release Date: 14th October, 2013
Last week saw the release of Apache Pig 0.12. Some of the highlights of this release include:
Support for new ASSERT, IN, CASE operators
Streaming UDFs
Support for BigInteger and BigDecimal data-types
Support for Microsoft Windows
Release Date: 30th August, 2013
And last but not least, the Apache Oozie community remade their 4.0 release:
Support strict SLAs
Support for HCatalog
As always, it’s an honor and pleasure to innovate with the entire Apache Hadoop community – thanks to everyone who contributed!
This website uses cookies for analytics, personalisation and advertising. To learn more or change your cookie settings, please read our Cookie Policy. By continuing to browse, you agree to our use of cookies.
Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Phoenix, NiFi, Nifi Registry, HAWQ, Zeppelin, Slider, Mahout, MapReduce, HDFS, YARN, Metron and the Hadoop elephant and Apache project logos are either registered trademarks or trademarks of the Apache Software Foundation in the United States or other countries.
© 2011-2018 Hortonworks Inc. All Rights Reserved.
Tags: