At Thanksgiving we took a moment to reflect on the past and give thanks for all that has happened to Hortonworks the past year. With the New Year approaching we now take time to look forward and provide our predictions for the Hadoop community in 2013. To compile this list, we queried and collected big data from our team of Hadoop committers and members of the community.
We asked a few luminaries as well and we surfaced many expert opinions and while we had our hearts set on five predictions, we ended up with SEVEN. So, without further adieu, here are the top Top 7 Predictions for Hadoop in 2013
Over the past 18 months the term “big data” has emerged and has defined a space for swath of new (and existing) technologies. It has been called transformative and many have even said it will replace everything we do today. Well, we have a bit of realistic eye on big data. We feel big data is just data. As Apache Hadoop has evolved it has become a standard platform for this new world and by the end of 2013, the “big” moniker will no longer be necessary… it is all just data after all. Big data and all the predictions for this space will collapse into data management by the analysts and all those following, including a lot of the “big” vendors.
At the keynote of Hadoop Summit last year, Geoffrey Moore characterized Apache Hadoop as currently crossing the chasm and that we would know it has landed on the other side and is enjoying adoption by the mainstream when vertical solutions arise. As more and more companies gain success we will see patterns and solutions arise that are custom-fit for a challenge found in a particular industry. As the system integrators and consultants become more and more expert on Apache Hadoop, they will wrap solutions in packages and we will see the emergence of these vertical solutions
Much has been made about the batch nature of Apache Hadoop in the past few months. This is understandable as it was, after all, architected this way. In 2013 we will see Apache Hadoop v2 finally deemed stable and reliable and with this we will see advances in the surrounding Apache projects to make the platform more interactive. The enterprise is asking for it and the community will naturally answer. Some will try to “fix” this with proprietary extensions on Hadoop, but ultimately the community will resolve this challenge. We will see technology emerge that allows you to get the “right” time applied to the “right” business requirements.
As there has been a lot of hype around Apache Hadoop and for as many new business ideas it presents, well there are new companies popping up all around to support these ideas. As the emergence of vertical based solutions progresses so too will the emergence of a new batch of startups ready to take advantage of the mainstream adoption of Apache Hadoop.
Hadoop has already established itself as the next generation data platform, however, with Apache Hadoop v2, the enterprise will adopt it for more than pilot and small projects. It will become the data backbone for many because of the advances in Apache Hadoop v2 make it more reliable and more stable. Personally, our Hortonworkers are excited and proud of this new architecture as our team has been busy building and testing it and can’t wait to see it prove value.
Related to number four prediction, existing application vendors will all clamor to make their products Hadoop-compatible. Led by Teradata and Microsoft and many others, application vendors are waking up to the reality that their applications must run on Hadoop. Already, it seems everyone is building a reference architectures which incorporate Hadoop and HDP to leverage all the goodness they already provide around data lifecycle management, data governance, security, etc. Meanwhile the Hadoop community is doing everything it can to foster adoption by the ISVs. In 2013, nearly everyone will be speaking big data.
This prediction is admittedly a little self-serving as Hortonworks employs the founder and many of the contributors behind Apache Ambari, but we are believers. We believe that Ambari will set the standard for operational services for Enterprise Hadoop as it allows organizations to more easily easy to consume, deploy and manage a cluster. It has already reached parity with the proprietary solutions available and with the power of the community it is accelerating and adding new features at an astonishing rate. Again, this fully dedicated open source approach not only provides the right tools but also showcases the extraordinary rate at which the democracy of the community can innovate.
Now this is just our opinion… What are YOUR predictions? please comment!
Happy new year and we look forward to seeing all of these come true!