The recent O'Reilly Strata conference offered an opportunity for industry professionals to gather and talk about the latest in Hadoop and big data advancements. As attendees reflect on big data trends and announcements from the event, several noted that Hadoop is being solidified as a must-have component of enterprise IT.
This belief is particularly strong following product announcements from companies such as Revolution Analytics and Microsoft, InformationWeek Executive Editor Doug Henschen noted. Microsoft's introduction of the Hortonworks Data Platform for Hadoop brings big data analytics to Windows, enables integration with Microsoft System Center and works with Microsoft's virtualization platform, making it the first distribution to run Hadoop on a virtualized infrastructure.
Revolution Analytics' introduction of in-database predictive analytics will cut the time analysts spend moving data between platforms, creating faster, more convenient big data processing, Chief Strategy Office Michele Chambers told InformationWeek. By allowing users to access data in Hadoop HBase and use in-memory processing across Hadoop nodes, the company's product differentiates itself from existing solutions. Revolution Analytics' partnership with Hortonworks will allow many current Hadoop users to quickly begin taking advantage of this new approach.
Examining these usability innovations, Forbes contributor and Neuralytix founder Ben Woo said that the takeaway from the conference is that Hadoop will soon be as fundamental a part of IT as Linux or Windows and that the information market will change as Hadoop file systems become commonplace.
"We all believe that the traditional enterprise data warehouse (EDW) will evolve from being relational to non-relational within five to 10 years," Woo wrote. "We all believe that the open-source nature of the Hadoop framework will drive cost down, and most importantly create new value and innovation in a very short time frame."
He added that many attendees were turning their focus to more business applications of Hadoop. Rather than just focusing on changes geared toward IT professionals, the next generation of Hadoop innovations is likely to be focused on transforming enterprises through big data initiatives.