Hadoop Insights

News about Hadoop in the wild; how Hadoop is being used; how Hadoop can be used.

It’s been 20 years since I was “the new Guy.”

Hello friends and colleagues. I wanted share some thoughts after my first 90 days at Hortonworks. It’s been a thrill ride to say the least, there is all of the normal new guy / first impression stuff – and for those of you who know me, you know I am very sensitive to all that!

Working with our founders and engineering team has been a blast.…

Along with the Hortonworks Oil and Gas team, I have been working closely with Laurence Sones, senior petrophysicist, to understand how Hadoop-based Data Discovery is enabling Geologic and Geophysical (G&G) teams to improve decision-making across their assets. What follows is a Q&A session with Laurence discussing his perspectives on data discovery.

Kohlleffel: Laurence, you have a wealth of experience in the oil and gas industry. Please discuss your background and some of the roles that you have taken on.…

A recent article in PropertyCasualty 360, The Internet of Things: Insurers must prepare for disruption, customer impact, highlights the imperative for insurer strategies that address the emergence of the Internet of Things (IoT) and how it changes customer behaviors and their views of risk. The article predicts that as consumers have more access to data through their connected devices:

The IoT will fundamentally change what consumers know, when they know it, and how they interact with businesses that serve them.…

The world is now estimated to be churning out quintillions of bytes of data every day, which goes to show why the industry is struggling to keep up with the ever increasing demand for data scientists to pinpoint those insights that can increase company revenues, or better manage their resources.

The McKinsey Global Institute predicts the industry will need at least 190,000 more workers with analytics expertise and 1.5 million more data-savvy managers by 2018 in the US alone.…

Earlier this month, Hortonworks had the pleasure of joining Yahoo! in hosting the 8th Annual Hadoop Summit, the leading conference for the Apache Hadoop community. Summit is always an important and exciting experience, bringing together thought leaders, technologists, and data specialists from throughout the community to explore and advance the art and science of Big Data.

This year’s event came at a pivotal time for Hadoop and Hortonworks, with news about Open Enterprise Hadoop and the launch of the newest version of Hortonworks Data Platform (HDP 2.3™) poised to transform the way large organizations in every industry process data.…

Hadoop isn’t optional for today’s enterprises—that much is clear. But as companies race to get control over the significantly growing volumes of unstructured data in their organizations, they’ve been less certain about the right way to put Hadoop to work in their environment.

We’ve already seen a variety of wrong approaches with proprietary extensions that limit innovation, fragment architectures and trade openness for vendor lock-in. Now a new consensus is forming around an emerging category that drives truly transformational outcomes: Open Enterprise Hadoop.…

As we approach Hadoop Summit in San Jose next week, the debate continues over where Hadoop really is on its adoption curve. George Leopold from Datanami was one of the first to beat the hornet’s nest with his article entitled Gartner: Hadoop Adoption ‘Fairly Anemic’. Matt Asay from TechRepublic and Virginia Backaitis from CMSWire volleyed back with Hadoop Numbers Suggest the Best is Yet to Come and Gartner’s Dismal Predictions for Hadoop Could Be Wrong, respectively.…

Today I am excited to announce that we have made a significant expansion of our operations in Australia in response to growing demand for open enterprise Hadoop in Australia and around the APAC region.

Focused on Sydney but with the ability to execute across Australia, this year we have hired several senior sales and technical staff drawn from industry-leading technology vendors. With this additional experience, we are better able to help customers regionally with their big data needs.…

Today from TU-Automotive Detroit, we announced our partnership with HARMAN, the leading global infotainment, audio and software services company.

Hortonworks and HARMAN are partnering to transform the automotive enterprise by enabling the connected car ecosystem with real-time, Internet of Things (IoT) data, insights and prognostics solutions.

The widespread adoption of connected devices is accelerating. Gartner Research expects 25 billion installed devices by 2020. Together, Hortonworks and HARMAN will offer solutions to help automotive manufacturers gain valuable insights by analyzing real-time information based on data streaming from connected cars.…

Hortonworks proudly announces the launch of a new education program for Academic Institutions. This program was created to introduce students to the Hortonworks Data Platform (HDP) and to provide them with the necessary technical skills to complement their chosen academic curriculum.

Accredited colleges and universities around the world are invited to apply to become a Hortonworks Academic Partner, allowing them to incorporate our course materials into their classrooms at a low cost to students.…

Hortonworks proudly announces the launch of a new education program for Academic Institutions. This program was created to introduce students to the Hortonworks Data Platform (HDP) and to provide them with the necessary technical skills to complement their chosen academic curriculum.

Accredited colleges and universities around the world are invited to apply to become a Hortonworks Academic Partner, allowing them to incorporate our course materials into their classrooms at a low cost to students.…

Hadoop really is everywhere. In his recent post, “Going from Hadoop Adoption to Hadoop Everywhere” Shaun Connolly made this point and also quoted Forrester’s Mike Gualtieri:

Hadoop is a must-have for large enterprises

Shaun mentioned these key trends in his post:

  • Hadoop is transforming every industry
  • Enterprises are building applications to make use of all kinds of data
  • Hadoop is ready for the enterprise

Earlier this month, we released Hortonworks’ first quarter earnings.…

In this guest blog, IDC Program Director for Retail Insights Greg Girard shares his insights how retailers employ big data and analytics to drive decision and action across myriad industries. 

Big data and analytics (BDA) have become top agenda items for a growing number of retail executives, and rightly so in the broader social and economic context of data-enabled decision and action. While “data-driven,” as a term, has been around for quite some time, the ability to act on insight has taken on new urgency.…

TU-Automotive Detroit (formerly Telematics Detroit) is the premier industry show focused on connected car and telematics and Hortonworks is proud to be a Platinum Sponsor of the conference. We hope you can visit us at the show, to learn more about Hadoop for the connected car and infotainment in the vehicle.

Register for TU-Automotive

Hortonworks counts some of the world’s premier automakers among its subscribers, and at TU-Automotive Detroit, on Wednesday June 3, Hortonworks President Herb Cunitz will deliver a keynote presentation Leveraging Telematics Data in a Connected World that will discuss some common automotive use cases.…

All segments of the oil and gas industry are adopting Hadoop, from exploration through to drilling, production, transportation, refining, and retail.

The Hortonworks Oil and Gas team will be demonstrating some of the Hadoop-based advanced analytics applications for the upstream oil and gas industry at PNEC Houston (the International Conference on Petroleum Data Integration, Information, and Data Management) running from May 19-21.

A Transformation in O&G

On a daily basis, the geological and geophysical discipline in upstream oil and gas must deal with a significant number of disparate datasets.…