HP and Hortonworks recently announced a strategic partnership that included a $50 million equity investment by HP. While the investment is important, there is an equally important joint commitment to help accelerate the adoption of Enterprise Apache Hadoop by deeply integrating the Hortonworks Data Platform (HDP) with the HP HAVEn big data platform.
Below are some thoughts on our joint work from the HP OMi Team…
The first area of joint engineering strategy between our companies will be to integrate Apache Ambari with HP Operations Manager i (OMi) which provides tools and APIs to provision, manage and monitor Hadoop clusters. In fact, HP has already completed a lot of the work to integrate Hadoop with HP OMi. In this blog, we envision how customers can profit from the years of expertise HP has in some of the most demanding enterprise environment as applied to Hadoop.
Hadoop clusters provide elasticity with dynamic scaling & transient workloads – the HP OMi Hadoop Management Pack automatically follows this elasticity by discovering new Hadoop cluster configurations to maintain an up to date view of the entire cluster infrastructure. Monitoring best practices are then automatically assigned to these nodes and activated, ensuring monitoring is always optimal. The management data provided is then exploited to identify root cause rapidly by correlating with underlying infrastructure components, out of the box reports for forecasting & capacity planning and out of the box integrations with a range of ticketing systems. Dependencies are used to map application and business services to YARN controlled Hadoop components in the OMi management server. This adds cross domain root cause analysis to HDP, giving holistic IT visibility to operations staff, and ensuring they are focused on the right priorities, features that are soon to be certified.
The HP OMi server is then capable of executing remedial action through integration with runbook automation (see more details in our google hangout) . This could allow the Enterprise management solution to execute configuration changes through Ambari APIs, and ensure varying business requirements are automatically addressed, as well as releasing resources as appropriate.
In our alliance with Hortonworks, HP envisions integrating with Apache Ambari, but to get further involved in additional projects within the HDP stack such as Apache Pig and Apache Hive so that we can support end to end Hadoop monitoring scenarios.