Syncsort is a certified Hortonworks Technology and YARN Ready Partner and our guest blogger. Here, Tendu Yogurtcu, vice president of engineering at Syncsort, expands on Syncsort’s recent news about their integration of DMX-h and Ambari.
As Apache Hadoop YARN has transformed Hadoop from being a data processing solution to being a true data processing platform, requirements for provisioning, managing, and securing the platform have changed dramatically.
Stability, security, easy deployment, performance, management and monitoring are among many of the key attributes that make a data management platform enterprise-grade. YARN allows Hadoop to become a single platform for data storage and processing, on which multiple workloads, batch or real-time or interactive, can run. What does this mean for the Apache Hadoop stack? Does this inevitably mean more components and a higher level of complexity?
Apache Ambari addresses this challenge of managing a variety of workloads, processing engines and different access patterns. This week, we at Syncsort are excited to announce the deployment of Syncsort’s native Hadoop data integration product DMX-h via Apache Ambari. Syncsort is the first data integration solution to use Ambari Stacks, creating a unified user experience for deployment, management and monitoring across Hadoop clusters. This builds on our commitment to accelerate enterprise adoption of Hadoop by providing an intuitive user experience and a highly-secure, industrial scale data integration engine.
This integration between Syncsort DMX-h and Apache Ambari brings several benefits to the enterprise:
Jeff Sposetti’s blog post after this year’s Hadoop Summit discussed Ambari’s focus in three specific areas: operate, integrate and extend. With the upcoming release of Ambari 1.7, the community has been active developing on all three fronts. Ambari 1.7 allows the community to create custom Stack definitions to plug-in new services that can co-exist with Hadoop. This makes it easy for ISV applications to be deployed on Hadoop clusters, while maintaining the stable, predictable operational capabilities that an enterprise expects. Ambari 1.7 will also introduce Ambari Views, a technology that further allows ISV applications to tailor the user experiences for operators and end users.
Syncsort DMX-h extended Ambari with a custom Service definition. Integration was quite straightforward, the operational controls as defined in the Stack literally “just worked” — we easily implemented a DMX-h Service and exposed it using the Ambari REST APIs. The DMX-h Service is automatically picked by Ambari and displayed in the Ambari 1.7 Web UI, and our joint customers can now use a single Hadoop management platform for all tools in the Hadoop stack.
Many thanks to the Hortonworks team for their collaboration, and feedback on the integration.
We expect to see ~5,000 people in next week’s Strata+Hadoop World 2014, a true testament to the growing ecosystem and number of Hadoop deployments. Syncsort and Hortonworks are committed to help enterprises overcome challenges in transitioning to the future of data management.
You can download DMX-h Service package for Apache Ambari via the Syncsort portal and try it with a Hortonworks Sandbox. Stop by our booth at Strata+Hadoop World to see a demo of the integration.