Dell EMC is a global leader in enabling businesses and service providers to transform their operations and deliver IT as a service. Fundamental to this transformation is cloud computing. Through innovative products and services, Dell EMC accelerates the journey to cloud computing, helping IT departments to store, manage, protect and analyze their most valuable asset – information – in a more agile, trusted and cost-efficient way. Additional information about Dell EMC can be found at www.EMC.com
Keith Manthey, Chief Technology Officer, Dell EMC
Watch The Cube interview with Keith Manthey of Dell EMC and Scott Andress of Hortonworks, recorded at EMC World 2016: theCUBE Production on May 3th, 2016.
Hortonworks and Dell EMC have partnered to help organizations use enterprise-grade Hadoop to get even more value from their EMC Isilon OneFS deployments. The combined solution comprising of EMC Isilon network-attached storage (NAS) and the Hortonworks Data Platform (HDP) combines massively scalable big data storage with robust analytics capabilities allowing enterprises to gain new efficiencies, accelerate business insight, and improve compliance with corporate governance or regulatory mandates. [Read the EMC Press Release in their Pulse Blog for more information]
EMC Isilon scale-out network-attached storage running the OneFS operating system provides a simple, scalable, and efficient platform that is certified to work with the Hortonworks Data Platform. The EMC Isilon system can store and utilize massive amounts of structured and unstructured data enabling various applications to access the scalable and accessible data repository without the overhead associated with traditional storage systems. EMC Isilon OneFS, the intelligence behind Isilon systems, is the industry’s leading scale-out NAS operating system known for supporting massive capacity, operational simplicity, extreme performance, and unmatched storage utilization. With proven enterprise-grade protection and security capabilities, Isilon OneFS is the ideal foundation to meet a wide variety of storage needs, including for a scale-out data lake.
Hortonworks Data Platform (HDP) together with EMC Isilon storage running the OneFS operating system provide a complete, tested, and popular solution encompassing Apache Hadoop and related projects or leveraging a data lake for getting the most value from your data. In fact, the testing for the OneFS operating system is one of the most rigorous in the industry, helping to ensure EMC customers have access to a robust Enterprise Hadoop distribution. The combination of HDP and Isilon shared storage helps organizations speed time-to-insights, improve storage utilization, eliminate islands or silos of storage, and lower storage management costs of migration, security and protection.
The scale-out data lake built EMC Isilon systems running OneFS provides improved data protection, security, compliance and governance while enabling enterprise to get to insights faster. Enterprises can reduce the risks of their big data project implementation and operational expenses by using HDP their in-place Isilon appliances. Highlights of Isilon OneFS-based Data Lake are:
EMC Isilon OneFS natively supports multiple protocols like SMB, NFS, File Transfer Protocol (FTP), and Hypertext Transfer Protocol (HTTP) for traditional workloads, and Hadoop Distributed File System (HDFS) for analytics, eliminating storage silos and ringing efficiencies and consistency to IT infrastructure.
Isilon OneFS provides highly resilient storage with unmatched data protection and availability. OneFS uses the proven Reed- Solomon erasure encoding algorithm rather than RAID to provide a level of data protection that goes far beyond traditional storage systems.
Enterprises can consolidate data from multiple islands into one single scale-out NAS storage system based on Isilon OneFS. This is made possible through the multiple access mechanisms at the protocol level where data can be ingested into the Isilon store from a wide variety of sources and surfaced for use by others.
Isilon OneFS meets compliance, governance, and regulatory requirements such as SEC Rule 17-a4, PCI DSS, and HIPPA by utilizing Isilon support for data confidentiality, integrity, and availability along with self-encrypting drives for data at rest encryption (DARE) requirements.
HDP - HDP Certified badge indicates this partner’s solution has been certified to work with HDP; reviewed for architectural best practices and validated against a comprehensive suite of integration test cases, benchmarked for scale under varied workloads and comprehensively documented.
Yarn Ready - Apache Hadoop YARN is the data operating system for Hadoop 2. YARN Ready certification recognizes applications that integrate with YARN and process data via pushdown computation to the cluster. Examples of a YARN ready solution includes an application that has native YARN application master or leverages scale-out capabilities of the platform like Hive, Spark and MR2.
Security Ready - Apache Hadoop is secured with a number of technologies, such as Kerberos, Apache Knox, and Apache Ranger. Security Ready certification recognizes applications that can integrate with Kerberos-enabled HDP cluster and supports HDFS encryption and user impersonation.
Operations Ready - Apache Ambari is the open source management fabric for Hadoop. Operations Ready certification recognizes applications that can either be deployed or managed via Ambari or integrate with Ambari's APIs.