Hortonworks Data Platform

The completely open source Apache Hadoop data platform, architected for the enterprise

HDP 2.1 delivers enterprise Hadoop

Architected, developed, and built completely in the open, Hortonworks Data Platform (HDP) provides Hadoop designed to meet the needs of enterprise data processing.

HDP is a platform for multi-workload data processing across an array of processing methods - from batch through interactive to real-time - all supported with solutions for governance, integration, security and operations.

Completely Open
HDP is the only completely open Hadoop data platform available. All solutions in HDP are developed as projects through the Apache Software Foundation (ASF). There are NO proprietary extensions or add-ons required.
Fundamentally Versatile
At its heart HDP offers linear scale storage and compute across a wide range of access methods from batch to interactive, to real time, search and streaming. It includes a comprehensive set of capabilities across governance, integration, security and operations.
Wholly Integrated
HDP integrates with and augments your existing applications and systems so that you can take advantage of Hadoop with only minimal change to existing data architectures and skillsets. Deploy HDP in-cloud, on-premise or from an appliance across both Linux and Windows.

HDP : A full Enterprise Hadoop Data Platform

Hortonworks Data Platform enables Enterprise Hadoop: the full suite of essential Hadoop capabilities that are required by the enterprise and that serve as the functional definition of any data platform technology. This comprehensive set of capabilities is aligned to the following functional areas: Data Management, Data Access, Data Governance and Integration, Security, and Operations.

Presentation & Applications
Enable both existing and new applications to provide value to the organization.
Enterprise Management & Security
Empower existing operations and security tools to manage Hadoop.
Governance Integration
Data Workflow, Lifecycle & Governance
Data Access
Access your data simultaneously in multiple ways (batch, interactive, real-time)
Script
SQL
NoSQL
Stream
Search
Others...
Store and process your Corporate Data Assets
HDFS
Distributed File System
Data Management
Security
Store and process your Corporate Data Assets
Authentication, Authorization, Accounting & Data Protection
Operations
Deploy, Manage and Monitor
Provision, Manage & Monitor
Scheduling
Deployment Choice
  • Linux & Windows
  • On Premise or Cloud/Hosted

HDFS & YARN : The core of Hadoop

Data Management

The core components of HDP are YARN and Hadoop Distributed Filesystem (HDFS). YARN is the data operating system of Hadoop that enables you to process data simultaneously in multiple ways. YARN provides the resource management and pluggable architecture for enabling a wide variety of data access methods. HDFS provides the scalable, fault-tolerant, cost-efficient storage for big data.

More info : HDFS | YARN

Access data from a variety of engines

Data Access

YARN provides the foundation for a versatile range of processing engines that empower you to interact with the same data in multiple ways, at the same time. This means applications can interact with the data in the best way: from batch to interactive SQL or low latency access with NoSQL. Emerging use cases for search and streaming are also supported with Apache Solr and Storm. Additionally, ecosystem partners provide even more specialized data access engines for YARN.

More info : Hive | Tez | Pig | Storm | HBase | Accumulo | Solr

Load and manage data according to policy

Data Governance & Integration

HDP extends data access and management with powerful tools for data governance and integration. They provide a reliable, repeatable, and simple framework for managing the flow of data in and out of Hadoop. This control structure, along with a set of tooling to ease and automate the application of schema or metadata on sources is critical for successful integration of Hadoop into your modern data architecture.

Hortonworks has engineering relationships with all of the data management providers to enable their tools to work and integrate with HDP.

More info : Falcon | Oozie | Sqoop | Flume

Authentication, Authorization, & Data Protection

Security

Security is woven and integrated into at HDP in multiple layers. Critical features for authentication, authorization, accountability and data protection are in place so that you can secure HDP across these key requirements. Consistent with approach throughout all of the enterprise Hadoop capabilities, HDP also ensures you can integrate and extend your current security solutions to provide a single, consistent, secure umbrella over your modern data architecture.

More info : Knox | Security

Provision, manage, monitor and operate Hadoop clusters at scale

Operations

Operations teams deploy, monitor and manage a Hadoop cluster within their broader enterprise data ecosystem. HDP delivers a complete set of operational capabilities that provide both visibilities into the health of your cluster as well as tooling to manage configuration and optimize performance across all data access methods. Apache Ambari provides APIs to integrate with existing management systems: for instance Microsoft System Center and Teradata ViewPoint.

More info : Ambari | Zookeeper

Integrates with your data analytics tools

Application Integration

Hortonworks has a thriving ecosystem of vendors providing additional capabilities and/or integration points. These partners contribute to and augment Hadoop with given functionality across Business Intelligence and Analytics, Data Management Tools and Infrastructure. Systems Integrators of all sizes are building skills to assist with integration and solution development.

More info : HDP as part of a modern data architecture

Deploy on-premise, in the cloud, on Windows too.

Deploy As Needed

HDP provides the broadest range of deployment options for Hadoop: from Windows Server or Linux to virtualized Cloud deployments. It is the most portable Hadoop distribution, allowing you to easily and reliably migrate from one deployment type to another.

More info : Microsoft | RedHat | Rackspace | Teradata

The Hortonworks engineering team includes contributors and committers across the array of Hadoop projects.More about Hortonworks' innovation on community projects.

Not only open-source, but built in the open.

HDP demonstrates our commitment to growing Hadoop and it's sub-projects with the community and completely in the open. HDP is assembled entirely of projects built through the Apache Software Foundation. How is this different from open-source, and why is it so important?

Proprietary Hadoop extensions can be made open-source simply by publishing to github. But compatability issues will creep in, and as the extensions diverge from the trunk, so too does reliance on the extension's vendor.

Community driven development is different. By combining the efforts of technologists across a diverse range of companies, the roadmap is stronger, and the quality deeper. In the long run community driven innovation will outpace that of any single company. Learn More...

Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.
Integrate with existing systems
Hortonworks maintains and works with an extensive partner ecosystem from broad enterprise platform vendors to specialized solutions and systems integrators.