HDP is the industry's only true secure, enterprise-ready open source Apache™ Hadoop® distribution based on a centralized architecture (YARN). HDP addresses the complete needs of data-at-rest, powers real-time customer applications and delivers robust analytics that accelerate decision making and innovation.
YARN and Hadoop Distributed File System (HDFS) are the cornerstone components of Hortonworks Data Platform (HDP). While HDFS provides the scalable, fault-tolerant, cost-efficient storage for your big data lake, YARN provides the centralized architecture that enables you to process multiple workloads simultaneously. YARN provides the resource management and pluggable architecture for enabling a wide variety of data access methods.
Data streaming, processing and analytics engines for a variety of workloads
Hortonworks Data Platform includes a versatile range of processing engines that empower you to interact with the same data in multiple ways, at the same time. This means applications can interact with the data in the best way: from batch to interactive SQL or low latency access with NoSQL. Emerging use cases for data science, search and streaming are also supported with Apache Spark, Storm and Kafka.
HDP extends data access and management with powerful tools for data governance and integration. They provide a reliable, repeatable, and simple framework for managing the flow of data in and out of Hadoop. This control structure, along with a set of tooling to ease and automate the application of schema or metadata on sources is critical for successful integration of Hadoop into your modern data architecture.
Hortonworks has engineering relationships with many leading data management providers to enable their tools to work and integrate with HDP.
Authentication, authorization, and data protection
Security is woven and integrated into HDP in multiple layers. Critical features for authentication, authorization, accountability and data protection are in place to help secure HDP across these key requirements. Consistent with this approach throughout all of the enterprise Hadoop capabilities, HDP also ensures you can integrate and extend your current security solutions to provide a single, consistent, secure umbrella over your modern data architecture.
Operations teams deploy, monitor and manage a Hadoop cluster within their broader enterprise data ecosystem. Apache Ambari simplifies this experience. Ambari is an open source management platform for provisioning, managing, monitoring, and securing the Hortonworks Data Platform. It enables Hadoop to fit seamlessly into your enterprise environment.
Provision and manage Hadoop clusters in any cloud environment
Cloudbreak, as part of Hortonworks Data Platform and powered by Apache Ambari, allows you to simplify the provisioning of clusters in any cloud environment including; Amazon Web Services, Microsoft Azure, Google Cloud Platform and OpenStack. It optimizes your use of cloud resources as workloads change.
Classification-based Policy. Assign access to data assets based on reusable metadata tags such as PCI or PII.
Location-based Policy. Customize entitlements based on geography. A user trying to access the same data from different locations would be subject to unique geographical context.
Data Expiry-based Policy Assign expiration dates to data tag to automatically deny users access to the tagged data after the expiration date.
Prohibition-based Policy. Define security policy that restricts combining two data sets to help avoid privacy violations.
Row Level Security & Dynamic Data Masking. Restrict row access and anonymize sensitive data in real-time in Hive based on user characteristics and runtime context.
For Hadoop operators
Role-Based Access Control. Apache Ambari 2.4 includes additional cluster operational roles to provide more granular division of control for cluster operations.
Log Search (Technical preview). Automatically configures the collection of cluster operational metrics to aid with analysis and troubleshooting by including a new Log Search service.
Customizable Cluster Alerts. Tailor HDP to fit with your enterprise monitoring environment by configuring a set of predefined alerts that seamlessly integrates with your existing enterprise monitoring tools.
Activity Reporting and Visualization. Activity Reporting and Visualization in Hortonworks SmartSense 1.3 (available separately) helps Hadoop operators understand how their cluster operates.
Try out the latest HDP features and functionality with Hortonworks Sandbox, or set HDP up for a production environment, install and configure your clusters.
Progressive Insurance is one of the largest U.S. auto insurance companies. The team turned to Hortonworks Data Platform to transform its business with massive ingest of new types of data. Progressive uses HDP for ad placement and to store driving data for its usage-based insurance products.
Download the Product Guide In this guide, discover: The technology components of HDP and its blueprint for Enterprise Hadoop. How HDP integrates and complements your existing data systems. The versatility of applications enabled by Apache Hadoop YARN at the core of HDP. How HDP provides security, operations and governance capabilities. Deployment for HDP from Linux…
How to Optimize your Data Architecture with Hadoop
You may be up all night wondering how enterprise organizations deal with large data volumes and data varieties without significantly increasing costs. And perhaps your existing data architectures are not equipped to handle today's data challenges? Join this webinar to learn how to optimize your data architecture and gain significant cost savings with Hadoop. We…
Why a Connected Data Strategy is critical to the future of your data The advent of big data revolutionized analytics and data science and created the concept of new data platforms, allowing enterprises to store, access and analyze vast amounts of historical data. The world of big data was born. But existing data platforms need…
One of a company’s main measures of success is through its customers. Nothing is more rewarding for us than learning about how data analytics experts are implementing a data-driven strategy. I spoke with a handful of our customers across Government, retail, telecommunications and automotive organizations to find out how things were going and what lessons they…
3 Ways Hortonworks Helps You Have More Time for the Holidays
As the hectic holiday season nears, we’re all looking for way to have a little more time for friends and family, to enjoy the season and perhaps slow down a little. But as many of us know, business doesn’t always wait. And for some, it’s one of the busiest times of year. Wouldn’t it be…
15 Questions and Answers from Apache NiFi, Kafka & Storm: Better Together
We just concluded our highly attended 7-part Data-In-Motion webinar series. The final installment was a very informative session on how Apache NiFi, Kafka and Storm work together. Slides and Q&A below. Should you have any more questions, anytime, we encourage you to check out the Data Ingestion & Streaming track of Hortonworks Community Connection where…
MiNiFI is a subproject of NiFi designed to solve the difficulties of managing and transmitting data feeds to and from the source of origin, often the first/last mile of digital signal, enabling edge intelligence to adjust flow behavior/bi-directional communication. Since the first mile of data collection (the far edge), is very distributed and likely involves…
How to Build IoT Intelligence from Geographically Distributed Sensor Data
Apache MiNiFi is designed to make it practical to enable data collection from the second it is born, ideal for IoT scenarios where there are a large number connected devices or a need for a smaller and more streamlined footprint than Apache NiFi. Join us as we share a use case and demo of Apache…
Apache, Hadoop, Falcon, Atlas, Tez, Sqoop, Flume, Kafka, Pig, Hive, HBase, Accumulo, Storm, Solr, Spark, Ranger, Knox, Ambari, ZooKeeper, Oozie, Metron and the Hadoop elephant and Apache project logos are either registered trademarks or trademarks of the Apache Software Foundation in the United States or other countries.