YARN Ready Program
Tools and applications that are YARN Ready have been verified to work within YARN, which means they are able to use the resources of the customer’s Hadoop system to process Hadoop data in-place, without interfering with other YARN Ready tools and applications.
Apache Hadoop YARN is the data operating system for Hadoop 2, responsible for managing access to Hadoop’s critical resources. YARN enables a user to interact with all data in multiple ways simultaneously, making Hadoop a true multi-use data platform and allowing it to take its place in a modern data architecture. Customers building a data lake expect to operate on the data without moving it to other systems, leveraging the processing resources of the data lake. Applications that use YARN fulfill that promise, lowering operational costs while improving quality and time-to-insight.
Looking for existing YARN Ready applications?
YARN Ready applications include those from these partners, and many more…
How do you become YARN Ready?
The first step is to determine the appropriate integration framework for your application. If it uses YARN natively, or uses a YARN framework (e.g. Apache Tez, Apache Slider, etc.), you’re well on your way. If it does not use YARN — e.g. it reads directly from HDFS — you’ll want to look into the expanding number of approaches that allow you to move to a YARN-based application.
There are four options available for integration into YARN:
|Full control||YARN Native||Custom or packaged app where fine grained control of cluster resources is required|
|Batch (Legacy)||MapReduce||Existing MapReduce application written for the 1.x code line|
|Batch or Interactive Query||Tez||Business Intelligence or analytic applications that optimize throughput while reducing latency|
|Online or Realtime Service||Slider||“Always-on” services, e.g. online or streaming applications|
Note that applications that interact with Hadoop solely via Hive will also qualify for YARN Ready, since Hive uses Tez and MapReduce – both YARN frameworks.
Once your application uses YARN, either natively or through a YARN framework, submit your application’s information to the Hortonworks certification team. Instructions are included in the certification kit available to members of the Hortonworks Certified Technology Program
- What is YARN? (includes links to YARN blog series)
- Getting Started with YARN (includes real-world code samples)
- Arun Murthy’s YARN book
- Hortonworks Community Forums for YARN, Slider, and Tez
Integrating Applications Natively to YARN (Part 1 of 3) – July 24 @ 9am PT
Integrating Applications using Slider (Part 2 of 3) – August 7 @ 9am PT
Integrating Applications using Tez (Part 3 of 3) – August 21 @ 9am PT
Introduction to YARN Ready - Recording of webinar held June 19, 2014