Get fresh updates from Hortonworks by email

Once a month, receive latest insights, trends, analytics information and knowledge of Big Data.

cta

Get Started

cloud

Ready to Get Started?

Download sandbox

How can we help you?

closeClose button
July 29, 2014
prev slideNext slide

Deploy Apache Ambari on HDP Clusters with StackIQ

StackIQ, a Hortonworks technology partner, offers a comprehensive software suite that automates the deployment, provisioning, and management of Big Infrastructure. In this guest blog, Anoop Rajendra (@anoop_r), a Senior Software Developer at StackIQ, gives instructions for using StackIQ Cluster Manager to deploy Apache Ambari on a cluster running Hortonworks Data Platform (HDP).

Provisioning, managing and monitoring an Apache™ Hadoop cluster can be challenging. With this in mind, the engineers at Hortonworks introduced the Apache Ambari project into the Apache Software Foundation.

Apache Ambari is used by hundreds of enterprises to manage thousands of Hadoop nodes. It provides a web interface that enables the deployment of Hadoop services across a cluster.

However, this requires an additional deployment step. While Ambari is used to deploy an HDP cluster, Ambari itself needs to be setup on a cluster too. StackIQ Cluster Manager executes this important step.
Using the StackIQ Bridge Roll for HDP, the administrator can easily deploy Ambari on a cluster by following the step-by-step instructions below.

Step 1: Install the StackIQ Cluster Manager

First install StackIQ Cluster Manager with the StackIQ Bridge Roll for HDP. For instructions on how to install StackIQ Cluster Manager with the StackIQ Bridge Roll for HDP, refer to the StackIQ Cluster Core Users Guide and the HDP-Bridge Users Guide.

Step 2: Download HDP and Ambari Bits

Once StackIQ Cluster Manager is up and running, you are now ready to download StackIQ Rolls for Hortonworks Data Platform (HDP) & Ambari.
Download the following Rolls from the given locations:

  1. HDP 2.x Roll: https://s3.amazonaws.com/stackiq-release/stack3/HDP-2.x-6.5-0.x86_64.disk1.iso
  2. Updates to HDP Roll: https://s3.amazonaws.com/stackiq-release/stack3/Updates-HDP-2.x-6.5-0.x86_64.disk1.iso
  3. Ambari Roll: https://s3.amazonaws.com/stackiq-release/stack3/ambari-1.x-6.5-0.x86_64.disk1.iso
  4. . Updates to Ambari Roll: https://s3.amazonaws.com/stackiq-release/stack3/Updates-ambari-1.4.4.23-6.5-0.x86_64.disk1.iso
  5. HDP Utils 1.1.0-16 Roll: https://s3.amazonaws.com/stackiq-release/stack3/HDP-UTILS-1.1.0.16-6.5-0.x86_64.disk1.iso

Depending on your inbound network connectivity and speed, the process may take anywhere from 30 minutes to 3 hours.

Step 3: Add the HDP and Ambari Bits to your Distribution

Once all the rolls are downloaded, add each ISO to your distribution.
rocks add roll
Enable the rolls by running:
rocks enable roll HDP Updates-HDP ambari Updates-ambari HDP-UTILS
Re-create the distribution by running:
rocks create distro
StackIQ Cluster Manager is now fully capable of deploying Ambari on your cluster.

Step 4: Deploy Ambari Appliance

Using the StackIQ web interface, or the insert-ethers utility, install an Ambari appliance. This will install and configure Ambari on the appliance.
Note: Deploy only one machine on your cluster as Ambari appliance.

Step 5: Deploy Compute Appliances

After the Ambari appliance is deployed, you can then deploy all the other machines in your cluster as compute appliances using the same StackIQ web UI or the insert-ethers utility.

Step 6: Configuring HDP Using Ambari

The Ambari service is a web service that allows the administrator to deploy HDP services, like HDFS, MapReduce, YARN, Hive, and HBase.
The administrator can access the Ambari Web interface at port 8080 on the Ambari appliance. For example, if the hostname of the Ambari appliance is ambari-0-0, point your web-browser to http://ambari-0-0:8080/
Log in to Ambari as user “admin” and password “admin”.
stackiq_1

Enter the name that you’d like to use for the HDP cluster. Click “Next”

stackiq_2

Select the version of HDP that you’d like to use. By default, only the latest version is made available. For any other version, you will need to download the bits.

stackiq_4

The repository should already be set to point to the correct location.
Verify this.
stackiq5

Enter the bootstrapping information about the hosts, and the private key.

stack6iq

Click “Next” to start the installation of hosts.

stackiq_7

After this, the wizard may warn you of inconsistencies in the system. Unless the install fails, you may be ignore this warning.
stackiq_8

Next, choose the services you want to install

stackiq_9

Assign the master/server components to the hosts
stackiq_10

Assign client components

stackiq_11

Customize the services. This allows you to fix mistakes in the default configuration. As shown below, the services that require attention (Hive, Oozie, and Nagios have a red tag next to them).

stackiq_12

Review the setup, and click “Deploy”

stackiq_13

This last screen shows the status of the installation.

stackiq_14

At the end of this process, you should have a fully functional HDP installation.
Congratulations!

stackiq_15

We’re certain you’ll find this the quickest and easiest way to configure and deploy Apache Ambari on an HDP cluster.
Give it a shot and send us your questions or comments!
—The StackIQ Team

Tags:

Leave a Reply

Your email address will not be published. Required fields are marked *

If you have specific technical questions, please post them in the Forums

You may use these HTML tags and attributes: <a href="" title=""> <abbr title=""> <acronym title=""> <b> <blockquote cite=""> <cite> <code> <del datetime=""> <em> <i> <q cite=""> <s> <strike> <strong>