StackIQ, a Hortonworks technology partner, offers a comprehensive software suite that automates the deployment, provisioning, and management of Big Infrastructure. In this guest blog, Anoop Rajendra (@anoop_r), a Senior Software Developer at StackIQ, gives instructions for using StackIQ Cluster Manager to deploy Apache Ambari on a cluster running Hortonworks Data Platform (HDP).
Provisioning, managing and monitoring an Apache™ Hadoop cluster can be challenging. With this in mind, the engineers at Hortonworks introduced the Apache Ambari project into the Apache Software Foundation.
Apache Ambari is used by hundreds of enterprises to manage thousands of Hadoop nodes. It provides a web interface that enables the deployment of Hadoop services across a cluster.
However, this requires an additional deployment step. While Ambari is used to deploy an HDP cluster, Ambari itself needs to be setup on a cluster too. StackIQ Cluster Manager executes this important step.
Using the StackIQ Bridge Roll for HDP, the administrator can easily deploy Ambari on a cluster by following the step-by-step instructions below.
First install StackIQ Cluster Manager with the StackIQ Bridge Roll for HDP. For instructions on how to install StackIQ Cluster Manager with the StackIQ Bridge Roll for HDP, refer to the StackIQ Cluster Core Users Guide and the HDP-Bridge Users Guide.
Once StackIQ Cluster Manager is up and running, you are now ready to download StackIQ Rolls for Hortonworks Data Platform (HDP) & Ambari.
Download the following Rolls from the given locations:
Depending on your inbound network connectivity and speed, the process may take anywhere from 30 minutes to 3 hours.
Once all the rolls are downloaded, add each ISO to your distribution.
rocks add roll
Enable the rolls by running:
rocks enable roll HDP Updates-HDP ambari Updates-ambari HDP-UTILS
Re-create the distribution by running:
rocks create distro
StackIQ Cluster Manager is now fully capable of deploying Ambari on your cluster.
Using the StackIQ web interface, or the insert-ethers utility, install an Ambari appliance. This will install and configure Ambari on the appliance.
Note: Deploy only one machine on your cluster as Ambari appliance.
After the Ambari appliance is deployed, you can then deploy all the other machines in your cluster as compute appliances using the same StackIQ web UI or the insert-ethers utility.
The Ambari service is a web service that allows the administrator to deploy HDP services, like HDFS, MapReduce, YARN, Hive, and HBase.
The administrator can access the Ambari Web interface at port 8080 on the Ambari appliance. For example, if the hostname of the Ambari appliance is ambari-0-0, point your web-browser to http://ambari-0-0:8080/
Log in to Ambari as user “admin” and password “admin”.
Enter the name that you’d like to use for the HDP cluster. Click “Next”
Select the version of HDP that you’d like to use. By default, only the latest version is made available. For any other version, you will need to download the bits.
Enter the bootstrapping information about the hosts, and the private key.
Click “Next” to start the installation of hosts.
Next, choose the services you want to install
Assign client components
Customize the services. This allows you to fix mistakes in the default configuration. As shown below, the services that require attention (Hive, Oozie, and Nagios have a red tag next to them).
Review the setup, and click “Deploy”
This last screen shows the status of the installation.
At the end of this process, you should have a fully functional HDP installation.
We’re certain you’ll find this the quickest and easiest way to configure and deploy Apache Ambari on an HDP cluster.
Give it a shot and send us your questions or comments!
—The StackIQ Team