The Hortonworks Community Connection is now live. A completely rebuilt Q&A forum, Knowledge Base, Code Hub and more, backed by the experts in the industry.

You will be redirected here in 10 seconds. If your are not redirected, click here to visit the new site.

The legacy Hortonworks Forum is now closed. You can view a read-only version of the former site by clicking here. The site will be taken offline on January 31,2016

HDP on Linux – Installation Forum

Can I seperate Hadoop Master Nodes from DataNodes ?

  • #13210

    For some reason, I want to configure my hadoop cluster with master node seperated from datanodes. What I want are :
    Clusters:10 nodes
    Master Nodes :Host001,Host002,Host003 ===>3 master nodes
    Slave Nodes:Host004,Host005,Host006,Host007,Host008,Host009====>7 slave nodes
    Host001 :NameNode+Zookeeper1,
    Host002: SecondNomenode+Jobtracker+Zookeeper2 ,

    But I found HMC can not configure Master nodes separated from Slave Nodes
    What I got from HMC deployment were :
    Host001 :NameNode+Zookeeper1, +DataNode+HDFS+Regionserver
    Host002: SecondNomenode+Jobtracker+Zookeeper2 ,+DataNode+HDFS+Regionserver

    How can I get what I want by configuring HMC or something?
    Can I separate Hadoop Master Nodes from DataNodes completly?


  • Author
  • #13223

    Hi Jeff,

    You can separate the masters from the slaves, during the HMC install you have the ability to change what components go to which node. there is a step in the install that shows you which components are going to each node on this same step to the right of this list there are drop downs for each component you can select a different node from this list.



    Hi Tedr:

    Is HMC node master or slave ?

    Can I deploy a cluster that HMC node with no data node ?

    Due to HMC node failure , I want my HMC node with HMC function only,

    but in fact , I found that HMC always configure a data node with itself.

    Is it a bug?



    Hi Jeff,

    The HMC node is not a master or a slave in the same sense that hadoop has masters and slaves. The HMC node is the node on which the main HMC service is installed and run. I am looking into whether or not it can be installed without a datanode. It is possible to decommission the datanode that is installed with it if if cannot be installed without it.


The forum ‘HDP on Linux – Installation’ is closed to new topics and replies.

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.