Home Forums HDP on Linux – Installation Name Node storage directory

This topic contains 2 replies, has 2 voices, and was last updated by  Sivagamasundari Veerabahu 10 months ago.

  • Creator
    Topic
  • #43414

    How many namenode storage directories should there be ?
    Because the installer(HDP2.0 thru Ambari) chose 5 dirs, and the name node was failing to start.
    When I removed 4 directories and made it to one dir. It started fine.

    Why does the installer(HDP2.0) choose 5 dir as namenode storage dirs?
    Ideally how many should there be, Currently I have only 1 dir as the namenode storage.. is this ok?
    I have enough storage space in this dir.

    I am trying to see if this is related to the heap size (shooting up) and going into safe mode issue (I posted earlier)
    Please advice.

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #43895

    Thanks Dave, your info was very helpful.

    I am talking about >dfs.namenode.name.dir< in the hdfs-site.xml which I think is the namenode storage dir.
    For some reason during the install when this had 5 dirs by default, it failed to start, when I changed into just 1 dir, it started fine.
    So just wanted to understand.

    I have another question on the Region Manager for Hbase, I have 2 node cluster, I have Hbase and Region Server on server1(datanode1), I do not have Region server on the 2nd datanode in server2.Architecture pics show that region server should be installed on all datanodes ?
    Whats the impact if I do not have the region manager on datanode2, and Can I add thru Ambari, can i do it while services are running,
    Any configuration files I need modify when I add a region server to a datanode ?
    I opened a separate thread for this, but please respond in any..

    Thanks again!

    Collapse
    #43890

    Dave
    Moderator

    Hi,

    There can be as many as you like for redundancy purposes.
    In most installs I see 3 – are you speaking about dfs.namenode.storage.dir in hdfs-site.xml ?
    I have just installed a fresh install and it only setup one – which I specified.
    I think your issues were to do with available disk space – which was resolved in your earlier post.

    Thanks

    Dave

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)