HDP on Linux – Installation Forum

Ambari Heatmaps does not display rack info correctly

  • #32291
    York Yao
    Member

    Hello,

    I have install hdp 1.3.1 using ambari, and deploy the correct topology script. I can see the rack information when namenode and job tracker startup. I can also see the rack information by running “hadoop fsck /” in which “Number of Racks” is displayed at last.

    But the “heatmaps” in the ambari web always show as “default rack”. Does anyone else also encounter the same problem? Is this a bug?

    Thanks!

    York

    NameNode:
    2013-08-15 10:41:10,715 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: node registration from xxx.xx.xx.22:50010 storage DS-947897631-xxx.xx.xx.22-50010-1374610700102
    2013-08-15 10:41:10,773 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /hhh-hhhhhhh.com-p/r12/xxx.xx.xx.22:50010
    2013-08-15 10:41:10,774 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: node registration from xxx.xx.xx.26:50010 storage DS-1133508292-xxx.xx.xx.26-50010-1374610672670
    2013-08-15 10:41:10,782 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /hhh-hhhhhhh.com-p/r14/xxx.xx.xx.26:50010
    2013-08-15 10:41:10,782 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: node registration from xxx.xx.xx.18:50010 storage DS-1976774260-xxx.xx.xx.18-50010-1374610669320
    2013-08-15 10:41:10,790 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /hhh-hhhhhhh.com-p/r13/xxx.xx.xx.18:50010
    2013-08-15 10:41:11,310 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: node registration from xxx.xx.xx.12:50010 storage DS-676474874-xxx.xx.xx.12-50010-1374610674368
    2013-08-15 10:41:11,319 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /hhh-hhhhhhh.com-p/r11/xxx.xx.xx.12:50010
    2013-08-15 10:41:11,321 INFO org.apache.hadoop.hdfs.StateChange: *BLOCK* NameNode.blocksBeingWrittenReport: from xxx.xx.xx.12:50010 0 blocks
    2013-08-15 10:41:11,330 INFO org.apache.hadoop.hdfs.StateChange: BLOCK* registerDatanode: node registration from xxx.xx.xx.13:50010 storage DS-61729491-xxx.xx.xx.13-50010-1374610674611
    2013-08-15 10:41:11,337 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /hhh-hhhhhhh.com-p/r11/xxx.xx.xx.13:50010
    2013-08-15 10:41:11,340 INFO org.apache.hadoop.hdfs.StateChange: *BLOCK* NameNode.blocksBeingWrittenReport: from xxx.xx.xx.13:50010 0 blocks

    JobTracker:
    2013-08-15 10:45:07,947 INFO org.apache.hadoop.mapred.JobTracker: Starting RUNNING
    2013-08-15 10:45:08,389 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /hhh-hhhhhhh.com-p/r12/hdp1r12n02-hhh-hhhhhhh.com
    2013-08-15 10:45:08,391 INFO org.apache.hadoop.mapred.JobTracker: Adding tracker tracker_hdp1r12n02-hhh-hhhhhhh.com:localhost/127.0.0.1:45983 to host hdp1r12n02-hhh-hhhhhhh.com
    2013-08-15 10:45:08,410 INFO org.apache.hadoop.net.NetworkTopology: Adding a new node: /hhh-hhhhhhh.com-p/r13/hdp1r13n04-hhh-hhhhhhh.com
    2013-08-15 10:45:08,411 INFO org.apache.hadoop.mapred.JobTracker: Adding tracker tracker_hdp1r13n04-hhh-hhhhhhh.com:localhost/127.0.0.1:45369 to host hdp1r13n04-hhh-h

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #73500
    Alex McLintock
    Participant

    Sorry to bump a two year old post but I am seeing the same thing with HDP 2.2.0 and Ambari 1.7.0

    We started off with just the default rack, added the rack configuration in (outside of Ambari) but the Ambari heatmap still refers to the default rack,

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.