YARN Forum

Resource manager heap size

  • #43151
    Veerabahu
    Participant

    In the Ambari Dashboard HDP 2.0 – I see resource manager heap is 93%..
    My name node went into safe mode because of this.
    I had restart all apps to get the heap size down to 11% and then was able to leave the safe mode.

    When does the heap size go up ? Because I didnt have anything running at that time.
    Also how can add the heap size ? where and how much is ideal ?
    Please advice.

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #43474
    Kenny Zhang
    Moderator

    Hi,

    The ambari RM heap size metric is not accurate, it’s a ambari bug which our engineering is working on now.

    We already replied back to you for the safe mode issue in another topic.
    Please let us know if there is any other question or issue.

    Thanks.
    Kenny

    #43598
    Veerabahu
    Participant

    Thanks Kenny.
    Good to know about the bug. Now knowing that this is a bug.
    Can you please tell me how I can monitor the heap size being currently used, and which app is using it ?
    Any cmd I can use at the Linux server

    #44081
    Kenny Zhang
    Moderator

    Hi,

    You can use the jmap utility eg. $jmap -heap

    Thanks,

    Kenny

    #46682
    Edwin Weill
    Participant

    I am also experiencing similar problems in the Ambari Dashboard HDP 2.0; the resource manager is showing 92+% usage. Also, every so often the YARN memory usage exceeds 3000%. Is this due to the bug or could it be some other problem with the heap and/or YARN memory? Thanks for the advice in advance.

    #50806
    Kenny Zhang
    Moderator

    Hi Edwin,

    This is only because the old version of Ambari (1.4.1) didn’t query the right jmx info. This is unrelated to YARN’s problem.

    Thanks,
    Kenny

    #50807
    Kenny Zhang
    Moderator

    Hi Edwin,

    This is only because the old version of Ambari (1.4.1) didn’t query the right jmx info. This is unrelated to YARN’s problem.

    Thanks,
    Kenny

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.