Home Forums Hortonworks Sandbox HDP 2 Sandbox, Yarn and Ambari

This topic contains 7 replies, has 2 voices, and was last updated by  Dave 6 months, 1 week ago.

  • Creator
    Topic
  • #39388

    Hi there,
    I’m using the VMWare Sandbox with HDP 2.0.
    I’m monitoring my cluster with Ambari, and eveything is healty except the YARN Ressource Manager und the YARN Datanode. If I’m trying to start those services, they will be started without exceptions in Ambari and shown as healty, but after 20 seconds they are red dotted again und stopped. What’s wrong there ?

Viewing 7 replies - 1 through 7 (of 7 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #39640

    Dave
    Moderator

    Hi Benjamin,

    Yes, if they can’t register that port they will not start. Can you check for them on a ps -ef | grep $service and then use this pid to see what port it uses.
    I dont understand what you mean by sth ?
    Giving the PIDs here will not help me, you will need to give me the binary or executable.

    Ambari may not be seeing the correct PID, so you will need to kill it off and start it from within ambari itself,

    Thanks

    Dave

    Collapse
    #39636

    The second PID for the Port 45454 is of course not the same as the one for 8088 but 1453, So the two PIDs are 1657 and 1453

    Collapse
    #39634

    I’m using the VMWare – Version, and i thing i’m using it just normal… I expanded the disc to 100 GB and resized the volume group accordingly to work with a greater data volume. But aside of this i did any special configurations or sth with my vm. Just using the beeswax or the shell to execute queries on my data.

    I think the ressource manager tries to register port 8088. This is in use by the java process with the pid 1657, which seems to be sth from the resource manager itself. As well the port 45454 is used by another java process with the pid 1657 and seems to be a process from the nodemanager itself.
    Could it possibly be that those services are started correctly and only ambari is displaying them stopped ? Interestingly displays Ambari in the dashboard YARN red dotted and shown as stopped but displays the Nodemanager as live. Switching in Ambari to the Hosts perspective shows both the ressource manager and the node manager red dotted and stopped. So I tried to start them and after a short period of a green dot they always switched back to red. Then i started to check the logs and found those errors. It seems after failing to register those ports the shutted themselfes down again.

    Collapse
    #39630

    Dave
    Moderator

    Hi Benjamin,

    Which programs were using these ports?
    I don’t have the issue on my Sandbox, so I’m interested to find what is different on yours (or how you are running it)

    Thanks

    Dave

    Collapse
    #39601

    PS: Ports were 8088 and 45454

    Collapse
    #39600

    After researching a little bit by myself (in the log files) I found out that YARN can’t start because both the resource Manager and the node manager were trying to register a port which is already in use. So i searched for the corresponding process and killed them. After killing those 2 processes I could succussfully start the YARN – Service with Ambari. The problem is solved but it’s persisting after restarting the VM. So I think anything could be wrong in the startup script or sth ? Perhaps is sth starting too early and so the port is alreday in use? Or is this only happening in my VM Sandbox ?

    Collapse
    #39441

    Dave
    Moderator

    Hi Benjamin,

    Without any logs then it is difficult to understand what is happening.
    Could you attach the errors from the appropriate logs here?

    Thanks

    Dave

    Collapse
Viewing 7 replies - 1 through 7 (of 7 total)