Home Forums YARN Connecting to HDP 2.0 with yarn client

Tagged: 

This topic contains 2 replies, has 1 voice, and was last updated by   8 months ago.

  • Creator
    Topic
  • #31339


    Member

    I downloaded and launched HDP 2.0 in VirtualBox and then tried to connect from java using YarnClient but came across the following error:

    1311 [IPC Client (1943692956) connection to /192.168.0.31:8050 from lordorient] DEBUG org.apache.hadoop.ipc.Client.run null – IPC Client (1943692956) connection to /192.168.0.31:8050 from lordorient: starting, having connections 1
    1315 [IPC Client (1943692956) connection to /192.168.0.31:8050 from lordorient] DEBUG org.apache.hadoop.ipc.Client.close null – closing ipc connection to /192.168.0.31:8050: null
    java.io.EOFException
    at java.io.DataInputStream.readInt(DataInputStream.java:392)
    at org.apache.hadoop.ipc.Client$Connection.receiveRpcResponse(Client.java:955)
    at org.apache.hadoop.ipc.Client$Connection.run(Client.java:852)
    1319 [IPC Client (1943692956) connection to /192.168.0.31:8050 from lordorient] DEBUG org.apache.hadoop.ipc.Client.close null – IPC Client (1943692956) connection to /192.168.0.31:8050 from lordorient: closed
    1320 [IPC Client (1943692956) connection to /192.168.0.31:8050 from lordorient] DEBUG org.apache.hadoop.ipc.Client.run null – IPC Client (1943692956) connection to /192.168.0.31:8050 from lordorient: stopped, remaining connections 0
    1391 [main] TRACE org.apache.hadoop.ipc.ProtobufRpcEngine.invoke null – 1: Exception <- null@192.168.0.31/192.168.0.31:8050: getClusterMetrics {java.io.IOException: Failed on local exception: java.io.EOFException; Host Details : local host is: "lordorient-VirtualBox/127.0.1.1"; destination host is: "192.168.0.31":8050; }

    Any ideas whats going wrong?

    I am using libraries version 2.1.0-SNAPSHOT from cenral repo and here is my yarn-site.xml

    yarn.resourcemanager.admin.address
    192.168.0.31:8141

    yarn.resourcemanager.address
    192.168.0.31:8050

    yarn.nodemanager.address
    192.168.0.31:45454

    yarn.resourcemanager.scheduler.address
    192.168.0.31:8030

    yarn.resourcemanager.resource-tracker.address
    192.168.0.31:8025

    yarn.resourcemanager.webapp.address
    192.168.0.31:8088

    yarn.log.server.url

    http://192.168.0.31:19888/jobhistory/logs

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #32560


    Member

    Finally I made this work. Here is the description of what needs to be done: http://fusionworks.md/connecting-to-yarn-on-hortonworks-hdp-2-0/

    Collapse
    #31361


    Member

    Connection reaches its target. Just looked up server logs and it seems to be auth issue:

    2013-08-11 12:17:34,018 INFO ipc.Server (Server.java:doRead(763)) – IPC Server listener on 8050: readAndProcess threw exception java.io.IOException: Unable to read authentication method from client 192.168.0.48. Count of bytes read: 0
    java.io.IOException: Unable to read authentication method
    at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1341)
    at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:758)
    at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:557)
    at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:532)

    But all the docs are deadly silent about how should I configure all this security stuff on client side. Is there anybody around to help me?

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)