Home Forums YARN Resource Manage forcibly closing the connection

Tagged: 

This topic contains 0 replies, has 1 voice, and was last updated by  Diwakar Dhanuskodi 2 months, 1 week ago.

  • Creator
    Topic
  • #57703

    Diwakar Dhanuskodi
    Participant

    I am running a oozie hive job in HDInsight.
    Oozie job is running successfully but the Hive hql script is not executing even thought the hive-node in workflow is showing successful completion. Below is the error. Please help.

    2014-07-23 08:37:25,247 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Re-sorting assigned queue: root.default stats: default: capacity=0.95, absoluteCapacity=0.95, usedResources=<memory:3072, vCores:2>usedCapacity=0.39475712, absoluteUsedCapacity=0.375, numApps=1, numContainers=2
    2014-07-23 08:37:25,247 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:3072, vCores:2> cluster=<memory:8192, vCores:8>
    2014-07-23 08:37:25,700 INFO org.apache.hadoop.yarn.server.resourcemanager.security.NMTokenSecretManagerInRM: Sending NMToken for nodeId : ddptestvm.ddptestvm.f4.internal.cloudapp.net:45454 for container : container_1406103288175_0002_01_000002
    2014-07-23 08:37:25,700 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1406103288175_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
    2014-07-23 08:37:26,731 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate…
    2014-07-23 08:37:27,262 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1406103288175_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
    2014-07-23 08:37:34,309 INFO SecurityLogger.org.apache.hadoop.ipc.Server: Auth successful for hadoop (auth:TOKEN)
    2014-07-23 08:38:04,131 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 8032: readAndProcess from client 10.119.222.54 threw exception [java 1="An" 2="existing" 3="connection" 4="was" 5="forcibly" 6="closed" 7="by" 8="the" 9="remote" 10="host" language=".io.IOException:"][/java]
    java.io.IOException: An existing connection was forcibly closed by the remote host
    at sun.nio.ch.SocketDispatcher.read0(Native Method)
    at sun.nio.ch.SocketDispatcher.read(SocketDispatcher.java:43)
    at sun.nio.ch.IOUtil.readIntoNativeBuffer(IOUtil.java:223)
    at sun.nio.ch.IOUtil.read(IOUtil.java:197)
    at sun.nio.ch.SocketChannelImpl.read(SocketChannelImpl.java:379)
    at org.apache.hadoop.ipc.Server.channelRead(Server.java:2558)
    at org.apache.hadoop.ipc.Server.access$2800(Server.java:130)
    at org.apache.hadoop.ipc.Server$Connection.readAndProcess(Server.java:1459)
    at org.apache.hadoop.ipc.Server$Listener.doRead(Server.java:750)
    at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(Server.java:624)
    at org.apache.hadoop.ipc.Server$Listener$Reader.run(Server.java:595)
    2014-07-23 08:38:05,085 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl

You must be logged in to reply to this topic.