Resource Manage forcibly closing the connection

to create new topics or reply. | New User Registration


This topic contains 0 replies, has 1 voice, and was last updated by  Diwakar Dhanuskodi 1 year ago.

  • Creator
  • #57703

    Diwakar Dhanuskodi

    I am running a oozie hive job in HDInsight.
    Oozie job is running successfully but the Hive hql script is not executing even thought the hive-node in workflow is showing successful completion. Below is the error. Please help.

    2014-07-23 08:37:25,247 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: Re-sorting assigned queue: root.default stats: default: capacity=0.95, absoluteCapacity=0.95, usedResources=<memory:3072, vCores:2>usedCapacity=0.39475712, absoluteUsedCapacity=0.375, numApps=1, numContainers=2
    2014-07-23 08:37:25,247 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.capacity.ParentQueue: assignedContainer queue=root usedCapacity=0.375 absoluteUsedCapacity=0.375 used=<memory:3072, vCores:2> cluster=<memory:8192, vCores:8>
    2014-07-23 08:37:25,700 INFO Sending NMToken for nodeId : for container : container_1406103288175_0002_01_000002
    2014-07-23 08:37:25,700 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1406103288175_0002_01_000002 Container Transitioned from ALLOCATED to ACQUIRED
    2014-07-23 08:37:26,731 INFO org.apache.hadoop.yarn.server.resourcemanager.scheduler.AppSchedulingInfo: checking for deactivate…
    2014-07-23 08:37:27,262 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl: container_1406103288175_0002_01_000002 Container Transitioned from ACQUIRED to RUNNING
    2014-07-23 08:37:34,309 INFO Auth successful for hadoop (auth:TOKEN)
    2014-07-23 08:38:04,131 INFO org.apache.hadoop.ipc.Server: Socket Reader #1 for port 8032: readAndProcess from client threw exception [java 1="An" 2="existing" 3="connection" 4="was" 5="forcibly" 6="closed" 7="by" 8="the" 9="remote" 10="host" language=".io.IOException:"][/java] An existing connection was forcibly closed by the remote host
    at Method)
    at org.apache.hadoop.ipc.Server.channelRead(
    at org.apache.hadoop.ipc.Server.access$2800(
    at org.apache.hadoop.ipc.Server$Connection.readAndProcess(
    at org.apache.hadoop.ipc.Server$Listener.doRead(
    at org.apache.hadoop.ipc.Server$Listener$Reader.doRunLoop(
    at org.apache.hadoop.ipc.Server$Listener$
    2014-07-23 08:38:05,085 INFO org.apache.hadoop.yarn.server.resourcemanager.rmcontainer.RMContainerImpl

You must be to reply to this topic. | Create Account

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.