Home Forums HDFS Unable to load data file

This topic contains 2 replies, has 3 voices, and was last updated by  Steve Loughran 2 years ago.

  • Creator
    Topic
  • #11071

    I am using AWS and able to install single instance hdp without any issue … all services are up and running however when I try to load a simple file I am getting follwoing error. ?
    source : /root/testdata/orders.txt (file own by root:root)
    destination : /user/root (directory own by root:hdfs)

    any idea ?

    [root@ip-10-60-129-228 testdata]# hadoop fs -put orders.txt /user/root/orders.txt
    12/10/16 03:29:00 WARN hdfs.DFSClient: DataStreamer Exception: org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /user/root/orders.txt could only be replicated to 0 nodes, instead of 1
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAdditionalBlock(FSNamesystem.java:1566)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.addBlock(NameNode.java:673)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:578)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1388)
    at org.apache.hadoop.ipc.Server$Handler$1.run(Server.java:1384)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1122)
    at org.apache.hadoop.ipc.Server$Handler.run(Server.java:1382)

    at org.apache.hadoop.ipc.Client.call(Client.java:1092)
    at org.apache.hadoop.ipc.RPC$Invoker.invoke(RPC.java:229)
    at $Proxy1.addBlock(Unknown Source)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:85)
    at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:62)
    at $Proxy1.addBlock(Unknown Source)
    at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.locateFollowingBlock(DFSClient.java:3595)
    at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.nextBlockOutputStream(DFSClient.java:3456)
    at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream.access$2600(DFSClient.java:2672)
    at org.apache.hadoop.hdfs.DFSClient$DFSOutputStream$DataStreamer.run(DFSClient.java:2912)

Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘Unable to load data file’ is closed to new replies.

  • Author
    Replies
  • #11268

    Steve Loughran
    Participant

    @faisal -that’s such a common problem in Hadoop there’s An Apache Wiki Article on it

    Collapse
    #11095

    Sasha J
    Moderator

    This error:
    org.apache.hadoop.ipc.RemoteException: java.io.IOException: File /user/root/orders.txt could only be replicated to 0 nodes, instead of 1
    means that you do not have DataNode process running.
    Make sure you have it started and check both namenode and datanode logs to find out the problem of starting it.

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)