Home Forums MapReduce Cannot run M/R job in standalone mode

This topic contains 1 reply, has 2 voices, and was last updated by  J Mishra 1 month, 4 weeks ago.

  • Creator
    Topic
  • #55422

    Jakub Stransky
    Participant

    Hello,

    I am facing issues with running M/R job in stand alone mode for hadoop 2.2.0 (HDP 2.0) I am getting following error:
    14/06/04 13:55:04 INFO mapreduce.Job: The url to track the job: http://hadooptools:8088/proxy/application_1401791587704_0007/
    14/06/04 13:55:04 INFO mapreduce.Job: Running job: job_1401791587704_0007
    14/06/04 13:55:08 INFO mapreduce.Job: Job job_1401791587704_0007 running in uber mode : false
    14/06/04 13:55:08 INFO mapreduce.Job: map 0% reduce 0%
    14/06/04 13:55:08 INFO mapreduce.Job: Job job_1401791587704_0007 failed with state FAILED due to: Application application_1401791587704_0007 failed 2 times due to AM Container for appattempt_1401791587704_0007_000002 exited with exitCode: -1000 due to: File file:/user/hdfs/.staging/job_1401791587704_0007/job.jar does not exist
    .Failing this attempt.. Failing the application.
    14/06/04 13:55:08 INFO mapreduce.Job: Counters: 0
    Exception in thread “main” java.io.IOException: Job failed!
    at org.apache.hadoop.mapred.JobClient.runJob(JobClient.java:836)
    at com.ncr.bigdata.mr.MaxTemperatureDriver.run(MaxTemperatureDriver.java:46)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:70)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:84)
    at com.ncr.bigdata.mr.MaxTemperatureDriver.main(MaxTemperatureDriver.java:54)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

    BUT

    bash-4.1$ ls -al /user/hdfs/.staging/job_1401791587704_0007/
    total 108
    drwx——. 2 hdfs hadoop 4096 Jun 4 13:55 .
    drwx——. 6 hdfs hadoop 4096 Jun 4 13:55 ..
    -rw-r–r–. 1 hdfs hadoop 7767 Jun 4 13:55 job.jar
    -rw-r–r–. 1 hdfs hadoop 72 Jun 4 13:55 .job.jar.crc
    -rw-r–r–. 1 hdfs hadoop 157 Jun 4 13:55 job.split
    -rw-r–r–. 1 hdfs hadoop 12 Jun 4 13:55 .job.split.crc
    -rw-r–r–. 1 hdfs hadoop 42 Jun 4 13:55 job.splitmetainfo
    -rw-r–r–. 1 hdfs hadoop 12 Jun 4 13:55 .job.splitmetainfo.crc
    -rw-r–r–. 1 hdfs hadoop 67865 Jun 4 13:55 job.xml
    -rw-r–r–. 1 hdfs hadoop 540 Jun 4 13:55 .job.xml.crc
    bash-4.1$ whoami
    hdfs

    Does anybody experienced the same or have clue what might be wrong?

    <property>
    <name>fs.default.name</name>
    <value>file:///</value>
    </property>
    <property>
    <name>mapred.job.tracker</name>
    <value>local</value>
    </property>

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #56825

    J Mishra
    Participant

    Seeing the same issue with giraph 1.1.0 job being submitted to Hadoop Yarn 2.3.0.
    Application application_1404262477145_0003 failed 2 times due to AM Container for appattempt_1404262477145_0003_000002 exited with exitCode: -1000 due to: File file:/tmp/hadoop-yarn/staging/root/.staging/job_1404262477145_0003/job.jar does not exist
    .Failing this attempt.. Failing the application.
    Any updates here?

    Collapse
Viewing 1 replies (of 1 total)