Home Forums MapReduce Incorrect Log Path

This topic contains 1 reply, has 1 voice, and was last updated by  Ray Roberts 2 months, 4 weeks ago.

  • Creator
    Topic
  • #55438

    Ray Roberts
    Participant

    I’ve noticed the following when starting mapreduce manually in my HDP 1.3.3 environmnent:

    –> starting MapReduce
    + sudo -u mapred -H bash -c ‘/cloud/hadoop/bin/hadoop-daemon.sh –config /cloud/hadoop/conf start jobtracker’
    starting jobtracker, logging to /var/log/hadoop/mapred/hadoop-mapred-jobtracker-integrate.out
    log4j:ERROR setFile(null,true) call failed.
    java.io.FileNotFoundException: /var/log/hadoop-mapreduce/mapred/hadoop-mapreduce.jobsummary.log (No such file or directory)
    at java.io.FileOutputStream.open(Native Method)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:221)
    at java.io.FileOutputStream.<init>(FileOutputStream.java:142)
    at org.apache.log4j.FileAppender.setFile(FileAppender.java:290)
    at org.apache.log4j.FileAppender.activateOptions(FileAppender.java:164)
    at org.apache.log4j.DailyRollingFileAppender.activateOptions(DailyRollingFileAppender.java:216)
    at org.apache.log4j.config.PropertySetter.activate(PropertySetter.java:257)
    at org.apache.log4j.config.PropertySetter.setProperties(PropertySetter.java:133)

    So, It looks like /var/log/hadoop-mapreduce/ doesn’t exist. Is this a bug or something I’m missing?

    Thanks,

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #55439

    Ray Roberts
    Participant

    hadoop-env.sh:

    # History server logs
    export HADOOP_MAPRED_LOG_DIR=/var/log/hadoop-mapreduce/$USER

    However, it seems to be logging in /var/log/hadoop/mapred/hadoop-mapred-historyserver-<hostname>.log

    Collapse
Viewing 1 replies (of 1 total)