Problem to start Start MapReduce JobHistory Server

to create new topics or reply. | New User Registration

This topic contains 6 replies, has 3 voices, and was last updated by  ulka asati 5 months ago.

  • Creator
    Topic
  • #26655

    yamei gu
    Member

    Hi,

    I followed the instruction on http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.0.2/bk_installing_manually_book/content/rpm-chap4-4.html to start the jobhistory server. However, the first trial failed because the HADOOP_MAPRED_HOME and HADOOP_MAPRED_LOG_DIR was not defined. After manually defined these env variables, I tried to execute:

    /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh start historyserver –config $HADOOP_CONF_DIR

    And have the following error:
    nice: /Hadoop/MAPRED/bin/mapred: Permission denied

    I looked into the mr-jobhistory-daemon.sh file, and checked $MAPRED_USER has full permission on every directory used in the “nohup nice … ” command line. Even run the “nice -n 0 /Hadoop/MAPRED/bin/mapred /etc/hadoop/conf –config historyserver” by using “root”, it still has the permission denied error.

    Any suggestion?

    Thanks,
    Yamei

Viewing 6 replies - 1 through 6 (of 6 total)

You must be to reply to this topic. | Create Account

  • Author
    Replies
  • #66260

    ulka asati
    Participant

    I am facing permission issue while starting the jobhistory server on RHEl 6.2 linux machine.
    I am following this doc.

    http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/bk_installing_manually_book-20131022.pdf

    Error I am facing is

    [mapred@4f00244d8025 bin]$ /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh start historyserver –config $HADOOP_CONF_DIR

    mkdir: cannot create directory `': No such file or directory
    chown: missing operand after `mapred’
    Try `chown –help’ for more information.
    starting historyserver, logging to /mapred-mapred-historyserver-4f00244d8025.out
    /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh: line 116: /mapred-mapred-historyserver-4f00244d8025.out: Permission denied

    Pl let me know what more configuration is required

    Collapse
    #27543

    tedr
    Moderator

    Hi Yamei,

    What I mean is do not preceed the command with ‘nice,’ just run the command
    su hdfs -c ‘/usr/lib/hadoop/bin/hadoop-daemon.sh start historyserver’

    Thanks,
    Ted.

    Collapse
    #27537

    yamei gu
    Member

    What do you mean without nice command? Can you elaborate more?

    Collapse
    #26967

    tedr
    Moderator

    Hi Yamei,

    Have you tried it without the nice command?

    Thanks,
    Ted.

    Collapse
    #26950

    yamei gu
    Member

    Ted, I was using su $mapred_user, as noted in the instruction.

    Collapse
    #26798

    tedr
    Moderator

    Hi Yamei,

    When you tried to start the jobhistory daemon with the command you show, what user were you using? were you root or your own user? or were you mapred?

    Thanks,
    Ted.

    Collapse
Viewing 6 replies - 1 through 6 (of 6 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.