MapReduce Forum

Problem to start Start MapReduce JobHistory Server

  • #26655
    yamei gu
    Member

    Hi,

    I followed the instruction on http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.0.2/bk_installing_manually_book/content/rpm-chap4-4.html to start the jobhistory server. However, the first trial failed because the HADOOP_MAPRED_HOME and HADOOP_MAPRED_LOG_DIR was not defined. After manually defined these env variables, I tried to execute:

    /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh start historyserver –config $HADOOP_CONF_DIR

    And have the following error:
    nice: /Hadoop/MAPRED/bin/mapred: Permission denied

    I looked into the mr-jobhistory-daemon.sh file, and checked $MAPRED_USER has full permission on every directory used in the “nohup nice … ” command line. Even run the “nice -n 0 /Hadoop/MAPRED/bin/mapred /etc/hadoop/conf –config historyserver” by using “root”, it still has the permission denied error.

    Any suggestion?

    Thanks,
    Yamei

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #26798
    tedr
    Moderator

    Hi Yamei,

    When you tried to start the jobhistory daemon with the command you show, what user were you using? were you root or your own user? or were you mapred?

    Thanks,
    Ted.

    #26950
    yamei gu
    Member

    Ted, I was using su $mapred_user, as noted in the instruction.

    #26967
    tedr
    Moderator

    Hi Yamei,

    Have you tried it without the nice command?

    Thanks,
    Ted.

    #27537
    yamei gu
    Member

    What do you mean without nice command? Can you elaborate more?

    #27543
    tedr
    Moderator

    Hi Yamei,

    What I mean is do not preceed the command with ‘nice,’ just run the command
    su hdfs -c ‘/usr/lib/hadoop/bin/hadoop-daemon.sh start historyserver’

    Thanks,
    Ted.

    #66260
    ulka asati
    Participant

    I am facing permission issue while starting the jobhistory server on RHEl 6.2 linux machine.
    I am following this doc.

    http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0/bk_installing_manually_book/bk_installing_manually_book-20131022.pdf

    Error I am facing is

    [mapred@4f00244d8025 bin]$ /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh start historyserver –config $HADOOP_CONF_DIR

    mkdir: cannot create directory `': No such file or directory
    chown: missing operand after `mapred’
    Try `chown –help’ for more information.
    starting historyserver, logging to /mapred-mapred-historyserver-4f00244d8025.out
    /usr/lib/hadoop-mapreduce/sbin/mr-jobhistory-daemon.sh: line 116: /mapred-mapred-historyserver-4f00244d8025.out: Permission denied

    Pl let me know what more configuration is required

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.