HDP on Linux – Installation Forum

Step7.Review and Deply failed

  • #9647

    Dear all:
    I have successfully start HMC, but failed at Deploying clusters stage
    (same as the Document’s Step7.Review and Deploy)
    and following are 4 log files for debug purpose.
    1. Error log shown at Deploy stage
    2. /var/log/yum.log
    3. /var/log/hmc/hmc.log
    4. /var/log/puppet_apply.log (on client node)

    My HDP Enviroment are as below:
    a. 1 name node + 3 data nodes. 4 PCs
    b. CentOS6.3 64 bit
    c. Host name : Host001(Name node+DataNode), Host003(Data Node),Host004(DataNode),HostJeff(HMC).
    Could anyone tell me what’s wrong?

    I did not specify /Java 32 bit Home /Java 64 bit Home , I just specify URL to Download 32/64bit Java jdk, am I right?

    /**********************1.Error log shown at Deploy stage *******************************/
    {
    “27”: {
    “nodeReport”: [],
    “nodeLogs”: []
    },
    “39”: {
    “nodeReport”: {
    “PUPPET_KICK_FAILED”: [],
    “PUPPET_OPERATION_FAILED”: [
    “host001.zyxel.com”
    ],
    “PUPPET_OPERATION_TIMEDOUT”: [],
    “PUPPET_OPERATION_SUCCEEDED”: []
    },
    “nodeLogs”: {
    “host001.zyxel.com”: {
    “reportfile”: “/var/lib/puppet/reports/14-39-27/host001.zyxel.com”,
    “overall”: “FAILED”,
    “finishtime”: “2012-09-11 10:16:59.629428 +08:00″,

    …..
    “\”Tue Sep 11 10:17:04 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/before (debug): requires Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end]\””,

    “\”Tue Sep 11 10:17:06 +0800 2012 Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode](provider=posix) (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode’\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 Puppet (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode’\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/returns (err): change from notrun to 0 failed: mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode returned 1 instead of one of [0] at /etc/puppet/agent/modules/hdp/manifests/init.pp:253\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end] (notice): Dependency Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode] has failures: true\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end] (warning): Skipping because of failed dependencies\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 Exec[mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode](provider=posix) (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode’\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 Puppet (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode’\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-

    },
    “43”: {
    “nodeReport”: [],
    “nodeLogs”: []
    }
    }
    /******************1.Error log shown at Deploy stage******************************************************/

    /

    Regards,
    Jeff

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #9649
    Sasha J
    Moderator

    1. Please, do NOT post the whole logs here in the forums! Search for word “fail” and the post only relevant messages.

    2. This was already explained many times in the forums, /dev/mapper/ is NOT a mount point, this is device file, and it is impossible to create folders into device files:
    v_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/returns (err): change from notrun to 0 failed: mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode returned 1 instead of one of [0] at /etc/puppet/agent/modules/hdp/manifests/init.pp:253\””,

    So, use some filesystem location for data directories, not devices.

    Thank you!
    Sasha

    #9835

    Dear Sasha :

    Wonderful !

    I finish the Deploy procedure now!

    Thanks a lot and a lot for your great help!

    Regards,

    Jeff

    #9836
    Sasha J
    Moderator

    Good to know.

    #17487
    hari patel
    Member

    Deploy Logs

    {
    “2”: {
    “nodeReport”: {
    “PUPPET_KICK_FAILED”: [],
    “PUPPET_OPERATION_FAILED”: [],
    “PUPPET_OPERATION_TIMEDOUT”: [],
    “PUPPET_OPERATION_SUCCEEDED”: [

    #17490
    vipul chavda
    Member

    {
    “2”: {
    “nodeReport”: {
    “PUPPET_KICK_FAILED”: [],
    “PUPPET_OPERATION_FAILED”: [],
    “PUPPET_OPERATION_TIMEDOUT”: [],
    “PUPPET_OPERATION_SUCCEEDED”: [

    #17491
    vipul chavda
    Member

    Hi All,
    I have successfully installed hmc and I am getting below error while deploying.
    {
    “2”: {
    “nodeReport”: {
    “PUPPET_KICK_FAILED”: [],
    “PUPPET_OPERATION_FAILED”: [],
    “PUPPET_OPERATION_TIMEDOUT”: [],
    “PUPPET_OPERATION_SUCCEEDED”: [

    #17520
    Larry Liu
    Moderator

    Hi, vipul, Hari,

    I highly recommend to install most recent HDP release which is HDP 1.2. It has a lot of cool features and fixes.

    Please see the documentation as below:

    http://docs.hortonworks.com/

    Thanks

    Larry

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.