Home Forums HDP on Linux – Installation Step7.Review and Deply failed

This topic contains 7 replies, has 5 voices, and was last updated by  Larry Liu 1 year, 7 months ago.

  • Creator
    Topic
  • #9647

    Dear all:
    I have successfully start HMC, but failed at Deploying clusters stage
    (same as the Document’s Step7.Review and Deploy)
    and following are 4 log files for debug purpose.
    1. Error log shown at Deploy stage
    2. /var/log/yum.log
    3. /var/log/hmc/hmc.log
    4. /var/log/puppet_apply.log (on client node)

    My HDP Enviroment are as below:
    a. 1 name node + 3 data nodes. 4 PCs
    b. CentOS6.3 64 bit
    c. Host name : Host001(Name node+DataNode), Host003(Data Node),Host004(DataNode),HostJeff(HMC).
    Could anyone tell me what’s wrong?

    I did not specify /Java 32 bit Home /Java 64 bit Home , I just specify URL to Download 32/64bit Java jdk, am I right?

    /**********************1.Error log shown at Deploy stage *******************************/
    {
    “27”: {
    “nodeReport”: [],
    “nodeLogs”: []
    },
    “39”: {
    “nodeReport”: {
    “PUPPET_KICK_FAILED”: [],
    “PUPPET_OPERATION_FAILED”: [
    "host001.zyxel.com"
    ],
    “PUPPET_OPERATION_TIMEDOUT”: [],
    “PUPPET_OPERATION_SUCCEEDED”: []
    },
    “nodeLogs”: {
    “host001.zyxel.com”: {
    “reportfile”: “/var/lib/puppet/reports/14-39-27/host001.zyxel.com”,
    “overall”: “FAILED”,
    “finishtime”: “2012-09-11 10:16:59.629428 +08:00″,

    …..
    “\”Tue Sep 11 10:17:04 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/before (debug): requires Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end]\””,

    “\”Tue Sep 11 10:17:06 +0800 2012 Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode](provider=posix) (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode’\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 Puppet (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode’\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/returns (err): change from notrun to 0 failed: mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode returned 1 instead of one of [0] at /etc/puppet/agent/modules/hdp/manifests/init.pp:253\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end] (notice): Dependency Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode] has failures: true\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end] (warning): Skipping because of failed dependencies\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 Exec[mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode](provider=posix) (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode’\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 Puppet (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode’\””,
    “\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-

    },
    “43”: {
    “nodeReport”: [],
    “nodeLogs”: []
    }
    }
    /******************1.Error log shown at Deploy stage******************************************************/

    /

    Regards,
    Jeff

Viewing 7 replies - 1 through 7 (of 7 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #17520

    Larry Liu
    Moderator

    Hi, vipul, Hari,

    I highly recommend to install most recent HDP release which is HDP 1.2. It has a lot of cool features and fixes.

    Please see the documentation as below:

    http://docs.hortonworks.com/

    Thanks

    Larry

    Collapse
    #17491

    vipul chavda
    Member

    Hi All,
    I have successfully installed hmc and I am getting below error while deploying.
    {
    “2”: {
    “nodeReport”: {
    “PUPPET_KICK_FAILED”: [],
    “PUPPET_OPERATION_FAILED”: [],
    “PUPPET_OPERATION_TIMEDOUT”: [],
    “PUPPET_OPERATION_SUCCEEDED”: [

    Collapse
    #17490

    vipul chavda
    Member

    {
    “2”: {
    “nodeReport”: {
    “PUPPET_KICK_FAILED”: [],
    “PUPPET_OPERATION_FAILED”: [],
    “PUPPET_OPERATION_TIMEDOUT”: [],
    “PUPPET_OPERATION_SUCCEEDED”: [

    Collapse
    #17487

    hari patel
    Member

    Deploy Logs

    {
    “2”: {
    “nodeReport”: {
    “PUPPET_KICK_FAILED”: [],
    “PUPPET_OPERATION_FAILED”: [],
    “PUPPET_OPERATION_TIMEDOUT”: [],
    “PUPPET_OPERATION_SUCCEEDED”: [

    Collapse
    #9836

    Sasha J
    Moderator

    Good to know.

    Collapse
    #9835

    Dear Sasha :

    Wonderful !

    I finish the Deploy procedure now!

    Thanks a lot and a lot for your great help!

    Regards,

    Jeff

    Collapse
    #9649

    Sasha J
    Moderator

    1. Please, do NOT post the whole logs here in the forums! Search for word “fail” and the post only relevant messages.

    2. This was already explained many times in the forums, /dev/mapper/ is NOT a mount point, this is device file, and it is impossible to create folders into device files:
    v_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/returns (err): change from notrun to 0 failed: mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode returned 1 instead of one of [0] at /etc/puppet/agent/modules/hdp/manifests/init.pp:253\””,

    So, use some filesystem location for data directories, not devices.

    Thank you!
    Sasha

    Collapse
Viewing 7 replies - 1 through 7 (of 7 total)