Step7.Review and Deply failed

Dear all:
I have successfully start HMC, but failed at Deploying clusters stage
(same as the Document’s Step7.Review and Deploy)
and following are 4 log files for debug purpose.
1. Error log shown at Deploy stage
2. /var/log/yum.log
3. /var/log/hmc/hmc.log
4. /var/log/puppet_apply.log (on client node)

My HDP Enviroment are as below:
a. 1 name node + 3 data nodes. 4 PCs
b. CentOS6.3 64 bit
c. Host name : Host001(Name node+DataNode), Host003(Data Node),Host004(DataNode),HostJeff(HMC).
Could anyone tell me what’s wrong?

I did not specify /Java 32 bit Home /Java 64 bit Home , I just specify URL to Download 32/64bit Java jdk, am I right?

/**********************1.Error log shown at Deploy stage *******************************/
{
“27″: {
“nodeReport”: [],
“nodeLogs”: []
},
“39″: {
“nodeReport”: {
“PUPPET_KICK_FAILED”: [],
“PUPPET_OPERATION_FAILED”: [
"host001.zyxel.com"
],
“PUPPET_OPERATION_TIMEDOUT”: [],
“PUPPET_OPERATION_SUCCEEDED”: []
},
“nodeLogs”: {
“host001.zyxel.com”: {
“reportfile”: “/var/lib/puppet/reports/14-39-27/host001.zyxel.com”,
“overall”: “FAILED”,
“finishtime”: “2012-09-11 10:16:59.629428 +08:00″,

…..
“\”Tue Sep 11 10:17:04 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/before (debug): requires Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end]\”",

…

“\”Tue Sep 11 10:17:06 +0800 2012 Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode](provider=posix) (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode’\”",
“\”Tue Sep 11 10:17:06 +0800 2012 Puppet (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode’\”",
“\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/returns (err): change from notrun to 0 failed: mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode returned 1 instead of one of [0] at /etc/puppet/agent/modules/hdp/manifests/init.pp:253\”",
“\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end] (notice): Dependency Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode] has failures: true\”",
“\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Anchor[hdp::exec::mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode::end] (warning): Skipping because of failed dependencies\”",
“\”Tue Sep 11 10:17:06 +0800 2012 Exec[mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode](provider=posix) (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode’\”",
“\”Tue Sep 11 10:17:06 +0800 2012 Puppet (debug): Executing ‘mkdir -p /dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode’\”",
“\”Tue Sep 11 10:17:06 +0800 2012 /Stage[2]/Hdp-hadoop::Namenode/Hdp-hadoop::Namenode::Create_name_dirs[/dev/mapper/vg_host001-lv_home/hadoop/hdfs/namenode,/dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/Hdp::Directory_recursive_create[/dev/mapper/vg_host001-
...
},
"43": {
"nodeReport": [],
“nodeLogs”: []
}
}
/******************1.Error log shown at Deploy stage******************************************************/

/

Regards,
Jeff

Topic

[Larry LiuModerator]

Hi, vipul, Hari,

I highly recommend to install most recent HDP release which is HDP 1.2. It has a lot of cool features and fixes.

Please see the documentation as below:

http://docs.hortonworks.com/

Thanks

Larry

[vipul chavdaMember]

Hi All,
I have successfully installed hmc and I am getting below error while deploying.
{
“2″: {
“nodeReport”: {
“PUPPET_KICK_FAILED”: [],
“PUPPET_OPERATION_FAILED”: [],
“PUPPET_OPERATION_TIMEDOUT”: [],
“PUPPET_OPERATION_SUCCEEDED”: [

[vipul chavdaMember]

{
“2″: {
“nodeReport”: {
“PUPPET_KICK_FAILED”: [],
“PUPPET_OPERATION_FAILED”: [],
“PUPPET_OPERATION_TIMEDOUT”: [],
“PUPPET_OPERATION_SUCCEEDED”: [

[hari patelMember]

Deploy Logs

{
“2″: {
“nodeReport”: {
“PUPPET_KICK_FAILED”: [],
“PUPPET_OPERATION_FAILED”: [],
“PUPPET_OPERATION_TIMEDOUT”: [],
“PUPPET_OPERATION_SUCCEEDED”: [

[Sasha JModerator]

Good to know.

[Wen-Chich TengMember]

Dear Sasha :

Wonderful !

I finish the Deploy procedure now!

Thanks a lot and a lot for your great help!

Regards,

Jeff

[Sasha JModerator]

1. Please, do NOT post the whole logs here in the forums! Search for word “fail” and the post only relevant messages.

2. This was already explained many times in the forums, /dev/mapper/ is NOT a mount point, this is device file, and it is impossible to create folders into device files:
v_root/hadoop/hdfs/namenode]/Exec[mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode]/returns (err): change from notrun to 0 failed: mkdir -p /dev/mapper/vg_host001-lv_root/hadoop/hdfs/namenode returned 1 instead of one of [0] at /etc/puppet/agent/modules/hdp/manifests/init.pp:253\””,

So, use some filesystem location for data directories, not devices.

Thank you!
Sasha

[Author]

Replies