Home Forums HDP on Linux – Installation Install,Start and Test fails installing DataNode

This topic contains 11 replies, has 2 voices, and was last updated by  Hesam Hashemi 1 year, 3 months ago.

  • Creator
    Topic
  • #35706

    After the “summary” step,when I click next,it starts to install DataNode but when it reaches the 4% in progress,it fails.and installation of other services are cancelled(I see them in cancelled list).
    I get this error below the ‘stderr':
    stderr:
    none
    Puppet has been killed due to timeout

    And I get this output from ‘stdout’ panel:

    stdout:
    notice: /Stage[main]/Hdp-repos::Process_repo/File[HDP]/ensure: defined content as

    ‘{md5}1132d8717759a797d6a18af29aeac337′
    notice: Finished catalog run in 0.06 seconds
    warning: Dynamic lookup of $conf_dir at /var/lib/ambari-agent/puppet/modules/hdp-

    hadoop/manifests/init.pp:108 is deprecated. Support will be removed in Puppet 2.8.

    Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $service_state at /var/lib/ambari-

    agent/puppet/modules/hdp-hadoop/manifests/init.pp:221 is deprecated. Support will be

    removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable)

    or parameterized classes.
    warning: Dynamic lookup of $service_state at /var/lib/ambari-

    agent/puppet/modules/hdp-hadoop/manifests/service.pp:76 is deprecated. Support will

    be removed in Puppet 2.8. Use a fully-qualified variable name (e.g.,

    $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $service_state at /var/lib/ambari-

    agent/puppet/modules/hdp-hadoop/manifests/service.pp:85 is deprecated. Support will

    be removed in Puppet 2.8. Use a fully-qualified variable name (e.g.,

    $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $configuration is deprecated. Support will be removed in

    Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or

    parameterized classes.
    warning: Dynamic lookup of $mapred-site is deprecated. Support will be removed in

    Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or

    parameterized classes.
    warning: Dynamic lookup of $tasktracker_port is deprecated. Support will be removed in

    Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or

    parameterized classes.
    warning: Dynamic lookup of $ambari_db_rca_url is deprecated. Support will be removed

    in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or

    parameterized classes.
    warning: Dynamic lookup of $ambari_db_rca_driver is deprecated. Support will be

    removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable)

    or parameterized classes.
    warning: Dynamic lookup of $ambari_db_rca_username is deprecated. Support will be

    removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable)

    or parameterized classes.
    warning: Dynamic lookup of $ambari_db_rca_password is deprecated. Support will be

    removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable)

    or parameterized classes.
    notice: /Stage[1]/Hdp::Create_smoke_user/File[/tmp/changeUid.sh]/ensure: defined

    content as ‘{md5}8118fe9ec0bca3d841d470ad02696adf’

Viewing 11 replies - 1 through 11 (of 11 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #36246

    The rest of stdout output is:

    notice: /Stage[1]/Hdp/Hdp::Lzo::Package[64]/Hdp::Package[lzo 64]/Hdp::Package::Process_pkg[lzo 64]/Package[lzo]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::Lzo::Package[64]/Hdp::Package[lzo 64]/Hdp::Package::Process_pkg[lzo 64]/Package[lzo-devel]/ensure: created
    notice: /Stage[1]/Hdp::Snappy::Package/Hdp::Package[snappy]/Hdp::Package::Process_pkg[snappy]/Package[snappy]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::Group[nagios_group]/Group[nagios_group]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::User[nagios_user]/User[nagios]/ensure: created
    notice: /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Package[net-snmp-utils]/ensure: created
    notice: /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg[snmp]/Hdp::Java::Package[snmp]/File[/usr/local/jdk6u31/jdk1.6.0_31/bin/java snmp]/ensure: created
    notice: /Stage[1]/Hdp::Snmp/Hdp::Snmp-configfile[snmpd.conf]/Hdp::Configfile[/etc/snmp//snmpd.conf]/File[/etc/snmp//snmpd.conf]/content: content changed ‘{md5}8307434bc8ed4e2a7df4928fb4232778′ to ‘{md5}f786955c0c36f7f5a4f375e3fe93c959′
    notice: /Stage[1]/Hdp::Snmp/Service[snmpd]/ensure: ensure changed ‘stopped’ to ‘running’
    notice: /Stage[1]/Hdp::Snmp/Service[snmpd]: Triggered ‘refresh’ from 1 events
    notice: /Stage[1]/Hdp::Snappy::Package/Hdp::Package[snappy]/Hdp::Package::Process_pkg[snappy]/Package[snappy-devel]/ensure: created
    notice: /Stage[1]/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln[64]/Hdp::Exec[hdp::snappy::package::ln 64]/Exec[hdp::snappy::package::ln 64]/returns: executed successfully
    notice: /Stage[1]/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln[32]/Hdp::Exec[hdp::snappy::package::ln 32]/Exec[hdp::snappy::package::ln 32]/returns: executed successfully
    err: /Stage[1]/Hdp/Hdp::Package[glibc]/Hdp::Package::Process_pkg[glibc]/Package[glibc.i686]: Could not evaluate: Puppet::Util::Log requires a message
    notice: /Stage[1]/Hdp/Hdp::Group[hdp_user_group]/Group[hdp_user_group]/ensure: created

    thanks

    Collapse
    #36245

    Dear Dave,
    I installed JDK 6 update 31 ,64bit
    the first error is shown again: (the error mentioned in question)

    stderr:
    none
    Puppet has been killed due to timeout

    but it seems the stdout output is different:

    stdout:
    notice: /Stage[main]/Hdp-repos::Process_repo/File[HDP]/ensure: defined content as ‘{md5}1132d8717759a797d6a18af29aeac337′
    notice: Finished catalog run in 0.07 seconds
    warning: Dynamic lookup of $conf_dir at /var/lib/ambari-agent/puppet/modules/hdp-hadoop/manifests/init.pp:108 is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $service_state at /var/lib/ambari-agent/puppet/modules/hdp-hadoop/manifests/init.pp:221 is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $service_state at /var/lib/ambari-agent/puppet/modules/hdp-hadoop/manifests/service.pp:76 is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $service_state at /var/lib/ambari-agent/puppet/modules/hdp-hadoop/manifests/service.pp:85 is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $configuration is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $mapred-site is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $tasktracker_port is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $ambari_db_rca_url is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $ambari_db_rca_driver is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $ambari_db_rca_username is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    warning: Dynamic lookup of $ambari_db_rca_password is deprecated. Support will be removed in Puppet 2.8. Use a fully-qualified variable name (e.g., $classname::variable) or parameterized classes.
    notice: /Stage[1]/Hdp::Create_smoke_user/File[/tmp/changeUid.sh]/ensure: defined content as ‘{md5}8118fe9ec0bca3d841d470ad02696adf’

    Collapse
    #36118

    Hi Dave,

    Here’s the yum repolist output:

    [root@centos6 /]# yum repolist
    Loaded plugins: fastestmirror, security
    Loading mirror speeds from cached hostfile
    * base: http://ftp.itu.edu.tr
    * epel: http://ftp.jaist.ac.jp
    * extras: http://ftp.itu.edu.tr
    * updates: http://ftp.itu.edu.tr
    repo id repo name status
    HDP-1.3.2 HDP 124
    HDP-1.x Hortonworks Data Platform Version – HDP-1.x 124
    HDP-UTILS-1.1.0.16 Hortonworks Data Platform Utils Version – HDP-UTILS-1.1.0.16 61
    Updates-HDP-1.3.2.0 HDP-1.3.2.0 – Updates 124
    Updates-ambari-1.2.5.17 ambari-1.2.5.17 – Updates 5
    ambari-1.x Ambari 1.x 5
    base CentOS-6 – Base 6,381
    epel Extra Packages for Enterprise Linux 6 – x86_64 9,595
    extras CentOS-6 – Extras 13
    updates CentOS-6 – Updates 1,228
    repolist: 17,660

    I am using a virtual machine for my HDP installation test,and I have a snapshot of virtual machine,before installation process.thus,whenever I want to restart the installation,first I revert to that snapshot,and then run the installation ;-)

    If there’s any problem with yum repositories,let me know.

    besides,I will try to install java 1.6_31 instead of java 1.7.0 and run the test again,and after that I will tell you the result ;-)

    Collapse
    #36015

    Dave
    Moderator

    Hi Hesam,

    If you run yum repolist, what shows?
    Can you install java 1.6_31 64 bit instead of Java 1.7.0 ?
    Did you clean the failed installs before you tried again?

    Thanks

    Dave

    Collapse
    #35986

    I edited the Hosts file exactly as you said,and stopped ambari-server and cleared the browser’s cache,and started ambari-server again,and then logged in to the ambari web GUI and passed all the steps up to install,start and test step.
    In that step,I encountered an error while installing dataNode again,but this time it is a different one.
    here’s the output:

    stderr:
    none
    Parameter path failed: File paths must be fully qualified, not ‘ /usr/lib/jvm/jre-1.7.0-openjdk.x86_64/bin/java hadoop 64′ at /var/lib/ambari-agent/puppet/modules/hdp/manifests/java/package.pp:60

    stdout:
    notice: /Stage[main]/Hdp-repos::Process_repo/File[HDP]/ensure: defined content as ‘{md5}1132d8717759a797d6a18af29aeac337′
    notice: Finished catalog run in 0.03 seconds
    None

    I appreciate your help.
    Thanks

    Collapse
    #35960

    Dave
    Moderator

    Hi Hesam,

    Yes, do not remove those lines but make sure they are not at the top and yes I missed the dot.
    So for clarification make your hosts file look like:

    192.168.1.75 centos6.local
    192.168.1.75 localhost
    127.0.0.1 localhost.localdomain localhost
    127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
    ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

    Then run the install again.

    Let me know how you get on,

    Dave

    Collapse
    #35959

    Hi Dave,

    yes,the output of hostname -f command is: centos6.local

    and about the ifconfig,here’s the output:

    eth0 Link encap:Ethernet HWaddr 00:0C:29:88:B3:FD
    inet addr:192.168.1.75 Bcast:192.168.1.255 Mask:255.255.255.0
    inet6 addr: fe80::20c:29ff:fe88:b3fd/64 Scope:Link
    UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
    RX packets:22418 errors:0 dropped:0 overruns:0 frame:0
    TX packets:20831 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:1000
    RX bytes:22537853 (21.4 MiB) TX bytes:1722429 (1.6 MiB)

    lo Link encap:Local Loopback
    inet addr:127.0.0.1 Mask:255.0.0.0
    inet6 addr: ::1/128 Scope:Host
    UP LOOPBACK RUNNING MTU:16436 Metric:1
    RX packets:24902 errors:0 dropped:0 overruns:0 frame:0
    TX packets:24902 errors:0 dropped:0 overruns:0 carrier:0
    collisions:0 txqueuelen:0
    RX bytes:16802129 (16.0 MiB) TX bytes:16802129 (16.0 MiB)

    I have also another question,the last line you wrote for edit the hostfile,is:
    127.0.0.1 localhost localdomain

    you mean another name for localhost,should be “localdomain”? or you missed the dot ? (i.e. localhost.localdomain)

    and another question is that,I should not remove the 2 lines that are inside hosts file originaly.should I?
    I think that it may cause some programs to fail.
    I mean these 2 lines:
    127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
    ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6

    thanks

    Collapse
    #35937

    Dave
    Moderator

    Hi Hesam,

    Does your hostname -f give an output of centos6.local?

    I would edit the hostfile to be:

    192.168.1.75 centos6.local
    192.168.1.75 localhost local
    127.0.0.1 localhost localdomain

    The issue you’re hitting is usually associated with the hostsfile (network) I’ve hit it many a time while installing on VM single nodes.

    If you provide the output of ‘ifconfig’ and hostname -f then I can provide you with a hosts file which should work.

    Thanks

    Dave

    Collapse
    #35883

    Hi Dave,
    Yes it is a single node cluster and the etc/hosts file is like:

    127.0.0.1 localhost localhost.localdomain localhost4 localhost4.localdomain4
    ::1 localhost localhost.localdomain localhost6 localhost6.localdomain6
    192.168.1.75 centos6.local

    In the install options step I use the centos6.local as the host name.
    Is there anything wrong with hosts file? or the problem is somewhere else?

    I also tried removing: _db files in the /var/lib/rpm directory,but similar problems emereged i.e. the problem with installing name node persists!

    thanks

    Collapse
    #35708

    Dave
    Moderator

    Hi Hesam,

    Is this a single node cluster? Have you set up the hosts file correctly, ie:

    IPAddress hostname
    IPAddress localhost local

    Thanks

    Dave

    Collapse
    #35707

    The rest of the ‘stdout’ is:

    notice: /Stage[1]/Hdp/Hdp::Lzo::Package[64]/Hdp::Package[lzo

    64]/Hdp::Package::Process_pkg[lzo 64]/Package[lzo]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::Lzo::Package[64]/Hdp::Package[lzo

    64]/Hdp::Package::Process_pkg[lzo 64]/Package[lzo-devel]/ensure: created
    notice: /Stage[1]/Hdp::Snappy::Package/Hdp::Package

    [snappy]/Hdp::Package::Process_pkg[snappy]/Package[snappy]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::Group[nagios_group]/Group[nagios_group]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::User[nagios_user]/User[nagios]/ensure: created
    notice: /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg

    [snmp]/Package[net-snmp-utils]/ensure: created
    notice: /Stage[1]/Hdp::Snappy::Package/Hdp::Package

    [snappy]/Hdp::Package::Process_pkg[snappy]/Package[snappy-devel]/ensure: created
    notice: /Stage[1]/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln[64]/Hdp::Exec

    [hdp::snappy::package::ln 64]/Exec[hdp::snappy::package::ln 64]/returns: executed

    successfully
    notice: /Stage[1]/Hdp::Snappy::Package/Hdp::Snappy::Package::Ln[32]/Hdp::Exec

    [hdp::snappy::package::ln 32]/Exec[hdp::snappy::package::ln 32]/returns: executed

    successfully
    err: /Stage[1]/Hdp/Hdp::Package[glibc]/Hdp::Package::Process_pkg[glibc]/Package

    [glibc.i686]: Could not evaluate: Puppet::Util::Log requires a message
    notice: /Stage[1]/Hdp/Hdp::Group[hdp_user_group]/Group[hdp_user_group]/ensure:

    created
    notice: /Stage[1]/Hdp/Hdp::User[hive_user]/User[hive]/ensure: created
    notice: /Stage[1]/Hdp::Create_smoke_user/Hdp::User[smoke_user]/User[ambari-

    qa]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::User[hbase_user]/User[hbase]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::User[oozie_user]/User[oozie]/ensure: created
    notice: /Stage[1]/Hdp::Create_smoke_user/Hdp::Exec[/tmp/changeUid.sh ambari-qa

    1012 /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-

    qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null]/Exec[/tmp/changeUid.sh ambari-

    qa 1012 /tmp/hadoop-ambari-qa,/tmp/hsperfdata_ambari-qa,/home/ambari-

    qa,/tmp/ambari-qa,/tmp/sqoop-ambari-qa 2>/dev/null]/returns: executed successfully
    notice: /Stage[1]/Hdp/Hdp::User[webhcat_user]/User[hcat]/ensure: created
    notice: /Stage[1]/Hdp/Hdp::Package[glibc]/Hdp::Package::Process_pkg[glibc]/Anchor

    [hdp::package::glibc::end]: Dependency Package[glibc.i686] has failures: true
    warning: /Stage[1]/Hdp/Hdp::Package[glibc]/Hdp::Package::Process_pkg[glibc]/Anchor

    [hdp::package::glibc::end]: Skipping because of failed dependencies
    notice: /Stage[1]/Hdp::Snmp/Hdp::Package[snmp]/Hdp::Package::Process_pkg

    [snmp]/Hdp::Java::Package[snmp]/File[/usr/lib/jvm/jre-1.7.0-openjdk.x86_64/bin/java

    snmp]/ensure: created
    notice: /Stage[1]/Hdp::Snmp/Hdp::Snmp-configfile[snmpd.conf]/Hdp::Configfile

    [/etc/snmp//snmpd.conf]/File[/etc/snmp//snmpd.conf]/content: content changed ‘{md5}

    8307434bc8ed4e2a7df4928fb4232778′ to ‘{md5}f786955c0c36f7f5a4f375e3fe93c959′

    Thanks for your help.

    Collapse
Viewing 11 replies - 1 through 11 (of 11 total)