Home Forums HDP on Linux – Installation HDFS Test Fails

This topic contains 6 replies, has 4 voices, and was last updated by  Shota Akhalaia 1 year, 4 months ago.

  • Creator
    Topic
  • #12301

    Hi,

    I’m unable to install HDP2 as it seems to fail on the HDFS test portion. I’ve verified the NTP is setup and working, all hostnames are correctly listed in the hosts file and I’ve tried doing a clean re-install a number of times.

    Below is a snippet from the log:

    [2012:11:27 06:22:43][INFO][PuppetInvoker][PuppetInvoker.php:100][sendKick]: xx.xx.xx.xx.internal: Kick failed with warning: peer certificate won’t be verified in this SSL session
    Host xx.xx.xx.xx.internal failed: Error 403 on SERVER: Forbidden request: node0(10.xx.xx.xx) access to /run/xx.xx.xx.xx.internal [save] at line 1
    Triggering xx.xx.xx.xx.internal
    xx.xx.xx.xx.internal finished with exit code 2
    Failed: xx.xx.xx.xx.internal

    [2012:11:27 06:22:43][INFO][PuppetInvoker][PuppetInvoker.php:338][waitForResults]: Waiting for results from
    [2012:11:27 06:22:43][INFO][PuppetInvoker][PuppetInvoker.php:342][waitForResults]: 0 out of 0 nodes have reported for txn 3-55-47
    [2012:11:27 06:22:44][INFO][PuppetInvoker][PuppetInvoker.php:237][createGenKickWaitResponse]: Response of genKickWait:
    Array
    (
    [result] => -1
    [error] => All kicks failed
    [nokick] => Array
    (
    [0] => xx.xx.xx.xx.internal
    )

    [failed] => Array
    (
    )

    [success] => Array
    (
    )

    [timedoutnodes] => Array
    (
    )

    )

    [2012:11:27 06:22:44][INFO][Service: HDFS2 (testclust0)][Service.php:466][smoke]: Persisting puppet report for smoke testing HDFS2
    [2012:11:27 06:22:44][ERROR][Service: HDFS2 (testclust0)][Service.php:473][smoke]: Service smoke check failed with Array
    (
    [result] => -1
    [error] => All kicks failed
    [nokick] => Array
    (
    [0] => xx.xx.xx.xx.internal
    )

    [failed] => Array
    (
    )

    [success] => Array
    (
    )

    [timedoutnodes] => Array
    (
    )

    )
    )

    [2012:11:27 06:22:44][INFO][OrchestratorDB][OrchestratorDB.php:610][persistTransaction]: persist: 3-55-47:FAILED:HDFS test:FAILED
    [2012:11:27 06:22:44][INFO][OrchestratorDB][OrchestratorDB.php:556][setServiceState]: HDFS2 – FAILED
    [2012:11:27 06:22:44][INFO][Service: HDFS2 (testclust0)][Service.php:130][setState]: HDFS2 – FAILED dryRun=
    [2012:11:27 06:22:44][INFO][OrchestratorDB][OrchestratorDB.php:610][persistTransaction]: persist: 3-55-47:FAILED:HDFS test:FAILED
    [2012:11:27 06:22:44][INFO][Cluster:testclust0][Cluster.php:810][startService]: Starting service HDFS2 complete. Result=-2
    [2012:11:27 06:22:44][INFO][ClusterMain:TxnId=3][ClusterMain.php:353][]: Completed action=deploy on cluster=testclust0, txn=3-0-0, result=-2, error=Service HDFS2 is not STARTED, smoke tests failed!

    Thanks in advance for your help,
    _alan

Viewing 6 replies - 1 through 6 (of 6 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #12598

    hello
    I had this problem, it is puppet ssl cert error
    I erased puppet then removed /var/lib/puppet folder on all nodes, it is directory where is stored all certificates.
    then install puppet again and after that all things goes successful :)
    I think it happends when you change hmc server to another host
    P.S. I’m sorry for my english :D

    Collapse
    #12493

    Hi Grant,

    I tried this as well with no success. sestatus shows disabled on all nodes and “service iptables status” shows Firewall is not running on all nodes as well.

    I’m going to gather the logs and upload to the ftp site for review.

    Thanks,
    _alan

    Collapse
    #12467

    Grant Liu
    Member

    Hi Alan,
    Puppet kick failing due to 403 could be because the master can’t see the slave node. If this is a dev/POC environment, turn off iptables (firewall) and make sure the servers can see each other (DNS, etc). Make sure selinux is turned off as well. It’s all about prereqs for these types of errors.
    Thanks,
    Grant

    Collapse
    #12450

    Hi Jeff,

    Have you run into this issue before? Any ideas what I could be doing wrong?

    Thanks for your help,
    _alan

    Collapse
    #12304

    Hi Jeff,

    1) This is a 6 node cluster
    2) Yes, EC2
    3) RHEL 6
    4) Yes, all HDP2 services

    Thanks,
    _alan

    Collapse
    #12303

    Jeff Sposetti
    Moderator

    Hi,
    A few questions:
    1) How many hosts are in your target cluster?
    2) Are you using EC2?
    3) What OS?
    4) Are you trying to install all HDP2 services? Or just a subset (for example, HDFS and YARN)?

    Thanks. -Jeff

    Collapse
Viewing 6 replies - 1 through 6 (of 6 total)