Home Forums HDP on Linux – Installation Cannot retrieve repository metadata (repomd.xml)

This topic contains 9 replies, has 3 voices, and was last updated by  Hugo Schieck 7 months, 4 weeks ago.

  • Creator
    Topic
  • #46792

    Hugo Schieck
    Participant

    Hello,

    Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-UTILS-1.1.0.16. Please verify its path and try again.

    I have verified that the path does contain the repomd.xml file.

    I am able to “wget http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml” successfully from all of my nodes.

    Full Log output from the install wizard :
    STDOUT

    STDERR
    scp /usr/lib/python2.6/site-packages/ambari_server/os_type_check.sh done for host MY_HOST_NAME.com, exitcode=0
    Copying os type check script finished
    Running os type check…
    STDOUT
    Cluster primary OS type is redhat6 and local OS type is redhat6

    STDERR
    Connection to MY_HOST_NAME.com closed.
    SSH command execution finished for host MY_HOST_NAME.com, exitcode=0
    Running os type check finished
    STDOUT
    sudo-1.7.4p5-7.el6.x86_64

    STDERR
    Connection to MY_HOST_NAME.com closed.
    SSH command execution finished for host MY_HOST_NAME.com, exitcode=0
    Checking ‘sudo’ package finished
    Copying repo file to ‘tmp’ folder…
    STDOUT

    STDERR
    scp /etc/yum.repos.d/ambari.repo done for host MY_HOST_NAME.com, exitcode=0
    Moving file to repo dir…
    STDOUT

    STDERR
    Connection to MY_HOST_NAME.com closed.
    SSH command execution finished for host MY_HOST_NAME.com, exitcode=0
    Copying setup script file…
    STDOUT

    STDERR
    scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py done for host MY_HOST_NAME.com, exitcode=0
    Copying files finished
    Running setup agent…
    STDOUT
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: [Errno 12] Timeout on http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: (28, ‘connect() timed out!’)
    Trying other mirror.
    Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-UTILS-1.1.0.16. Please verify its path and try again
    {‘exitstatus’: 1, ‘log’: (‘Loaded plugins: rhnplugin
    ‘, None)}

    STDERR
    Connection to MY_HOST_NAME.com closed.
    SSH command execution finished for host MY_HOST_NAME.com, exitcode=1
    Setting up agent finished
    ERROR: Bootstrap of host MY_HOST_NAME.com fails because previous action finished with non-zero exit code (1)

Viewing 9 replies - 1 through 9 (of 9 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #47274

    Hugo Schieck
    Participant

    Hello,
    I have figured out my issue here. I had to adjust all my base urls on both the /etc/yum.repos.d/hdp.repo & /etc/yum.repos.d/ambari.repo files on all my hosts to my local repository.

    The default URLs are not accurate, so users just make sure all URLs are accessible.

    I have successfully install HDP 2.0.6 !

    Good luck,
    Hugo

    Collapse
    #47228

    Hugo Schieck
    Participant

    Using the Cluster Install Wizard, I have been unable to configure the cluster using the provided repository, http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.0.6.0/

    I have created a local repository and am able to get past the Base URL Validation Step.

    Here is my hdp.repo file
    [root@MY_HOST ]# cat /etc/yum.repos.d/hdp.repo
    [HDP-2.x]
    name=Hortonworks Data Platform Version – HDP-2.x
    baseurl=http://MY_REPO.com/HDP/centos6/2.x/updates/2.0.6.0
    gpgcheck=1
    gpgkey=http://MY_REPO.com/HDP/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
    enabled=1
    priority=1

    [HDP-UTILS-1.1.0.16]
    name=Hortonworks Data Platform Utils Version – HDP-UTILS-1.1.0.16
    baseurl=http://MY_REPO.com/HDP-UTILS-1.1.0.16/repos/centos6
    gpgcheck=1
    gpgkey=http://MY_REPO.com/HDP/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
    enabled=1
    priority=1

    [HDP]
    name=Hortonworks Data Platform HDP
    baseurl=http://MY_REPO.com/HDP/centos6/2.x/updates/2.0.6.0
    gpgcheck=1
    pgkey=http://MY_REPO.com/HDP/centos6/RPM-GPG-KEY/RPM-GPG-KEY-Jenkins
    enabled=1
    priority=1

    I’ve gotten further on the Confirm Hosts step, but am failing with the following:

    STDERR
    scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py done for host MY_HOST.com, exitcode=0
    Copying files finished
    Running setup agent…
    STDOUT
    Repository HDP-UTILS-1.1.0.16 is listed more than once in the configuration
    Repository HDP-UTILS-1.1.0.16 is listed more than once in the configuration
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: [Errno 12] Timeout on http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: (28, ‘connect() timed out!’)
    Trying other mirror.
    Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-UTILS-1.1.0.16. Please verify its path and try again
    Repository HDP-UTILS-1.1.0.16 is listed more than once in the configuration
    Repository HDP-UTILS-1.1.0.16 is listed more than once in the configuration
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: [Errno 12] Timeout on http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: (28, ‘connect() timed out!’)
    Trying other mirror.
    Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-UTILS-1.1.0.16. Please verify its path and try again
    {‘exitstatus’: 1, ‘log’: (”, None)}

    STDERR
    Connection to MY_HOST.com closed.
    SSH command execution finished for host MY_HOST.com, exitcode=1
    Setting up agent finished
    ERROR: Bootstrap of host MY_HOST.com fails because previous action finished with non-zero exit code (1)

    Why is the setup still going to public-repo-1, instead of my local repo?

    Thanks,
    Hugo

    Collapse
    #47032

    Michael Cao
    Participant

    Regarding “Master key initialization failed” in the log.

    When you copy/paste your private key, make sure you includes “BEGIN …, END …” as follows:
    —–BEGIN RSA PRIVATE KEY—–
    ….
    —–END RSA PRIVATE KEY—–
    That should solve your Key recognizing issue.

    Collapse
    #46899

    Hugo Schieck
    Participant

    To eliminate lingering effects from my previous install, I’ve started fresh with a new VM RHEL6.2 install. I was able to get to the same step, Select a Stack :

    http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.9.0/bk_using_Ambari_book/content/ambari-chap3-2a_2x.html

    Issue1 : The Advanced Repository Options fails to validate the Base URLs.

    http://public-repo-1.hortonworks.com/HDP/centos5/2.x/updates/2.0.6.0/

    http://public-repo-1.hortonworks.com/HDP/centos6/2.x/updates/2.0.6.0/

    http://public-repo-1.hortonworks.com/HDP/suse11/2.x/updates/2.0.6.0/

    I tried the option to “Skip Repository Base URL validation” and arrived at the original failure from my original attempt:

    I’m not seeing instructions on how to install Ambari-Agents on my hosts prior to running the Cluster Install Wizard.

    # ambari-server –version
    1.4.3.38

    Log Output :
    STDOUT

    STDERR
    scp /usr/lib/python2.6/site-packages/ambari_server/os_type_check.sh done for host MY_HOST_NAME.com, exitcode=0
    Copying os type check script finished
    Running os type check…
    STDOUT
    Cluster primary OS type is redhat6 and local OS type is redhat6

    STDERR
    Connection to MY_HOST_NAME.com closed.
    SSH command execution finished for host MY_HOST_NAME.com, exitcode=0
    Running os type check finished
    STDOUT
    sudo-1.7.4p5-7.el6.x86_64

    STDERR
    Connection to MY_HOST_NAME.com closed.
    SSH command execution finished for host MY_HOST_NAME.com, exitcode=0
    Checking ‘sudo’ package finished
    Copying repo file to ‘tmp’ folder…
    STDOUT

    STDERR
    scp /etc/yum.repos.d/ambari.repo done for host MY_HOST_NAME.com, exitcode=0
    Moving file to repo dir…
    STDOUT

    STDERR
    Connection to MY_HOST_NAME.com closed.
    SSH command execution finished for host MY_HOST_NAME.com, exitcode=0
    Copying setup script file…
    STDOUT

    STDERR
    scp /usr/lib/python2.6/site-packages/ambari_server/setupAgent.py done for host MY_HOST_NAME.com, exitcode=0
    Copying files finished
    Running setup agent…
    STDOUT
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: [Errno 12] Timeout on http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: (28, ‘connect() timed out!’)
    Trying other mirror.
    Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-UTILS-1.1.0.16. Please verify its path and try again
    http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: [Errno 12] Timeout on http://public-repo-1.hortonworks.com/HDP-UTILS-1.1.0.16/repos/centos6/repodata/repomd.xml: (28, ‘connect() timed out!’)
    Trying other mirror.
    Error: Cannot retrieve repository metadata (repomd.xml) for repository: HDP-UTILS-1.1.0.16. Please verify its path and try again
    {‘exitstatus’: 1, ‘log’: (”, None)}

    STDERR
    Connection to MY_HOST_NAME.com closed.
    SSH command execution finished for host MY_HOST_NAME.com, exitcode=1
    Setting up agent finished
    ERROR: Bootstrap of host MY_HOST_NAME.com fails because previous action finished with non-zero exit code (1)

    Collapse
    #46863

    Jeff Sposetti
    Moderator

    On your hosts (the hosts besides the Ambari Server), did you upgrade the ambari-agent as well? You’ll want to make sure Ambari Server and Ambari Agents are both running 1.4.3.38.

    Also, can you paste the entire output from the UI (in addition to the “bootstrap call failed”) that is presented on Failed for one of your hosts?

    Collapse
    #46798

    Hugo Schieck
    Participant

    I ran the ambari-server reset and installed version 1.4.3.38 successfully.

    # ambari-server –version
    1.4.3.38

    However, now when I try to Register & Confirm via web browser, providing my Target Hosts & SSH Private Key, I’m getting an error message saying “Bootstrap call failed. Please try again.”

    I’ve noticed a “Master key initialization failed” in the log.

    # cat ambari-server.log
    16:23:28,262 INFO [main] Configuration:350 – Reading password from existing file
    16:23:28,315 INFO [main] Configuration:530 – Hosts Mapping File null
    16:23:28,315 INFO [main] HostsMap:60 – Using hostsmap file null
    16:23:29,992 INFO [main] Configuration:429 – Credential provider creation failed. Reason: Master key initialization failed.

    Collapse
    #46797

    Jeff Sposetti
    Moderator

    Would you mind trying with the latest Ambari? Ambari 1.4.3 can be found here…

    http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.9.0/bk_using_Ambari_book/content/ambari-chap1-1.html

    Collapse
    #46796

    Hugo Schieck
    Participant

    Hi Jeff,

    # ambari-server –version
    1.4.1.61

    Stack : HDP 1.3.3

    I have also tried HDP 2.0.6 unsuccessfully failing with the same error.

    Thanks,
    Hugo

    Collapse
    #46795

    Jeff Sposetti
    Moderator

    Hi,

    1) Can you confirm which Ambari version you are using? “ambari-server –version” or “yum info ambari-server”
    2) Which Stack are you selecting to install in the Install Wizard?

    Thanks.

    Collapse
Viewing 9 replies - 1 through 9 (of 9 total)