HDP on Windows – Installation Forum

Slave node host name quirk and Smoketest failure

  • #33859
    John Bunch

    I discovered a quirk in required machine naming convention that isn’t clear in the installation instructions. This applies to version 1.3.

    If I use the FQDN for all machine names in the clusterproperties.txt file, I get the following Powershell error when running start_remote_hdp_services.cmd:

    Master nodes: start HadoopCB1.FloridaKeys.mycompany.com
    1 Master nodes successfully started.
    Worker nodes: start HadoopCB2.FloridaKeys.MyCompany.com HadoopCB3.FloridaKeys.saje
    s.com HadoopCB4.FloridaKeys.MyCompany.com
    Invoke-Command : One or more computer names is not valid. If you are trying to
    pass a URI, use the -ConnectionUri parameter or pass URI objects instead of
    At C:\hdp\hadoop\manage_remote_hdp_services.ps1:126 char:15
    + $results = Invoke-Command -ComputerName $nodes -ScriptBlock {
    + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo : InvalidArgument: (System.String[]:String[]) [Inv
    oke-Command], ArgumentException
    + FullyQualifiedErrorId : PSSessionInvalidComputerName,Microsoft.PowerShel

    0 Worker nodes successfully started.

    Each FQDN in the list of nodes can be successfully resolved, pinged, appears in DNS, and otherwise seemed to be correct.

    If I replace the SLAVE_HOSTS list with computer names (HadoopCB2) rather than FQDN’s (HadoopCB2.FloridaKeys.mycompany.com) and re-install hadoop, start_remote_hdp_services.cmd works fine.

    After researching the Invoke-Command Powershell command it appears that either computer names or FQDN’s should work, so this seems odd.

    However, even though start_remote_hdp_services.cmd works, Run-SmokeTests.cmd fails with:

    Hadoop smoke test – wordcount using hadoop.cmd file
    The system cannot find the path specified.
    Run-HadoopSmokeTest : Error copying the input file for the Hadoop smoke test
    At line:1 char:1
    + Run-HadoopSmokeTest
    + ~~~~~~~~~~~~~~~~~~~
    + CategoryInfo : NotSpecified: (:) [Write-Error], WriteErrorExcep
    + FullyQualifiedErrorId : Microsoft.PowerShell.Commands.WriteErrorExceptio

to create new topics or reply. | New User Registration

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.