Slave node host name quirk and Smoketest failure

to create new topics or reply. | New User Registration

This topic contains 0 replies, has 1 voice, and was last updated by  John Bunch 1 year, 11 months ago.

  • Creator
  • #33859

    John Bunch

    I discovered a quirk in required machine naming convention that isn’t clear in the installation instructions. This applies to version 1.3.

    If I use the FQDN for all machine names in the clusterproperties.txt file, I get the following Powershell error when running start_remote_hdp_services.cmd:

    Master nodes: start
    1 Master nodes successfully started.
    Worker nodes: start HadoopCB3.FloridaKeys.saje
    Invoke-Command : One or more computer names is not valid. If you are trying to
    pass a URI, use the -ConnectionUri parameter or pass URI objects instead of
    At C:\hdp\hadoop\manage_remote_hdp_services.ps1:126 char:15
    + $results = Invoke-Command -ComputerName $nodes -ScriptBlock {
    + ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~
    + CategoryInfo : InvalidArgument: (System.String[]:String[]) [Inv
    oke-Command], ArgumentException
    + FullyQualifiedErrorId : PSSessionInvalidComputerName,Microsoft.PowerShel

    0 Worker nodes successfully started.

    Each FQDN in the list of nodes can be successfully resolved, pinged, appears in DNS, and otherwise seemed to be correct.

    If I replace the SLAVE_HOSTS list with computer names (HadoopCB2) rather than FQDN’s ( and re-install hadoop, start_remote_hdp_services.cmd works fine.

    After researching the Invoke-Command Powershell command it appears that either computer names or FQDN’s should work, so this seems odd.

    However, even though start_remote_hdp_services.cmd works, Run-SmokeTests.cmd fails with:

    Hadoop smoke test – wordcount using hadoop.cmd file
    The system cannot find the path specified.
    Run-HadoopSmokeTest : Error copying the input file for the Hadoop smoke test
    At line:1 char:1
    + Run-HadoopSmokeTest
    + ~~~~~~~~~~~~~~~~~~~
    + CategoryInfo : NotSpecified: (:) [Write-Error], WriteErrorExcep
    + FullyQualifiedErrorId : Microsoft.PowerShell.Commands.WriteErrorExceptio

You must be to reply to this topic. | Create Account

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.