Home Forums HDP on Windows – Installation Successful Installation – Cannot Get All Services Running Such As namenode

This topic contains 4 replies, has 2 voices, and was last updated by  Kevin Ellis 8 months, 2 weeks ago.

  • Creator
    Topic
  • #48459

    Kevin Ellis
    Participant

    Hello,

    I have followed the instructions outlined here:

    http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0-Win/bk_installing_hdp_for_windows/content/win-chap2-singlenode.html

    and successfully installed the HDP 2.0 for Windows. However, I have not been able to get all the services running. The number I can get seems to vary everyday, but today I was only able to get 6 of the 15 running.

    Sent all start commands.
    total services
    15
    running services
    6
    not yet running services
    9
    Failed_Start datanode derbyserver historyserver hiveserver2 hwi metastore namenode secondarynamenode templeton

    The alarming one is the namenode. When installing (for the first time) I did select “Delete existing HDP data” which means the namenode should have already been formatted. On the Hadoop command line I have been trying “hdfs namenode -format” to try and format the namenode, but I always receive the error:

    Error: Could not find or load main class (Computer Name).

    I thought this may be an error with my path variable for Java. I have the following set:

    JAVA_HOME is set to C:\Software\Java\jdk1.7.0_51
    Path I have prepended: %JAVA_HOME%\bin;

    The error for all the services that do not start all read the same (except for the first line which changes depending on one of the 9 services):

    Start-Service : Service ‘Apache Hadoop templeton (templeton)’ start failed.
    At C:\hdp\manage_local_hdp_services.ps1:77 char:29
    + $foo = Start-Service <<<< -Name $serviceName.Name -ErrorAction Continue
    + CategoryInfo : OpenError: (System.ServiceProcess.ServiceControl
    ler:ServiceController) [Start-Service], ServiceCommandException
    + FullyQualifiedErrorId : StartServiceFailed,Microsoft.PowerShell.Commands
    .StartServiceCommand

    I have also tried running everything as a system administrator and everything still fails. I run the ‘start_local_hdp_services’ in the ‘C:\hdp>’ directory as instructed in the installation instructions (twice). I also received a ‘Installation completed successfully’ after following the directions.

    I am simply trying to evaluate the technology by setting up a single node HDP installation, but am getting worried at how difficult it is to get this up and running. I have spent days on forums trying different solutions and am in need of serious assistance. Any help would be VERY much appreciated as I am almost at wit’s end with Hadoop. Thanks again.

    Kevin

Viewing 4 replies - 1 through 4 (of 4 total)

The topic ‘Successful Installation – Cannot Get All Services Running Such As namenode’ is closed to new replies.

  • Author
    Replies
  • #48878

    Kevin Ellis
    Participant

    Oh man, now I’m kicking myself for not looking at the operating system requirements in the documentation. Kind of went straight to the installation instructions. Oh well, thanks for the help Dave.

    Kevin

    Collapse
    #48860

    Dave
    Moderator

    Hi Kevin,

    HDP 2.0 is not supported on Windows 7. There are no plans to make HDP run on Desktop Operating Systems in the future.
    I would advise finding a Windows 2008/2012 64 bit VM or OS to install on.

    Thanks

    Dave

    Collapse
    #48845

    Kevin Ellis
    Participant

    Hello,

    Thought I would give an update. I reinstalled HDP 2.0 for Windows a couple more times and still had the same issues as before. I was able to get all the services working except the namenode. However, I received no error messages. Now I was able to accomplish this by modifying the the XML Documents for all the services not working such as the datanode. I would open the XML Document and modify the command -Dhadoop.id.str=Kevin Ellis and change it to -Dhadoop.id.str=KevinEllis for every service that wasn’t running (yes, all I did was remove the space). No idea why this worked or even what this line of code does, but all the services started running except the namenode.

    Now, for the past few days I have been trying to get the namenode to work. I have opened the Hadoop command line and have been trying to type ‘hdfs namenode -format’ and receive the following error:

    c:\hdp\hadoop-2.2.0.2.0.6.0-0009>hdfs namenode -format
    Exception in thread “main” java.lang.NoClassDefFoundError: Ellis
    Caused by: java.lang.ClassNotFoundException: Ellis
    at java.net.URLClassLoader$1.run(URLClassLoader.java:202)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:190)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:306)
    at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:301)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:247)
    Could not find the main class: Ellis. Program will exit.

    I have already mentioned how I previously setup JAVA_HOME. This seems to be an error with the HADOOP_CLASSPATH, but I have no idea where to modify it nor have any idea where or what the java main class ELLIS even is. Does anyone know how HDP 2.0 for Windows defines the CLASSPATH? Or even better how during installation the main class ELLIS even got created or where it is? Any help would be much appreciated and I will keep trying.

    David, here is my OS:

    OS Name Microsoft Windows 7 Home Premium
    Version 6.1.7601 Service Pack 1 Build 7601
    Other OS Description Not Available
    OS Manufacturer Microsoft Corporation
    System Name KEVINELLIS-PC
    System Manufacturer Dell Inc.
    System Model Inspiron N5110
    System Type x64-based PC
    Processor Intel(R) Core(TM) i7-2670QM CPU @ 2.20GHz, 2201 Mhz, 4 Core(s), 8 Logical Processor(s)
    BIOS Version/Date Dell Inc. A07, 7/18/2011
    SMBIOS Version 2.6
    Windows Directory C:\windows
    System Directory C:\windows\system32
    Boot Device \Device\HarddiskVolume2
    Hardware Abstraction Layer Version = “6.1.7601.17514”
    User Name KevinEllis-PC\Kevin Ellis
    Installed Physical Memory (RAM) 8.00 GB
    Total Physical Memory 7.91 GB
    Available Physical Memory 4.13 GB
    Total Virtual Memory 15.8 GB
    Available Virtual Memory 9.96 GB
    Page File Space 7.91 GB

    I’m worried that my username (because it has a space) is screwing up everything but not sure. Also, David, I’m not sure how to check for DNS lookups, could you advise? Thanks for the help.

    Kevin

    Collapse
    #48637

    Dave
    Moderator

    Hi Kevin,

    What OS are you running and can you ensure that the Hostname is available to both forward and reverse DNS lookups?

    Thanks

    Dave

    Collapse
Viewing 4 replies - 1 through 4 (of 4 total)