Home Forums HDP on Windows – Installation Windows Installation – Outstanding Questions

Tagged: 

This topic contains 2 replies, has 2 voices, and was last updated by  Robert 3 months, 1 week ago.

  • Creator
    Topic
  • #49565

    Basil Privitera
    Participant

    Dear All,

    Ok, this is what I have so far ..

    – Windows Server 2008R2 (Single Node Install ONLY) (Always logged in as an Administrator)
    – HortonWorks 2.0.6
    – JDK 1.7.0.51 and the latest version of Python installed as well.
    – All ports are OPEN on this machine as it is inside our company firewall
    – Followed the instructions for the Quick Start single node installation (as per the doco and these completed OK)

    All local hdp services started OK (as per ‘start_local_hdp_services)

    SMOKE TESTS
    Ok, this of course failed when I first ran it, so then I check forum posts.

    So far I have done the following

    – Opened up a command shell as the haddop user (runas /use:hadoop cmd)
    – Changed the permissions on the /mapred folder via ‘hadoop fs -chmod -R 755 /mapred’

    Then ran the smoke tests again and …
    Hadoop Smoke Test PASSED
    Pig Smoke Test PASSED
    HCatalog Smoke Test FAILED
    Hive Smoke Test FAILED

    There is not much info about this stuff around the NET so I tried a couple of things (especially as permissions seemed to be the issue) …

    - Changed the Onwership of the /user folder via ‘hadoop fs -chown -R haddop /user’ (previosuly owned by me)
    - Changed the Onwership of the /hive folder via ‘hadoop fs -chown -R haddop /hive’ (previosuly owned by me)
    – Changed the permissions on the /user folder via ‘hadoop fs -chmod -R 755 /user’
    – Changed the permissions on the /hive folder via ‘hadoop fs -chmod -R 755 /hive’

    So no my filesystem looks like this …

    D:\hdp>hadoop fs -ls /
    Found 4 items
    drwxrwxrwt – hadoop hdfs 0 2014-03-04 12:13 /app-logs
    drwxr-xr-x – hadoop hdfs 0 2014-03-04 12:18 /hive
    drwxr-xr-x – hadoop hdfs 0 2014-03-04 11:42 /mapred
    drwxr-xr-x – hadoop hdfs 0 2014-03-04 12:12 /user
    D:\hdp>

    I then ran the smoke tests again and this time …
    – Hadoop Smoke Test FAILED
    – Pig Smoke Test FAILED
    – HCatalog Smoke Test PASSED
    – Hive Smoke Test PASSED

    So I just have a few questions …

    1. Why have the first 2 x smoke tests failed now when they had previously passed? Is this normal? Can you run them more than once?

    2. Will there be any negative consequences from changing the ownership and permissions as above?

    3. Considering that at one time, ALL of the smoke tests PASSED, can I move on to the next section of my evaluation?

    Any help much appreciated.

    Thanks

    Basil

    P.S. Dear HortonWorks guys … can you please update the documentation and include other efforts we may need to make to get the Smoke Tests to run successfully. It has taken about a day to try and work out what to do and I’m still not sure if I have it right.
    Also, can you please updae the PS Scripts so that we don’t see a myriad of ‘deprecated’ commands in the log output. It’s extremely annoying when trying to find out where the error truly is.

    Also, is it possible to INCREASE the character limit of the postings in this forum so that we can post output logs etc.

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #51366

    Robert
    Participant

    Hi Basil,
    In regards to your question:
    1. Why have the first 2 x smoke tests failed now when they had previously passed? Is this normal? Can you run them more than once?
    The smoketests are running wordcount I believe. You should be able to see the job in the resource manager webui and click on job to get more information as to why it failed.
    3. Considering that at one time, ALL of the smoke tests PASSED, can I move on to the next section of my evaluation?
    At this point, it would be good to understand why the smoketests are failing first before moving on.

    Regards,
    Robert

    Collapse
    #49566

    Basil Privitera
    Participant

    Dear All,

    OK, need to retract some of what I said earlier … just found Section 8 in the Installation Manual (Adding a Smoke Test user) and will give it a go.
    Would still like some help on the other questions.
    Cheers

    Basil

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)