Home Forums HDP on Linux – Installation Hadoop streaming in sandbox

This topic contains 1 reply, has 2 voices, and was last updated by  tedr 9 months ago.

  • Creator
    Topic
  • #29404

    Duncan Gunn
    Member

    Hello

    I was wondering if I had to do anything to enable/install streaming in the sandbox.

    I am accessing the sandbox directly, i.e. not through the GUI.

    I log in to the VM, and try to run:

    hadoop jar contrib/streaming/hadoop-*streaming*.jar -file mapper.py -mapper mapper.py etc. etc.

    straight away it comes back with

    Not a valid JAR: /contrib/streaming/hadoop-*streaming*.jar

    I haven’t had much success with the GUI before, so just trying on the command line, but open to all suggestions!

    Thanks

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #29422

    tedr
    Moderator

    Hi Duncan,

    You shouldn’t need to do anything special to enable streaming in the sandbox, it is a standard single-node hadoop installation. It could be that due to the extra ‘*’ before streaming the .jar file couldn’t be found, can you try it without the ‘*’ before streaming? Also it probably woudn’t hurt to spell out the entire name of the .jar.

    Thanks,
    Ted.

    Collapse
Viewing 1 replies (of 1 total)