Home Forums Hortonworks Sandbox user directory in sandbox

This topic contains 1 reply, has 2 voices, and was last updated by  Pramod Thangali 1 year, 5 months ago.

  • Creator
    Topic
  • #14332

    Kar Son
    Member

    Hi I am trying to find where the map reduce input files are located in the sand box. Is there a way to find out where /user/… directory in the sandbox UI maps to in the actual sandbox. Also I couldn’t find where $output_directory maps to . Any help is really appreciated.

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #14363

    Pramod Thangali
    Moderator

    Kar,

    Can you provide more details on what you are trying to do? All references to files/directories in a job specification refer to files/directories on HDFS.

    Assuming you are referring to the job specification under Job Designer:
    - mapred.input.dir /user/hue/jobsub/sample_data on hdfs
    - $output_directory interpreted as a parameter that is prompted for when you submit the job. This directory should have write permissions for the current user. In this case sandbox.

    As an example use:
    - Go to Job Designer
    - Clone streaming _wordcount
    - Change the name of job to say my_streaming_wordcount (or any other name of your choice)
    - Click Save at the bottom of this screen
    - Once you are back on the job designer page, select my_streaming_wordcount
    - Click Submit and it will prompt you for the output directory
    - type /tmp/output1 for example
    When the job is finished, you can go to this directory on the ‘File Browser’ and see results

    Hope this helps….

    Collapse
Viewing 1 replies (of 1 total)