Home Forums HDP on Windows – Installation Hadoop R Streaming

This topic contains 2 replies, has 3 voices, and was last updated by  Paul Codding 1 year ago.

  • Creator
    Topic
  • #22536

    Yang Song
    Member

    I have a question about the Hadoop streaming. In this version HDP for windows, could I use streaming method to execute R script to do mapreduce job? If I could, how could I do this and what the command should I use?

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #22562

    Paul Codding
    Member

    Hi Yang,

    Your best option for using R for MapReduce would be to use the RHadoop packages available on Github. These packages are created by RevolutionAnalytics and provide a lot of useful tools for interacting with MapReduce, HDFS, and HBase using R. You can find them here:

    https://github.com/RevolutionAnalytics/RHadoop/wiki

    Collapse
    #22560

    Sasha J
    Moderator

    Yang,
    Thank you for using HDP!
    You definitely can use streaming for executing R scripts.
    However, I do not recall how to do this from the top of my head, need to do some research.

    Thank you!
    Sasha

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)