HDP on Windows – Installation Forum

Hadoop R Streaming

  • #22536
    Yang Song

    I have a question about the Hadoop streaming. In this version HDP for windows, could I use streaming method to execute R script to do mapreduce job? If I could, how could I do this and what the command should I use?

to create new topics or reply. | New User Registration

  • Author
  • #22560
    Sasha J

    Thank you for using HDP!
    You definitely can use streaming for executing R scripts.
    However, I do not recall how to do this from the top of my head, need to do some research.

    Thank you!

    Paul Codding

    Hi Yang,

    Your best option for using R for MapReduce would be to use the RHadoop packages available on Github. These packages are created by RevolutionAnalytics and provide a lot of useful tools for interacting with MapReduce, HDFS, and HBase using R. You can find them here:



    I have worked through a similar challenge lately. I have documented the idiosyncrasies related to HDP on windows on my blog:


You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.