HDP on Windows – Other Forum
Using Windows HDP without Azure
I am building a Data Analysis prototype using .Net in the HDP Sandbox which I then want to apply to our client solutions. Two things to note:
– The implementation needs to be in .Net as far as possible. This involves data files management as well as writing of Mapper-Reducer / Jobs code in .Net.
– The implementation is NOT going to be on Azure. It will be either in premise or on Amazon.
I successfully used the WebHDFS webservice for the data files management. However, how do I implement the Mapper-Reducer / Jobs management code in .Net without relying on HDInsight dependencies? I tried the Streaming approach but that also has HDInsight dependencies. Would ODBC drivers be of any help? Or is there any other approach?
Some pointers greatly appreciated!!! Thanks,
The forum ‘HDP on Windows – Other’ is closed to new topics and replies.
Support from the Experts
A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.
Become HDP Certified
Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world