MapReduce Forum

Failed to run MapReduce job

  • #47285
    Gabriel Ciuloaica


    I have installed Hortonworks on AWS using Ambari. Without any extra configuration than defaults, I’m trying to run a MapReduce job that needs to connect to a kafka broker on a different box. From same machine I can successfully connect and consume messages from kafka broker, but only when I’m running a similar code from hadoop, I’m getting the following exception:

    14/01/22 19:10:30 INFO mapreduce.JobSubmitter: Cleaning up the staging area /user/root/.staging/job_1390409931641_0005
    14/01/22 19:10:30 ERROR security.UserGroupInformation: PriviledgedActionException as:root (auth:SIMPLE) Connection refused
    Exception in thread “main” Connection refused
    at Method)
    at Source)
    at kafka.consumer.SimpleConsumer.connect(Unknown Source)
    at kafka.consumer.SimpleConsumer.getOrMakeConnection(Unknown Source)
    at kafka.consumer.SimpleConsumer.kafka$consumer$SimpleConsumer$$sendRequest(Unknown Source)
    at kafka.consumer.SimpleConsumer.send(Unknown Source)
    at kafka.javaapi.consumer.SimpleConsumer.send(Unknown Source)
    at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(
    at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(
    at org.apache.hadoop.mapreduce.Job$
    at org.apache.hadoop.mapreduce.Job$
    at Method)
    at org.apache.hadoop.mapreduce.Job.submit(
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(
    at java.lang.reflect.Method.invoke(
    at org.apache.hadoop.util.RunJar.main(

    Any clues?

to create new topics or reply. | New User Registration

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.