Home Forums HDP on Windows – Installation Pig Map Reduce Error

This topic contains 2 replies, has 2 voices, and was last updated by  Manish Sharma 9 months, 2 weeks ago.

  • Creator
    Topic
  • #47898

    Manish Sharma
    Participant

    Hi All,

    I am working on processing of MongoDB and Pig MapReduce using PigLatin. I have successfully imported MongoDB data to Hadoop cluster.But When I am trying to do group by operations getting the following Error.

    =============================================================================================================================

    2014-01-31 19:53:22,013 [Thread-19] INFO org.apache.hadoop.mapred.ReduceTask – attempt_local1860096372_0003_r_0000
    Need another 1 map output(s) where 0 is already in progress
    2014-01-31 19:53:22,013 [Thread-19] INFO org.apache.hadoop.mapred.ReduceTask – attempt_local1860096372_0003_r_0000
    Scheduled 0 outputs (0 slow hosts and0 dup hosts)
    2014-01-31 19:53:26,115 [communication thread] INFO org.apache.hadoop.mapred.LocalJobRunner – reduce > copy >
    2014-01-31 19:53:32,116 [communication thread] INFO org.apache.hadoop.mapred.LocalJobRunner – reduce > copy >
    2014-01-31 19:53:35,117 [communication thread] INFO org.apache.hadoop.mapred.LocalJobRunner – reduce > copy >
    2014-01-31 19:53:41,118 [communication thread] INFO org.apache.hadoop.mapred.LocalJobRunner – reduce > copy >

    =============================================================================================================================

    Could any one please tell me why this is happening ?

    Thanks
    MANISH

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #48239

    Manish Sharma
    Participant

    Hi,

    I did some changes after that it worked for me, The changes I have made are

    <property>
    <name>mapred.job.tracker</name>
    <value>hdfs://localhost:9000</value>
    <final>true</final> //CHANGE THIS true to False
    </property>

    <property>
    <name>fs.default.name</name>
    <!– cluster variant –>
    <value>hdfs://MASTER:8020</value>
    <final>ture</final> //CHANGE THIS true to False
    </property>

    After this changes it worked for me.

    Thanks
    MANISH

    Collapse
    #48237

    Robert Molina
    Moderator

    Hi Manish,
    Does the job finish? Does the jobtracker logs have any information or the task attempt?

    Regards,
    Robert

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)