Home Forums Hue Hue Pig Job stays in 0%

This topic contains 2 replies, has 2 voices, and was last updated by  Rodulfo 4 months ago.

  • Creator
    Topic
  • #50211

    Rodulfo
    Participant

    Hello

    I installed a single node in AWS EC2 with Ambari and everything seems to work fine. Im using Hortonworks HUE 2.3.0 to run a Pig script but the job doesnt seem advance since it stays in 0%. If I check the sintax the job complets succesfully. I checked the Hue logs and I get no errors. I checked Hdp and I dont see anything wierd eithr. The container log shows the following:


    2014-03-17 12:06:16,869 INFO [IPC Server handler 9 on 57646] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Ping from attempt_1395067113856_0012_m_000000_0
    2014-03-17 12:06:19,905 INFO [IPC Server handler 12 on 57646] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Status update from attempt_1395067113856_0012_m_000000_0
    2014-03-17 12:06:19,905 INFO [IPC Server handler 12 on 57646] org.apache.hadoop.mapred.TaskAttemptListenerImpl: Progress of TaskAttempt attempt_1395067113856_0012_m_000000_0 is : 0.0

    and this goes on and on…

    Any idea why my job is never finishing?

    Thanks in advance

Viewing 2 replies - 1 through 2 (of 2 total)

The topic ‘Hue Pig Job stays in 0%’ is closed to new replies.

  • Author
    Replies
  • #50340

    Rodulfo
    Participant

    Hi Dave I solve the issue. I tracked it down and it was a matter of memory. I used your tutorial: “Manually Calculate YARN and MapReduce Memory Configuration Settings” to solve it and for the moment works fine.

    http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.8.0/bk_installing_manually_book/content/rpm-chap1-11.html

    Thanks for the help anyways.
    Rodulfo

    Collapse
    #50316

    Dave
    Moderator

    Hi Rodulfo,

    Can you share your pig script here?
    I was seeing issues using the following:

    a = LOAD ‘stocks’ using org.apache.hcatalog.pig.HCatLoader();
    b = filter a by stock_symbol == ‘IBM’;
    c = group b all;
    d = foreach c generate AVG(b.stock_volume);
    dump d;

    If I don’t have the dump d; at the end then it runs fine.

    I’m just interested if you are seeing the same?

    Have you tested this in the grunt shell – as my pig scripts have no issues there but in Hue it seems to have some issue.

    Thanks

    Dave

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)