Home Forums Pig Talend Data Integration (HDP) pig error

This topic contains 4 replies, has 3 voices, and was last updated by  Pal J 1 year, 4 months ago.

  • Creator
    Topic
  • #25551

    Pal J
    Participant

    I created job to perform data analysis as per instruction provided in bk_dataintergration guide page# 5 to page#9, when I tired to run the job I getting following error
    org.apache.pig.impl.logicalLayer.FrontendException: ERROR 1002: Unable to store alias tPigAggregate_1_RESULT
    Caused by: org.apache.pig.backend.executionengine.ExecException: ERROR 2043: Unexpected error during execution.
    Caused by: java.io.IOException: Call to hdpbox/192.168.93.131:50030 failed on local exception: java.io.EOFException

    I made sure following services are started HDFS, MapReduce, Zookeeper and HBase

    thanks
    Pal

Viewing 4 replies - 1 through 4 (of 4 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #25966

    Pal J
    Participant

    Hi Seth,
    I resolved this issue, I was using http port number 50030 of Job tracker instead of job tracker port number; I changed to 50300 (after checking the mapred-site.xml).
    I do have another query, when I tired browse content of file/result “output/part-r-00000” in HDFS file system via Ambari admin web console logeed in as defauly users “admin” (i.e. Namenod http://servername:8020 (Browse the filesystem)  http://servername:50075 ). I get error “org.apache.hadoop.security.AccessControlException: Permission denied: user=gopher, access=READ_EXECUTE, inode=”hdptestuser”: hdptestuser:hdfs:rwx——“
    But was able to view the result via terminal windows using command “hadoop dfs -cat /user/hdptestuser/output/part-r-00000”
    Do I have create another account in Ambari admin web console which is user in unix OR should I grant read permission to public for the directory “hdptestuser” can we grant permissions to default account “admin” to access . Just wanted to what are best practices.
    Also what are passwords for accounts following account “ambari_qa, hadoop_deplpoy, oozie and puppet” created during creation of cluster in ambari

    thanks
    Pal

    Collapse
    #25935

    Seth Lyubich
    Keymaster

    Hi Pal,

    Can you please let us know if you are using instruction here below?

    http://docs.hortonworks.com/HDPDocuments/HDP1/HDP-1.2.4/bk_dataintegration/content/ch_talend-instruct.html#ch_talend-instruct-job-step5

    Also, can you please try running the job with firewall disabled? Can you please let us know you installation method and version?

    Hope this helps,

    Thanks,
    Seth

    Collapse
    #25671

    Pal J
    Participant

    Hi Abdelrahman,
    I checked “http://192.168.93.131:50030″ is working, can you please advise if i have check any logs or other settings ?

    thanks

    Collapse
    #25601

    abdelrahman
    Moderator

    Hi Paul ,

    Please make sure that the firewall is off and Jobtracker is up and running. Also, check the Jobtracker UI by clicking on the following link.

    http://192.168.93.131:50030

    Hope this helps.

    Thanks
    -Abdelrahman

    Collapse
Viewing 4 replies - 1 through 4 (of 4 total)