Home Forums Pig Cannot run any pig scripts from Hue

This topic contains 6 replies, has 6 voices, and was last updated by  Artur Markiewicz 1 month, 3 weeks ago.

  • Creator
    Topic
  • #56788

    Jens Rabe
    Participant

    I just installed a small sample cluster with the current HDP and Ambari 1.6. It works well so far, but I cannot run any Pig scripts, even something simple like

    a = 3 + 3;
    dump a;

    I get the following log:

    ls: cannot access /hadoop/yarn/local/usercache/jra/appcache/application_1404231648965_0017/container_1404231648965_0017_01_000002/hive.tar.gz/hive/lib/slf4j-api-*.jar: No such file or directory
    Error: Could not find or load main class hive.metastore.uris=thrift:..localhost:9933

    I think there is a misconfiguration anywhere. Can you guide me what is wrong?

Viewing 6 replies - 1 through 6 (of 6 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #57712

    Artur Markiewicz
    Participant

    Hi!
    For me the following did the work:

    1. Go to Ambari/WebHCat and change the property templeton.hive.properties to “hive.metastore.local=false,hive.metastore.uris=thrift://<YOUR_METASTORE_HOST>:9083,hive.metastore.sasl.enabled=false”. Be sure to remove all spaces in the property’s value! I guess, that spaces cause some command-line execution to fail – the property value after the space will be interpreted as a next argument. In this case as a class name. Restart WebHCat and try to execute your Pig-script.

    2. Add slf4j-api jar to hdfs:///apps/webhcat/hive.tar.gz to get rid of the first error. I guess it’s not critical, to get the Pig-scripts to work.

    Cheers!

    Collapse
    #57655

    Learner
    Participant

    Also I tried editing /usr/lib/pig/bin/pig and added HCAT_HOME=/usr/lib/hive-hcatalog. After this I restarted all the services. But the same error still persists.

    “”
    ls: cannot access /hadoop/yarn/local/usercache/hdfs/appcache/application_1405964500282_0014/container_1405964500282_0014_01_000002/hive.tar.gz/hive/lib/slf4j-api-*.jar: No such file or directory
    Error: Could not find or load main class hive.metastore.uris=thrift:..inf-misc-snv-05:9083
    “”

    Collapse
    #57654

    Learner
    Participant

    Hi
    I installed hue and while writing pig script I am getting the same error.
    “”
    ls: cannot access /hadoop/yarn/local/usercache/hdfs/appcache/application_1405964500282_0014/container_1405964500282_0014_01_000002/hive.tar.gz/hive/lib/slf4j-api-*.jar: No such file or directory
    Error: Could not find or load main class hive.metastore.uris=thrift:..inf-misc-snv-05:9083
    “”
    can anyone help me to fix this problem. Thanks in advance.

    Collapse
    #57601

    Praveen Kumar
    Participant

    I also have the same error. As Owen Taylor suggested above, I edited /usr/lib/pig/bin/pig and added HCAT_HOME=/usr/lib/hive-hcatalog. After this I restarted all the services. But the same error still persists.

    Collapse
    #57555

    Owen Taylor
    Participant

    Hi Jens,

    I’m not sure if this will be satisfactory, but some issues related to pig in HDP are discussed/resolved in this thread:

    http://hortonworks.com/community/forums/topic/sandbox-pig-basic-tutorial-example-is-nbot-working/page/2/#post-56174

    Collapse
    #57037

    Christian González
    Participant

    I have the same problem, I have installed HDP 2.1.2.1 and
    hue-common-2.3.1.2.1.2.0-402.el6.x86_64
    hue-plugins-2.3.1.2.1.2.0-402.el6.x86_64
    hue-pig-2.3.1.2.1.2.0-402.el6.x86_64
    hue-hcatalog-2.3.1.2.1.2.0-402.el6.x86_64
    hue-oozie-2.3.1.2.1.2.0-402.el6.x86_64
    hue-beeswax-2.3.1.2.1.2.0-402.el6.x86_64
    hue-server-2.3.1.2.1.2.0-402.el6.x86_64
    hue-shell-2.3.1.2.1.2.0-402.el6.x86_64
    hue-2.3.1.2.1.2.0-402.el6.x86_64

    Collapse
Viewing 6 replies - 1 through 6 (of 6 total)