Home Forums Hortonworks Sandbox Sandbox – Pig Basic Tutorial example is nbot working

This topic contains 51 replies, has 33 voices, and was last updated by  Howard Dierking 1 week ago.

  • Creator
    Topic
  • #17798

    Sankarg
    Member

    Hi, I just tried the following pig Basic Tutorial which is not working

    a = LOAD ‘nyse_stocks’ USING org.apache.hcatalog.pig.HCatLoader();
    b = FILTER a BY stock_symbol == ‘IBM’;
    c = group b all;
    d = FOREACH c GENERATE AVG(b.stock_volume);
    dump d;

    when i tried the syntax check, the following logs captured.

    013-03-17 14:35:28,456 [main] INFO org.apache.pig.Main – Apache Pig version 0.10.1.21 (rexported) compiled Jan 10 2013, 04:00:42
    2013-03-17 14:35:28,459 [main] INFO org.apache.pig.Main – Logging error messages to: /home/sandbox/hue/pig_1363556128447.log
    2013-03-17 14:35:41,945 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to hadoop file system at: file:///
    2013-03-17 14:35:45,555 [main] ERROR org.apache.pig.tools.grunt.Grunt – ERROR 1070: Could not resolve org.apache.hcatalog.pig.HCatLoader using imports: [, org.apache.pig.builtin., org.apache.pig.impl.builtin.]
    Details at logfile: /home/sandbox/hue/pig_1363556128447.log

    please do the needful to resolve this issue. Thank you!

    Regards,
    Sankar

Viewing 30 replies - 1 through 30 (of 51 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #57719

    Howard Dierking
    Participant

    Yes, I added the -useHcatalog statement and it was still not working. Ended up getting unblocked by just running pig in local mode on my machine, so will circle back to the sandbox at some point in the future.

    Collapse
    #57718

    Sagar Allamdas
    Participant

    Just go to Sandbox shell….
    write…
    pig -useHcatalog
    —insert ur pig script here—-

    it works fast and great

    Collapse
    #57391

    Tom Benton
    Participant

    Howard, are you still having issues? I just went through the tutorial and was able to complete it successfully. Do you have the latest version of the sandbox and tutorials installed?

    The -useHCatalog option can be added using HUE and the Pig prompt.

    Collapse
    #57267

    Howard Dierking
    Participant

    I noticed that there hasn’t been any update on this thread for quite a while and I just hit the same issue today. Was there a work around discovered other than modifying /usr/bin/pig to add the -useHCatalog flag to the pig command?

    Collapse
    #57068

    Charles Ibrahim
    Participant

    Hi,
    I got the same error, still.

    When typing:

    a = LOAD ‘default.sample_07′ USING org.apache.hcatalog.pig.HCatLoader();

    I got:

    ls: cannot access /usr/lib/hive/lib/slf4j-api-*.jar: No such file or directory
    2014-07-10 01:55:56,678 [main] INFO org.apache.pig.Main – Apache Pig version 0.12.1.2.1.1.0-385 (rexported) compiled Apr 16 2014, 15:59:00
    2014-07-10 01:55:56,680 [main] INFO org.apache.pig.Main – Logging error messages to: /hadoop/yarn/local/usercache/hue/appcache/application_1404978936821_0004/container_1404978936821_0004_01_000002/pig_1404982556676.log
    2014-07-10 01:55:58,231 [main] ERROR org.apache.pig.Main – ERROR 2997: Encountered IOException. File HCatalog->load template does not exist
    Details at logfile: /hadoop/yarn/local/usercache/hue/appcache/application_1404978936821_0004/container_1404978936821_0004_01_000002/pig_1404982556676.log

    Collapse
    #56174

    Owen Taylor
    Participant

    It should be noted that the exceptions and issues in this thread are not all the same. I mention this because I don’t want folks to be confused into thinking this is harder than it should be or more broken than it is. :)
    Bottom, line – carefully read the stack traces for clues regarding which error you are facing.
    [Sometimes there is no error at all - just warnings which can look alarming but can be overlooked - the data may be written to the output directory as you requested and you just need to go find it! ]

    Types of errors exposed in this thread:

    * Security exceptions due to copy-paste errors where quotes are not ” ” regular quotes Solution: check your scripts for weird symbols/characters and hand-type the correct ones in if they look suspicious

    * Missing library issues (this was the one I addressed in my earlier post by adding HCAT_HOME=/usr/lib/hive-hcatalog into the pig script)

    * Jar file typos Hcatatalog or similar typos prevent the JVM from loading the correct jar – Solution: double check your keywords and jar file names etc

    * Formatting issues within the pig script – using ” in place of ‘ or using = instead of == Solution: read the exception text and carefully examine all your code

    I think that pretty much covers it. Hopefully, that adds some clarity going forward.

    Cheers,

    Owen.

    Collapse
    #56154

    Amit Likhyani
    Participant

    Owen, I downloaded the latest sandbox 2 days ago and implemented the fix. Same error. Anyone else having the same issues?

    Collapse
    #56105

    Owen Taylor
    Participant

    I think I have a fix:
    HCAT_HOME needs to be set properly to
    /usr/lib/hive-hcatalog

    One way to do this is to Edit the following file:

    /usr/lib/pig/bin/pig

    So that this line
    if [ "$HCAT_HOME" == "" ]; then

    is preceded by this line:

    HCAT_HOME=/usr/lib/hive-hcatalog

    So I have the following:

    #### Owen otaylor@hortonworks.com Added this next line to enable finding HCATALOG Jars etc:

    HCAT_HOME=/usr/lib/hive-hcatalog

    if [ "$HCAT_HOME" == "" ]; then
    if [ -d "/usr/lib/hcatalog" ]; then
    HCAT_HOME=/usr/lib/hcatalog
    else
    echo “Please initialize HCAT_HOME”
    exit -1
    fi
    fi
    hcatJarPath=ls $HCAT_HOME/share/hcatalog/$hcatJar

    etc…

    After doing this the following works for me:

    a = LOAD ‘nyse_stocks’ USING org.apache.hcatalog.pig.HCatLoader();
    b = FILTER a BY stock_symbol == ‘IBM’;
    c = GROUP b ALL;
    d = FOREACH c GENERATE AVG(b.stock_volume);
    store d INTO ‘/wip/pigtest/1′;

    Cheers,

    Owen.

    Collapse
    #55728

    VJ Jain
    Participant

    I have the same problem with SandBox 2.1 for all Pig tutorials that use PigStorage or reference HCatalog. I have tried numerous fixes on here and looked for more recent Pig scripts to see what differences there are. I noticed that some of the newer scripts use the full virtual path for the load. For example, STOCK_A = LOAD ‘/user/hue/NYSE_daily_prices_A.csv’ using PigStorage(‘,’); instead of STOCK_A = LOAD ‘NYSE_daily_prices_A.csv’ using PigStorage(‘,’). This did not resolve my problem. Furthermore, while the job errors, it produces no log files. I have tried to locate them on the server but they don’t exist. There is obviously some issue with the 2.1 SandBox making the earlier Pig tutorials invalid because none of them work. I read the more recent posts on this thread and I am in the exact same position. The earlier solutions might have worked for earlier distributions but not for 2.1. Can someone please let us all know how to get the Pig scripts working on 2.1?

    Collapse
    #55563

    Anand Venkatraman
    Participant

    I was able to successfully complete tutorial 1 (nyse_stock). However, I keep getting a bunch of errors with tutorial 2 (batting.csv)

    ls: cannot access /usr/lib/hive/lib/slf4j-api-*.jar: No such file or directory
    2014-06-10 20:31:04,641 [main] INFO org.apache.pig.Main – Apache Pig version 0.12.1.2.1.1.0-385 (rexported) compiled Apr 16 2014, 15:59:00
    2014-06-10 20:31:04,642 [main] INFO org.apache.pig.Main – Logging error messages to: /hadoop/yarn/local/usercache/hue/appcache/application_1402456675484_0003/container_1402456675484_0003_01_000002/pig_1402457464639.log
    2014-06-10 20:31:05,503 [main] INFO org.apache.pig.impl.util.Utils – Default bootup file /home/yarn/.pigbootup not found
    2014-06-10 20:31:05,656 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
    2014-06-10 20:31:05,656 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:05,656 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to hadoop file system at: hdfs://sandbox.hortonworks.com:8020
    2014-06-10 20:31:06,288 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:06,324 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:06,356 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:06,389 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:06,416 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:06,419 [main] WARN org.apache.pig.PigServer – Empty string specified for jar path
    2014-06-10 20:31:06,490 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:06,539 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:06,592 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-06-10 20:31:06,641 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    <file script.pig, line 1, column 15> Unexpected character ‘‘’
    2014-06-10 20:31:06,828 [main] ERROR org.apache.pig.PigServer – exception during parsing: Error during parsing. <file script.pig, line 1, column 15> Unexpected character ‘‘’
    Failed to parse: <file script.pig, line 1, column 15> Unexpected character ‘‘’
    at org.apache.pig.parser.QueryParserDriver.parse(QueryParserDriver.java:243)
    at org.apache.pi

    Collapse
    #53871

    Ahmed Hashmi
    Participant

    hi ,

    I have Just installed the Sandbox and ran the Basic PIG Program . It is running successfully but with no output and logs also not showing any Error .
    Please help to resolve this .

    ls: cannot access /usr/lib/hive/lib/slf4j-api-*.jar: No such file or directory
    2014-05-16 23:14:27,247 [main] INFO org.apache.pig.Main – Apache Pig version 0.12.1.2.1.1.0-385 (rexported) compiled Apr 16 2014, 15:59:00
    2014-05-16 23:14:27,249 [main] INFO org.apache.pig.Main – Logging error messages to: /hadoop/yarn/local/usercache/hue/appcache/application_1400296543712_0013/container_1400296543712_0013_01_000002/pig_1400307267243.log
    2014-05-16 23:14:28,706 [main] INFO org.apache.pig.impl.util.Utils – Default bootup file /home/yarn/.pigbootup not found
    2014-05-16 23:14:29,677 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
    2014-05-16 23:14:29,678 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:29,678 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to hadoop file system at: hdfs://sandbox.hortonworks.com:8020
    2014-05-16 23:14:31,016 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,094 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,163 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,227 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,293 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,300 [main] WARN org.apache.pig.PigServer – Empty string specified for jar path
    2014-05-16 23:14:31,391 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,558 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,760 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,838 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:31,969 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-05-16 23:14:34,773 [main] INFO hive.metastore – Trying to connect to metastore with URI thrift://sandbox.hortonworks.com:9083
    2014-05-16 23:14:35,133 [main] INFO hive.metastore – Connected to metastore.
    2014-0

    Collapse
    #51537

    Don Estes
    Participant

    Thanks Nicolas! That worked for me when all the other work arounds didn’t.

    Collapse
    #50613

    suaroman
    Participant

    Just checking to see if there are any updates?
    I have the latest 2.x sandbox and experiencing the same problem.

    None of the recommended solutions has worked.

    This command: (from Larry )
    sed -i ’49s/.*/includeHCatalog=true;/’ /usr/lib/pig/bin/pig

    didn’t resolve the problem

    nor did manually going to pig file and making the adjustments work.

    I don’t think this problem is related to the VM. I’m using VMWare workstation 10.

    If you need anything, i’ll be happy to send you my files or any of the configurations I have.
    thanks,

    Collapse
    #49734

    Maddy Techie
    Participant

    hi – i tried the basic tutorial , but its not working. On Execute it succesfully completes , but the output is blank.
    Below is my code and log file

    a = LOAD ‘nyse_stocks’ USING org.apache.hcatalog.pig.HCatLoader();
    b = filter a by stock_symbol == ‘IBM’;
    c = group b all;
    d = foreach c generate AVG(b.stock_volume);
    dump d;
    —————
    log file

    2014-03-06 16:56:17,294 [main] INFO org.apache.pig.Main – Apache Pig version 0.12.0.2.0.6.0-76 (rexported) compiled Oct 17 2013, 20:44:07
    2014-03-06 16:56:17,322 [main] INFO org.apache.pig.Main – Logging error messages to: /hadoop/yarn/local/usercache/hue/appcache/application_1394153146773_0001/container_1394153146773_0001_01_000002/pig_1394153777285.log
    2014-03-06 16:56:35,564 [main] INFO org.apache.pig.impl.util.Utils – Default bootup file /home/yarn/.pigbootup not found
    2014-03-06 16:56:37,061 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.job.tracker is deprecated. Instead, use mapreduce.jobtracker.address
    2014-03-06 16:56:37,062 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – fs.default.name is deprecated. Instead, use fs.defaultFS
    2014-03-06 16:56:37,063 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to hadoop file system at: hdfs://sandbox.hortonworks.com:8020
    2014-03-06 16:56:37,113 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.used.genericoptionsparser is deprecated. Instead, use mapreduce.client.genericoptionsparser.used
    2014-03-06 16:56:44,048 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – dfs.df.interval is deprecated. Instead, use fs.df.interval
    2014-03-06 16:56:44,049 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.task.tracker.http.address is deprecated. Instead, use mapreduce.tasktracker.http.address
    2014-03-06 16:56:44,049 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – dfs.max.objects is deprecated. Instead, use dfs.namenode.max.objects
    2014-03-06 16:56:44,050 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.userlog.retain.hours is deprecated. Instead, use mapreduce.job.userlog.retain.hours
    2014-03-06 16:56:44,051 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – hadoop.native.lib is deprecated. Instead, use io.native.lib.available
    2014-03-06 16:56:44,053 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.local.dir.minspacestart is deprecated. Instead, use mapreduce.tasktracker.local.dir.minspacestart
    2014-03-06 16:56:44,053 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.shuffle.read.timeout is deprecated. Instead, use mapreduce.reduce.shuffle.read.timeout
    2014-03-06 16:56:44,055 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – io.sort.spill.percent is deprecated. Instead, use mapreduce.map.sort.spill.percent
    2014-03-06 16:56:44,056 [main] INFO org.apache.hadoop.conf.Configuration.deprecation – mapred.reduce.parallel.copi

    Collapse
    #48729

    Nicolas MASSART
    Participant

    Have the same issue, and i found what’s happen !!!
    The problem come if the parameter “-useHCatalog” is not set.
    If you only write the parameter on the HDP Pig interface it on the text field it is not taken in account, you need to press enter button.

    Collapse
    #48396

    one2go
    Participant

    I encountered this problem (“ERROR 1070: Could not resolve org.apache.hcatalog.ping.HCataloader”) after downloading Hortonworks+Sandbox+2.0+VMware.ova on Feb 8, 2014. The fixes below did not solve the problem when using the browser-based hue editor. (It did solve the problem when running pig from the command line on the sandbox).

    I was able to get it working by patching the following file.

    sed -i 's/^includeHCatalog=.*/includeHCatalog=true;/' /hadoop/yarn/local/filecache/10/pig.tar.gz/pig/bin/pig

    Collapse
    #44734

    I’m also having trouble with the tutorial1 pig script. When I execute it, I get no results back. The job reports success, but the box remains empty. The syntax check passes, while the explain plan fails without presenting any logs. I’ve tried this with Chrome and with Internet Explorer.

    I am running a fresh Hortonworks+Sandbox+2.0+VMware instance with the latest VMware Player. Here is the code I’m running:

    a = LOAD ‘nyse_stocks’ USING org.apache.hcatalog.pig.HCatLoader();
    b = FILTER a BY stock_symbol == ‘IBM’;
    c = GROUP b ALL;
    d = FOREACH c GENERATE SUM(b.stock_volume);
    DUMP d;

    Any thoughts? Thanks!

    Kevin

    Collapse
    #43682

    Hi,

    I am trying to run the Tutorial #2, I follow each step very carefully but when I Execute I get the following Error.

    Job job_1384288052635_0017 was failed

    Here is the script I try to run:

    batting = load ‘Batting.csv’ using PigStorage(‘,’);
    runs = FOREACH batting GENERATE $0 as playerID, $1 as year, $8 as runs;
    grp_data = GROUP runs by (year);
    max_runs = FOREACH grp_data GENERATE group as grp,MAX(runs.runs) as max_runs;
    join_max_run = JOIN max_runs by ($0, max_runs), runs by (year,runs);
    join_data = FOREACH join_max_run GENERATE $0 as year, $2 as playerID, $1 as runs;
    dump join_data;

    When I click on Explain I get this message:

    #———————————————–
    # New Logical Plan:
    #———————————————–
    Logical plan is empty.

    When I run syntax check, everything seems normal.

    Please help.

    Thanks

    Collapse
    #41085

    I think VirtualBox does cause errors on occassion when importing the 2.0 beta sandbox. I had the same error and applied the fixes as described by Larry and Peter, to no effect. After I re-imported the VM the query started working without needing the fixes. Thanks Oracle, not.

    Collapse
    #28615

    tedr
    Moderator

    Hi Nilesh,

    in looking at this line from your post:

    2013-06-27 11:12:28,167 [main] ERROR org.apache.pig.tools.grunt.Grunt – ERROR 1070: Could not resolve org.apache.hcatalog.ping.HCataloader using imports: [, org.apache.pig.builtin., org.apache.pig.impl.builtin.]

    it looks like the problem is a misspelling of the class name – it should be ‘HCatLoader’ not ‘HCataloader’ – note the extra ‘a’ in what you entered and the need for a uppercase ‘L’.

    Thanks,
    Ted.

    Collapse
    #28492

    Hello Ted/Sasha/Larry, I followed the workaround suggestions. Now receiving a different error. Please help.

    2013-06-27 11:12:27,054 [main] INFO org.apache.pig.Main – Apache Pig version 0.11.1.1.3.0.0-107 (rexported) compiled May 20 2013, 03:04:35
    2013-06-27 11:12:27,059 [main] INFO org.apache.pig.Main – Logging error messages to: /hadoop/mapred/taskTracker/hue/jobcache/job_201306271056_0001/attempt_201306271056_0001_m_000000_0/work/pig_1372356747052.log
    2013-06-27 11:12:27,334 [main] INFO org.apache.pig.impl.util.Utils – Default bootup file /usr/lib/hadoop/.pigbootup not found
    2013-06-27 11:12:27,447 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to hadoop file system at: hdfs://sandbox:8020
    2013-06-27 11:12:27,597 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to map-reduce job tracker at: sandbox:50300
    2013-06-27 11:12:28,167 [main] ERROR org.apache.pig.tools.grunt.Grunt – ERROR 1070: Could not resolve org.apache.hcatalog.ping.HCataloader using imports: [, org.apache.pig.builtin., org.apache.pig.impl.builtin.]
    Details at logfile: /hadoop/mapred/taskTracker/hue/jobcache/job_201306271056_0001/attempt_201306271056_0001_m_000000_0/work/pig_1372356747052.log

    Collapse
    #26974

    tedr
    Moderator

    Hi Doop,

    Thanks for letting us know that you figured it out.

    Ted.

    Collapse
    #26941

    ETL Doop
    Member

    The issue resolved. I logged in and replaced the last line in the /usr/bin/pig file:

    Replace to: exec /usr/lib/pig/bin/pig -useHCatalog “$@”

    I followed Kirill Wood steps and it worked…Thank you.

    Collapse
    #26894

    ETL Doop
    Member

    Thanks Sarah for login pwd…Logged in as root.

    Unable to access pig folder. How do i resolve HCatloder issue? Please let me know.

    Collapse
    #26892

    Sasha J
    Moderator

    Dear Doop,
    Do you mean to say “what is username and password for Sandbox”?
    Or you meant something else?
    username is root
    password is hadoop

    Hope this helps!
    Thank you!
    Sasha

    Collapse
    #26891

    ETL Doop
    Member

    2013-06-03 16:43:59,751 [main] INFO org.apache.pig.Main – Apache Pig version 0.10.1.21 (rexported) compiled Jan 10 2013, 04:00:42
    2013-06-03 16:43:59,752 [main] INFO org.apache.pig.Main – Logging error messages to: /home/sandbox/hue/pig_1370303039747.log
    2013-06-03 16:43:59,998 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to hadoop file system at: hdfs://sandbox:8020
    2013-06-03 16:44:00,412 [main] INFO org.apache.pig.backend.hadoop.executionengine.HExecutionEngine – Connecting to map-reduce job tracker at: sandbox:50300
    2013-06-03 16:44:00,896 [main] ERROR org.apache.pig.tools.grunt.Grunt – ERROR 1070: Could not resolve org.apache.hcatalog.pig.HCatLoader using imports: [, org.apache.pig.builtin., org.apache.pig.impl.builtin.]
    Details at logfile: /home/sandbox/hue/pig_1370303039747.log

    1. Downloaded the Version today..
    2. username / pwd for the Virtual version

    Please assist.

    Collapse
    #24682

    Larry Liu
    Moderator

    Hi, Craig

    Thanks for trying and let us know it worked.

    Please let us know any issues you meet.

    Larry

    Collapse
    #24582

    Craig Rowley
    Member

    I was receiving the error for newly downloaded HDP Sandbox (downloaded today) when trying to execute tutorial1, check syntax, explain.
    (using Mac OSX 10.6.8, Virtualbox 4.2.4)

    I used terminal and ssh’d into the VM (using IP from url and root/hadoop as auth)

    I applied the fix to /usr/bin/pig (to add -useHCatalog to last line)

    It worked, as far as I can tell

    Collapse
    #23758

    Yi Zhang
    Moderator

    Hi Adam,

    There is no /etc/bin/pig, do you mean /usr/lib/pig/bin/pig or /usr/bin/pig?

    Try peter’s suggestion:

    sed -i ’49s/.*/includeHCatalog=true;/’ /usr/lib/pig/bin/pig

    This will load HCatalog automatically when pig is started.

    Thanks,
    Yi

    Collapse
    #23576

    Has anyone found the resolution to this issue. It looks like we get it first with Hcat then with pig. it must be a config problem but I can’t even get to the directory recommended above. My /etc/bin/ does not have a pig in it on the newest sandbox – downloaded on 4/26/13. I’m happy to try recommendations if folks can reply. I’ll post the results here.

    Collapse
Viewing 30 replies - 1 through 30 (of 51 total)