Home Forums Hive / HCatalog HiveServer2 – Beeline – hive-builtins-0.10.0.22.jar on HDFS??

This topic contains 1 reply, has 2 voices, and was last updated by  Carter Shanklin 11 months, 2 weeks ago.

  • Creator
    Topic
  • #30418

    Following error occurs when a beeline command is run that requires submitting a Map-Reduce job – such as ‘analyze table ‘

    Below is the error trace – did anyone experience this? I’ve tried setting the value in hive.aux.jars.path in hive-site.xml as well in hive-env.sh. Only thing I’ve not checked is permissions on HDFS. The user initiating the Job is still ‘hive’ and user is given permissions on /apps/hive folder. Is there a dependency on tez-ampool-jars folder?

    java.io.FileNotFoundException: File does not exist: hdfs://avine001.dewron.com:8020/usr/lib/hive/lib/hive-builtins-0.10.0.22.jar
    at org.apache.hadoop.hdfs.DistributedFileSystem.getFileStatus(DistributedFileSystem.java:815)
    at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:288)
    at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.getFileStatus(ClientDistributedCacheManager.java:224)
    at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestamps(ClientDistributedCacheManager.java:93)
    at org.apache.hadoop.mapreduce.filecache.ClientDistributedCacheManager.determineTimestampsAndCacheVisibilities(ClientDistributedCacheManager.java:57)
    at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:255)
    at org.apache.hadoop.mapreduce.JobSubmitter.copyAndConfigureFiles(JobSubmitter.java:291)
    at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:362)
    at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1218)
    at org.apache.hadoop.mapreduce.Job$11.run(Job.java:1215)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1441)
    at org.apache.hadoop.mapreduce.Job.submit(Job.java:1215)
    at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:587)
    at org.apache.hadoop.mapred.JobClient$1.run(JobClient.java:582)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:396)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1441)
    at org.apache.hadoop.mapred.JobClient.submitJob(JobClient.java:582)
    at org.apache.hadoop.hive.ql.exec.ExecDriver.execute(ExecDriver.java:448)
    at org.apache.hadoop.hive.ql.exec.ExecDriver.main(ExecDriver.java:682)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
    at java.lang.reflect.Method.invoke(Method.java:597)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:212)
    Job Submission failed with exception ‘java.io.FileNotFoundException(File does not exist: hdfs://avine001.dewron.com:8020/usr/lib/hive/lib/hive-builtins-0.10.0.22.jar)’
    Execution failed with exit status: 1

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #32577

    Carter Shanklin
    Participant

    Is it possible for you to upgrade to HDP 1.3? The problem might not occur there. Otherwise you can try copying the JAR into the directory where it’s looking for it.

    Collapse
Viewing 1 replies (of 1 total)