Home Forums Hive / HCatalog hive-testbench. ATSHook not found error

Tagged: ,

This topic contains 2 replies, has 2 voices, and was last updated by  Carter Shanklin 3 months ago.

  • Creator
    Topic
  • #57790

    Ilho Kim
    Participant

    Installing and testing hive-testbench( https://github.com/cartershanklin/hive-testbench.git)
    faced the following error. Is this because of missing configuration or lack of lib?

    – hadoop 2.4
    – Hive 0.13.1

    [hadoop@ip-172-31-5-6 bin]$ hadoop fs -ls /user/hive/warehouse
    Found 4 items
    drwxr-xr-x – hadoop supergroup 0 2014-07-22 10:11 /user/hive/warehouse/tpcds_bin_partitioned_orc_2.db <- 생성된 DB
    drwxr-xr-x – hadoop supergroup 0 2014-07-21 21:11 /user/hive/warehouse/tpcds_text_2.db
    [hadoop@ip-172-31-5-6 bin]$

    5)

    [hadoop@ip-172-31-5-6 sample-queries-tpcds]$ pwd
    /home/hadoop/hive-testbench/sample-queries-tpcds
    [hadoop@ip-172-31-5-6 sample-queries-tpcds]$ hive -i testbench.settings

    Logging initialized using configuration in jar:file:/home/hadoop/apache-hive-0.13.1-bin/lib/hive-common-0.13.1.jar!/hive-log4j.properties
    hive> use tpcds_bin_partitioned_orc_2;
    hive.exec.pre.hooks Class not found:org.apache.hadoop.hive.ql.hooks.ATSHook
    FAILED: Hive Internal Error: java.lang.ClassNotFoundException(org.apache.hadoop.hive.ql.hooks.ATSHook)
    java.lang.ClassNotFoundException: org.apache.hadoop.hive.ql.hooks.ATSHook
    at java.net.URLClassLoader$1.run(URLClassLoader.java:366)
    at java.net.URLClassLoader$1.run(URLClassLoader.java:355)
    at java.security.AccessController.doPrivileged(Native Method)
    at java.net.URLClassLoader.findClass(URLClassLoader.java:354)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:425)
    at java.lang.ClassLoader.loadClass(ClassLoader.java:358)
    at java.lang.Class.forName0(Native Method)
    at java.lang.Class.forName(Class.java:270)
    at org.apache.hadoop.hive.ql.hooks.HookUtils.getHooks(HookUtils.java:59)
    at org.apache.hadoop.hive.ql.Driver.getHooks(Driver.java:1172)
    at org.apache.hadoop.hive.ql.Driver.getHooks(Driver.java:1156)
    at org.apache.hadoop.hive.ql.Driver.execute(Driver.java:1206)
    at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1088)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:911)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:901)
    at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
    at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
    at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
    at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:792)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
    at java.lang.reflect.Method.invoke(Method.java:606)
    at org.apache.hadoop.util.RunJar.main(RunJar.java:212)

    hive>

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #57795

    Carter Shanklin
    Participant

    They should be commented out from testbench.settings

    Collapse
    #57794

    Carter Shanklin
    Participant

    Comment out these three lines, either by removing them or adding two dashes (–) to the beginning:

    set hive.exec.failure.hooks=org.apache.hadoop.hive.ql.hooks.ATSHook;
    set hive.exec.post.hooks=org.apache.hadoop.hive.ql.hooks.ATSHook;
    set hive.exec.pre.hooks=org.apache.hadoop.hive.ql.hooks.ATSHook;

    I will probably remove these lines from the settings file for better compatibility with other Hadoop versions.

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)