Home Forums HDP 2.1 Technical Preview tez classpath error

Tagged: 

This topic contains 0 replies, has 1 voice, and was last updated by  Eric Perler 4 months, 2 weeks ago.

  • Creator
    Topic
  • #57259

    Eric Perler
    Participant

    Hello

    I installed and enabled TEZ but when I run a query through HUE I get the following error

    14/07/15 08:35:24 ERROR thrift.ProcessFunction: Internal error processing query
    java.lang.NoClassDefFoundError: org/apache/tez/dag/api/SessionNotRunning
    at org.apache.hadoop.hive.ql.session.SessionState.start(SessionState.java:354)
    at com.cloudera.beeswax.BeeswaxServiceImpl$RunningQueryState.initialize(BeeswaxServiceImpl.java:303)
    at com.cloudera.beeswax.BeeswaxServiceImpl$2.run(BeeswaxServiceImpl.java:832)
    at com.cloudera.beeswax.BeeswaxServiceImpl$2.run(BeeswaxServiceImpl.java:828)
    at java.security.AccessController.doPrivileged(Native Method)
    at javax.security.auth.Subject.doAs(Subject.java:415)
    at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1557)
    at com.cloudera.beeswax.BeeswaxServiceImpl.doWithState(BeeswaxServiceImpl.java:777)

    I have set $TEZ_CONF_DIR, $TEZ_JARS, and added $TEZ_JARS to the $HADOOP_CLASSPATH

    I have added the tez.lib.uris property to tez-site.xml

    <property>
    <name>tez.lib.uris</name>
    <value>hdfs://172.31.83.135:8020/apps/tez/,hdfs://172.31.83.135:8020/apps/tez/lib/</value>
    </property>

    And I have copied the files into the HDFS directory

    # hadoop fs -ls /apps/tez
    Found 10 items
    drwxr-xr-x – hdfs Users 0 2014-07-15 09:26 /apps/tez/conf
    drwxr-xr-x – hdfs Users 507 2014-07-15 09:26 /apps/tez/lib
    -rw-r–r– 1 hdfs Users 748258 2014-07-15 09:26 /apps/tez/tez-api-0.4.0.2.1.2.0-402.jar
    -rw-r–r– 1 hdfs Users 29852 2014-07-15 09:26 /apps/tez/tez-common-0.4.0.2.1.2.0-402.jar
    -rw-r–r– 1 hdfs Users 980895 2014-07-15 09:26 /apps/tez/tez-dag-0.4.0.2.1.2.0-402.jar
    -rw-r–r– 1 hdfs Users 242117 2014-07-15 09:26 /apps/tez/tez-mapreduce-0.4.0.2.1.2.0-402.jar
    -rw-r–r– 1 hdfs Users 195639 2014-07-15 09:26 /apps/tez/tez-mapreduce-examples-0.4.0.2.1.2.0-402.jar
    -rw-r–r– 1 hdfs Users 110397 2014-07-15 09:26 /apps/tez/tez-runtime-internals-0.4.0.2.1.2.0-402.jar
    -rw-r–r– 1 hdfs Users 348568 2014-07-15 09:26 /apps/tez/tez-runtime-library-0.4.0.2.1.2.0-402.jar
    -rw-r–r– 1 hdfs Users 2620 2014-07-15 09:26 /apps/tez/tez-tests-0.4.0.2.1.2.0-402.jar

    Is there another step I am missing to get HUE/beeswax to see the TEZ jars on the classpth

    Thanks

The forum ‘HDP 2.1 Technical Preview’ is closed to new topics and replies.