Home Forums Hive / HCatalog using user-supplied jars

Tagged: 

This topic contains 6 replies, has 3 voices, and was last updated by  tedr 9 months, 3 weeks ago.

  • Creator
    Topic
  • #28479

    Andrew Hume
    Participant

    we are running a jdbc query that uses an .jar we have.
    we installed the jar file in the same path on all nodes in our cluster,
    and added a property to the hive hive-site.xml file:

    hive.aux.jars.path
    file:///usr/lib/hive/auxlib/SA_UDF.jar
    available for one and all

    we pushed this file out to all nodes, and then stopped/restarted hive.

    after all that, the query still can’t find teh jar file (or more exactly, a class
    defined in that jar file).

    what did i do wrong?
    (and is this documented anywhere?)

Viewing 6 replies - 1 through 6 (of 6 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #28609

    tedr
    Moderator

    Hi Andrew,

    Thanks for letting us know that you solved the problem and how you did it.

    Thanks,
    Ted.

    Collapse
    #28591

    Andrew Hume
    Participant

    after putting some debugging and being reminded of how moronic the java jar paths thing is,
    i decided to brute force it by adding
    HIVE_AUX_JARS_PATH=/usr/lib/hive/auxlib
    near the top of hive-config.sh.

    problem solved.

    Collapse
    #28496

    Andrew Hume
    Participant

    the hive query works; its just the JDBC query that doesn’t find it.

    Collapse
    #28495

    Seth Lyubich
    Keymaster

    Hi Andrew,

    I think you can try few things:

    1. From Hive shell add your jar with command ‘add jar /path/to/jar’.
    2. Run Hive command specifying aux jar with something like below:
    hive –auxpath /path-to-/hive-examples.jar

    Hope this helps,

    Thanks,
    Seth

    Collapse
    #28481

    Andrew Hume
    Participant

    bollocks! i don’t know how to escap teh xml so i’ll set off teh field names

    name=hive.aux.jars.path
    value=file:///usr/lib/hive/auxlib/SA_UDF.jar
    description=available for one and all

    Collapse
    #28480

    Andrew Hume
    Participant

    somehow the wrteched editor corrupted teh property.
    here it is again:

    hive.aux.jars.path
    file:///usr/lib/hive/auxlib/SA_UDF.jar
    available for one and all

    Collapse
Viewing 6 replies - 1 through 6 (of 6 total)