Home Forums Hive / HCatalog Hive0.13 (windows) Inner Join fails with NumberFormatException

Tagged: ,

This topic contains 4 replies, has 3 voices, and was last updated by  Harish Bansal 3 months, 3 weeks ago.

  • Creator
    Topic
  • #58219

    Harish Bansal
    Participant

    I am trying a simple inner join on two tables and it always throws same error
    ERROR ql.Driver (SessionState.java:printError(546)) – FAILED: NumberFormatException For input string: “10.00”
    Table_1
    Id Name
    1 A
    2 B
    3 C
    4 D

    Table_2
    Id Name
    1 X
    2 Y
    3 Z

    Query:Select Table_1.Name, Table_2.Name from Table_1 Inner Join Table_2 on Table_1.Id=Table_2.Id.

    Error thrown is :
    ERROR ql.Driver (SessionState.java:printError(546)) – FAILED: NumberFormatException For input string: “10.00”
    java.lang.NumberFormatException: For input string: “10.00”
    at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
    at java.lang.Long.parseLong(Long.java:441)
    at java.lang.Long.parseLong(Long.java:483)
    at org.apache.hadoop.conf.Configuration.getLong(Configuration.java:1147)
    at org.apache.hadoop.hive.conf.HiveConf.getLongVar(HiveConf.java:1248)
    at org.apache.hadoop.hive.conf.HiveConf.getLongVar(HiveConf.java:1261)
    at org.apache.hadoop.hive.ql.optimizer.ConvertJoinMapJoin.mapJoinConversionPos(ConvertJoinMapJoin.java:263)
    at org.apache.hadoop.hive.ql.optimizer.ConvertJoinMapJoin.process(ConvertJoinMapJoin.java:107)
    at org.apache.hadoop.hive.ql.lib.DefaultRuleDispatcher.dispatch(DefaultRuleDispatcher.java:90)
    at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatchAndReturn(DefaultGraphWalker.java:94)
    at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.dispatch(DefaultGraphWalker.java:78)
    at org.apache.hadoop.hive.ql.lib.ForwardWalker.walk(ForwardWalker.java:61)
    at org.apache.hadoop.hive.ql.lib.DefaultGraphWalker.startWalking(DefaultGraphWalker.java:109)
    at org.apache.hadoop.hive.ql.parse.TezCompiler.optimizeOperatorPlan(TezCompiler.java:123)
    at org.apache.hadoop.hive.ql.parse.TaskCompiler.compile(TaskCompiler.java:97)
    at org.apache.hadoop.hive.ql.parse.SemanticAnalyzer.analyzeInternal(SemanticAnalyzer.java:9429)
    at org.apache.hadoop.hive.ql.parse.BaseSemanticAnalyzer.analyze(BaseSemanticAnalyzer.java:327)
    at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:426)
    at org.apache.hadoop.hive.ql.Driver.compile(Driver.java:322)
    at org.apache.hadoop.hive.ql.Driver.compileInternal(Driver.java:976)
    at org.apache.hadoop.hive.ql.Driver.runInternal(Driver.java:1041)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:912)
    at org.apache.hadoop.hive.ql.Driver.run(Driver.java:902)
    at org.apache.hadoop.hive.cli.CliDriver.processLocalCmd(CliDriver.java:268)
    at org.apache.hadoop.hive.cli.CliDriver.processCmd(CliDriver.java:220)
    at org.apache.hadoop.hive.cli.CliDriver.processLine(CliDriver.java:423)
    at org.apache.hadoop.hive.cli.CliDriver.executeDriver(CliDriver.java:793)
    at org.apache.hadoop.hive.cli.CliDriver.run(CliDriver.java:686)
    at org.apache.hadoop.hive.cli.CliDriver.main(CliDriver.java:625)
    at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
    at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:57)
    at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)

Viewing 4 replies - 1 through 4 (of 4 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #58253

    Harish Bansal
    Participant

    Thanks Carter and Jason, It worked.

    Collapse
    #58234

    Jason Dere
    Participant

    As Carter mentions, it looks like an issue parsing the Hive configuration. Looking at the stack trace it appears to be for configuration value hive.auto.convert.join.noconditionaltask.size. Is that set to 10.00? If so try setting to a integer value.

    Collapse
    #58233

    Carter Shanklin
    Participant

    The traceback looks like a parse time error, not a runtime error. Can you look in your hive-site.xml and see if the string “10” appears somewhere there? Or can you paste your entire hive-site.xml? I suspect there is something in your config confusing Hive.

    Collapse
    #58220

    Harish Bansal
    Participant

    Further information on this is: Id column in both tables in integer. I actually tried this query on a bigger table, when it failed on actual table, I tried it on sample table and it throws same error NumberFormatException For input string: “10.00″ even when none of the tables have id=10.

    Collapse
Viewing 4 replies - 1 through 4 (of 4 total)