MapReduce Error when using HCatInputFormat process data

to create new topics or reply. | New User Registration


This topic contains 1 reply, has 2 voices, and was last updated by  abdelrahman 1 year, 10 months ago.

  • Creator
  • #28822

    Andy Miao

    HI guys,
    I tried to create map/reduce program to practice Hcatalog, I followed the guidence on Site.
    The Map/Reduce program just read data from HCatalog table and wirte to another one. But the simple program always raise error on following code snipt
    HCatInputFormat.setInput(job, InputJobInfo.create(DbName,InputTbName,null));

    Here is the dtailed Error Message:

    I have already package hive-exec.jar into my map/Reduce program.

    hadoop jar d:\hcat\HCatInterface.jar hcatalog.HCatInterfacePOC student studentg
    BTW, What i am using is HDP for windows.

Viewing 1 replies (of 1 total)

You must be to reply to this topic. | Create Account

  • Author
  • #28824


    Hi Andy,

    It is most likely because it can’t find some Hive jars. You may want to try to add the Hive jars into the CLASSPATH.


Viewing 1 replies (of 1 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.