Hive External Table Pointing to HBASE

to create new topics or reply. | New User Registration

This topic contains 2 replies, has 3 voices, and was last updated by  Yi Zhang 1 year, 3 months ago.

  • Creator
    Topic
  • #45118

    Zin Zin
    Participant

    I have a Hbase table called

    Client_Txn with column famlies
    Txn (Txn_no)
    Dt (Txn_dt)
    Txn_Type (Type)
    Cf1 (val1, val2)
    Cf2 (val3, val4)

    Can I create a Hive Table pointing to this structure

    I basically want to create the Hive Table that refers to this external table and bring in only

    Txn_no
    Txn_dt
    Txn_Type
    Cf1_Val (from Cf1:val1)
    Cf2_Val (from Cf2:val3)

    Is it possible ?

Viewing 2 replies - 1 through 2 (of 2 total)

You must be to reply to this topic. | Create Account

  • Author
    Replies
  • #46755

    Yi Zhang
    Moderator

    Hi Paulie,

    Yes, it is possible. The hbase.column.mapping allows you to map between hbase and hive, in your case, mapping a specific column family column to a hive column. https://cwiki.apache.org/confluence/display/Hive/HBaseIntegration
    Please note that you would need to put the hbase jars into hive client path.

    Thanks,
    Yi

    Collapse
    #46549
    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.