1.3>2 upgrade – my Hive is empty :-(

to create new topics or reply. | New User Registration

This topic contains 5 replies, has 2 voices, and was last updated by  Toby Evans 1 year, 3 months ago.

  • Creator
    Topic
  • #47644

    Toby Evans
    Participant

    Hi there guys,

    I’ve clubbed my single-node practice server from 1.3 to 2.0, but the tables have dropped out of hive. I’m sure this is to do with the Derby datastore, is there any easy way of recovering this?

    thanks

    Toby

Viewing 5 replies - 1 through 5 (of 5 total)

You must be to reply to this topic. | Create Account

  • Author
    Replies
  • #48142

    Toby Evans
    Participant

    Hi Rohit,

    sorry for the delay. Yeah, I just copied the Derby metastore_db folder between the Hive installations. That was it!

    Collapse
    #47758

    Rohit Bakhshi
    Moderator

    Hey Toby,

    Thanks for the info. So you got the same Derby to work by copying the metastore_db from HDP 1.3 to the relevant location in HDP 2.0 install, and you were able to utilize the same tables with HDP 2.0?

    Collapse
    #47681

    Toby Evans
    Participant

    Hi Rohit,

    I had a Derby metastore – in the upgrade documentation, it says:
    http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0-Win/bk_installing_hdp_for_windows/content/ch_win-upgrade-6.html
    [Note] Note
    If you used the Derby database option, you can skip this section.

    however, if you do, when you finally get Hive 0.12 buzzing, then the metastore is empty!

    it’s probably a better idea to use SQL Server or mySQL, but that’s how I got it working with Derby …

    Collapse
    #47679

    Rohit Bakhshi
    Moderator

    Hi Toby,

    To upgrade the Hive metastore and keep the metadata, you need to have your Hive metastore database in SQL Server. In our documentation, we guide you through how to upgrade Hive table metadata stored in SQL Server.

    Collapse
    #47667

    Toby Evans
    Participant

    buzzzzzz

    I feel ridiculous posting this as answer. I just copied in my old metastore from Hdp1.3, eg
    C:\hdp\hadoop13\hive-0.11.0.1.3.0.0-0380\bin\metastore_db

    I copied the metastore_db folder to my new Hive: C:\hdp\hadoop\hive-0.12.0.2.0.6.0-0009\bin\metastore_db

    there were an anxious few minutes of failing to connect to the metastore, until I remembered to restart all the services. Then my old Hive returned! Colony Collapse no more …

    Collapse
Viewing 5 replies - 1 through 5 (of 5 total)
Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.