HDP on Windows – Installation Forum

1.3>2 upgrade – my Hive is empty :-(

  • #47644
    Toby Evans
    Participant

    Hi there guys,

    I’ve clubbed my single-node practice server from 1.3 to 2.0, but the tables have dropped out of hive. I’m sure this is to do with the Derby datastore, is there any easy way of recovering this?

    thanks

    Toby

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #47667
    Toby Evans
    Participant

    buzzzzzz

    I feel ridiculous posting this as answer. I just copied in my old metastore from Hdp1.3, eg
    C:\hdp\hadoop13\hive-0.11.0.1.3.0.0-0380\bin\metastore_db

    I copied the metastore_db folder to my new Hive: C:\hdp\hadoop\hive-0.12.0.2.0.6.0-0009\bin\metastore_db

    there were an anxious few minutes of failing to connect to the metastore, until I remembered to restart all the services. Then my old Hive returned! Colony Collapse no more …

    #47679
    Rohit Bakhshi
    Moderator

    Hi Toby,

    To upgrade the Hive metastore and keep the metadata, you need to have your Hive metastore database in SQL Server. In our documentation, we guide you through how to upgrade Hive table metadata stored in SQL Server.

    #47681
    Toby Evans
    Participant

    Hi Rohit,

    I had a Derby metastore – in the upgrade documentation, it says:
    http://docs.hortonworks.com/HDPDocuments/HDP2/HDP-2.0.6.0-Win/bk_installing_hdp_for_windows/content/ch_win-upgrade-6.html
    [Note] Note
    If you used the Derby database option, you can skip this section.

    however, if you do, when you finally get Hive 0.12 buzzing, then the metastore is empty!

    it’s probably a better idea to use SQL Server or mySQL, but that’s how I got it working with Derby …

    #47758
    Rohit Bakhshi
    Moderator

    Hey Toby,

    Thanks for the info. So you got the same Derby to work by copying the metastore_db from HDP 1.3 to the relevant location in HDP 2.0 install, and you were able to utilize the same tables with HDP 2.0?

    #48142
    Toby Evans
    Participant

    Hi Rohit,

    sorry for the delay. Yeah, I just copied the Derby metastore_db folder between the Hive installations. That was it!

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.