Hive / HCatalog Forum

Hive Metastore and HiveServer2 Faild to start

  • #46189
    Chia-Hao Chang
    Participant

    Hi,
    Just install a new cluster(HDP 2.0.6.0) via ambari.
    Encountered Hive Metastore and HiveServer2 Faild problem.
    It always show me the following error message, even I use the new configuration property!
    =======================================================================
    CRITICAL: Error accessing Hive Metastore status [13/12/27 15:20:45 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive

    Seems no solution or workaround to fix this problem.
    By the way, in Hortonworks’ official website, the latest version of HDP shows in http://docs.hortonworks.com/ is 2.0.8.0, why the version when using ambari
    to install HDP 2, the version still in 2.0.6.0 ?

    Thanks in advance.

    James

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #46300
    Yi Zhang
    Moderator

    Hi James,

    The 2.0.6 is the latest stable release version.

    The message
    13/12/27 15:20:45 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive

    is of INFO level, annoying but innocuous. It means a property name needs to be updated in the newer version of hadoop.

    Is hive service shown up running in Ambari? The alert from above message does not necessarily mean the service is down (meaning hive metastore and hiveserver2 not up running). If you check the processes on the host, are their hive processes running?

    Thanks,
    Yi

    #46770
    Chia-Hao Chang
    Participant

    Hi Yi,
    Thanks for your kindly reply the information. In Ambari, the status of Hive service show me as the following:
    ========================================================================
    Hive Metastore Stopped
    HiveServer2 Stopped
    MySQL Server Started
    Hive Clients 2 Hive Clients Installed
    ========================================================================
    And, Alerts and Health Checks in Ambari Hive service show me the following mwssages:
    ===========================================
    Hive Metastore status
    CRIT for 21 days
    CRITICAL: Error accessing Hive Metastore status [14/01/15 18:19:44 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive

    Also, I try to create a database by using Hive shell, it show me the following error messages:
    ========================================================================
    # hive
    14/01/15 18:16:00 INFO Configuration.deprecation: mapred.input.dir.recursive is deprecated. Instead, use mapreduce.input.fileinputformat.input.dir.recursive
    14/01/15 18:16:00 INFO Configuration.deprecation: mapred.max.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.maxsize
    14/01/15 18:16:00 INFO Configuration.deprecation: mapred.min.split.size is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize
    14/01/15 18:16:00 INFO Configuration.deprecation: mapred.min.split.size.per.rack is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.rack
    14/01/15 18:16:00 INFO Configuration.deprecation: mapred.min.split.size.per.node is deprecated. Instead, use mapreduce.input.fileinputformat.split.minsize.per.node
    14/01/15 18:16:00 INFO Configuration.deprecation: mapred.reduce.tasks is deprecated. Instead, use mapreduce.job.reduces
    14/01/15 18:16:00 INFO Configuration.deprecation: mapred.reduce.tasks.speculative.execution is deprecated. Instead, use mapreduce.reduce.speculative

    Logging initialized using configuration in jar:file:/usr/lib/hive/lib/hive-common-0.12.0.2.0.6.0-76.jar!/hive-log4j.properties
    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:file:/usr/lib/hadoop/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/usr/lib/hive/lib/slf4j-log4j12-1.7.5.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
    hive> CREATE DATABASE testhive;
    FAILED: Execution Error, return code 1 from org.apache.hadoop.hive.ql.exec.DDLTask. java.lang.RuntimeException: Unable to instantiate org.apache.hadoop.hive.metastore.HiveMetaStoreClient
    hive>
    ========================================================================

    Anything I can do to solve this problem?

    Thanks in advance.
    James Chang

    #46800
    Yi Zhang
    Moderator

    Hi James,

    That does indicate hive metastore may not be running. Can you post /var/log/hive/hive.log on the hive metastore server to see any error messages?

    Thanks,
    Yi

    #46861
    Chia-Hao Chang
    Participant

    Hi Yi,
    Following are the messages in Hive Server log
    # cat hive.log
    Error creating temp dir in hadoop.tmp.dir /tmp/hadoop-hive due to Permission denied

    #cat hive-server2.log
    Error creating temp dir in hadoop.tmp.dir /tmp/hadoop-hive due to Permission denied

    Best Regards,
    James Chang

    #50312
    Srinivas Nadella
    Participant

    We also ran into same issue today. We were trying to install 2.0.6 version. Was there any resolution for this issue?

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.