HBase Forum

Hbase zookeeper connection exception

  • #16990
    Kadir Sert

    When i’m trying to integrate nutch 2.1 with hbase in hortonworks 1.2.1 distribution, i’m getting connection exception. What can i do to resolve this problem?

    Zookeeper, version = 3.4.5
    HBase, version =
    Nutch, version = 2.1

    Nutch command output is here:
    # bin/nutch inject urls
    InjectorJob: starting
    InjectorJob: urlDir: urls
    InjectorJob: org.apache.gora.util.GoraException: org.apache.hadoop.hbase.ZooKeeperConnectionException: HBase is able to connect to ZooKeeper but the connection closes immediately. This could be a sign that the server has too many connections (30 is the default). Consider inspecting your ZK server logs for that error and then make sure you are reusing HBaseConfiguration as often as you can. See HTable’s javadoc for more information.
    at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:167)
    at org.apache.gora.store.DataStoreFactory.createDataStore(DataStoreFactory.java:135)
    at org.apache.nutch.storage.StorageUtils.createWebStore(StorageUtils.java:75)
    at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:214)
    at org.apache.nutch.crawl.InjectorJob.inject(InjectorJob.java:228)
    at org.apache.nutch.crawl.InjectorJob.run(InjectorJob.java:248)
    at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
    at org.apache.nutch.crawl.InjectorJob.main(InjectorJob.java:258)

    Zookeeper server logs contains warning:
    200 – WARN [NIOServerCxn.Factory:] – caught end of stream exception
    EndOfStreamException: Unable to read additional data from client sessionid 0x0, likely client has closed socket
    at org.apache.zookeeper.server.NIOServerCnxn.doIO(NIOServerCnxn.java:220)
    at org.apache.zookeeper.server.NIOServerCnxnFactory.run(NIOServerCnxnFactory.java:208)
    at java.lang.Thread.run(Thread.java:662)

to create new topics or reply. | New User Registration

  • Author
  • #16996

    Hi Kadir,

    Thanks for trying out Hortonworks Data Platform.

    Could you send us the complete log files? Follow the link in this post http://hortonworks.com/community/forums/topic/hmc-installation-support-help-us-help-you
    for instructions on how to get them to us.


    Kadir Sert

    the scripts you say in not working!

    # ./HMC-check.sh
    Error: unable to open database “/var/db/hmc/data/data.db”: unable to open database file
    Error: unable to open database “/var/db/hmc/data/data.db”: unable to open database file
    Error: unable to open database “/var/db/hmc/data/data.db”: unable to open database file
    Error: unable to open database “/var/db/hmc/data/data.db”: unable to open database file
    Error: unable to open database “/var/db/hmc/data/data.db”: unable to open database file
    grep: /var/log/hmc/hmc.log: No such file or directory
    Resulting file is: /tmp/…out
    Please, upload it to Hortonworks Support FTP site.

    and ambari-check.sh asking me password!

    Larry Liu

    Hi, Kadir,

    Thanks for trying HDP.

    HDP recommends increasing the maximum number of file handles to more than 10,000. Note that increasing the file handles for the user who is running the HBase process is an operating system configuration, not an HBase configuration.
    If you are using ulimit, you must make the following configuration changes:

    In the /etc/security/limits.conf file, add the following lines:
    hdfs – nofile 32768
    hbase – nofile 32768

    After the changes made, please restart zookeeper and hbase.

    Hope this helps resolve the issue


    Jason Wu

    Hi all: I also want to run Nutch on HDP. Do you have any tutorials for that?

    Sasha J

    NO, we do not have any tutorial on this.

    Stephen Dring

    Hi Kadir

    Did you ever get this to work?

    I’m going to have a go at getting nutch going and I wondered if you have any tips for me?


    Kadir Sert

    I did not get it to work. But It was over a year ago, though. As far as i remember, there was an incompatibility issue between nutch 2.X and gora libraries for hbase. Now Nutch uses gora 0.4 and the documentation says: “Gora 0.4 uses HBase 0.94.14 we therefore suggest you use this version if possible. If you decide to use another version of HBase please do not be surprised if the stack does not work”

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.