Home Forums HBase HBase Error – This server is in the failed servers list

Tagged: 

This topic contains 2 replies, has 3 voices, and was last updated by  Xiandong Su 4 months, 2 weeks ago.

  • Creator
    Topic
  • #40574

    Hi,
    I am using Hortonworks HDP 2.1 beta with CentOS RHEL 6.2 and trying to run a simple HBase Java program.
    By JPS command all the services are running fine.
    [root@localhost ~]# jps
    28508 HRegionServer
    2423 SecondaryNameNode
    3389 NodeManager
    3570 JobHistoryServer
    32362 Jps
    2328 NameNode
    18379 QuorumPeerMain
    2671 DataNode
    4219 org.eclipse.equinox.launcher_1.2.0.v20110502.jar
    28379 HMaster
    3138 ResourceManager

    Below is the java program.
    public static void main(String[] args) {
    // TODO Auto-generated method stub
    Configuration conf = HBaseConfiguration.create();
    try {
    HBaseAdmin hbase = new HBaseAdmin(conf);
    boolean flag = hbase.isMasterRunning();
    System.out.print(“ok”);
    } catch (Exception e) {
    // TODO Auto-generated catch block
    e.printStackTrace();
    }
    Once I run the program it is showing below output.
    13/10/10 11:17:15 INFO zookeeper.ZooKeeper: Initiating client connection, connectString=127.0.0.1:2181 sessionTimeout=60000 watcher=hconnection-0x6564dbd5
    13/10/10 11:17:15 INFO zookeeper.RecoverableZooKeeper: Process identifier=hconnection-0x6564dbd5 connecting to ZooKeeper ensemble=127.0.0.1:2181
    13/10/10 11:17:15 INFO zookeeper.ClientCnxn: Opening socket connection to server localhost.localdomain/127.0.0.1:2181. Will not attempt to authenticate using SASL (unknown error)
    13/10/10 11:17:15 INFO zookeeper.ClientCnxn: Socket connection established to localhost.localdomain/127.0.0.1:2181, initiating session
    13/10/10 11:17:15 INFO zookeeper.ClientCnxn: Session establishment complete on server localhost.localdomain/127.0.0.1:2181, sessionid = 0x141a029bd47004e, negotiated timeout = 40000
    13/10/10 11:17:16 INFO client.HConnectionManager$HConnectionImplementation: getMaster attempt 1 of 35 failed; retrying after sleep of 100, exception=com.google.protobuf.ServiceException: java.io.IOException: Could not set up IO Streams
    13/10/10 11:17:16 INFO client.HConnectionManager$HConnectionImplementation: getMaster attempt 2 of 35 failed; retrying after sleep of 200, exception=com.google.protobuf.ServiceException: org.apache.hadoop.hbase.ipc.RpcClient$FailedServerException: This server is in the failed servers list: localhost.localdomain/127.0.0.1:60000
    Here is the HBase-site.xml

    hbase.rootdir
    hdfs://127.0.0.1:8020/apps/hbase

    hbase.master.info.bindAddress
    127.0.0.1

    hbase.zookeeper.quorum
    127.0.0.1

    hbase.cluster.distributed
    true

    Here is the /etc/hosts file
    127.0.0.1 localhost.localdomain localhost

    Please let me know why the error is happening.
    Thanks,
    Aparna

Viewing 2 replies - 1 through 2 (of 2 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #44835

    Xiandong Su
    Member

    I am having the exact same issue. I executed the egrep command Rahman mentioned. However I could not determine the result based on the print outs. The result did mention that tcp between sandbox.hortonworks.c:60000 and sandbox.hortonworks.c:40993 established. Running the command to find out HBase master address seems failed with SLF4j print out (class path contains multiple SLF4j bindings).

    I am using Hortonworks Sandbox 2.0

    Thanks

    Sean

    Collapse
    #41322

    abdelrahman
    Moderator

    Hi Aparna,

    Let us validate if the HBase Master is up and running. From command line, please run:
    netstat -all | egrep “6000|60010″

    The HBase master address is stored in Zookeeper instance. It should match the same address as above. To find out the HBase master address from command line, please run:

    # hbase org.jruby.Main /usr/lib/hbase/bin/get-active-master.rb

    Thanks
    -Rahman

    Collapse
Viewing 2 replies - 1 through 2 (of 2 total)