Home Forums HBase Datanode denied communication with namenode on localhost?

Tagged: 

This topic contains 1 reply, has 2 voices, and was last updated by  abdelrahman 6 months, 3 weeks ago.

  • Creator
    Topic
  • #36413

    Nancy Snyder
    Member

    I am using HBaseTestingUtility for testing on my localhost (Windows 7). This used to work but something has changed?

    configuration = new Configuration();
    hBaseTestingUtility = new HBaseTestingUtility(configuration);
    hBaseTestingUtility.getConfiguration()
    .setInt(HConstants.REGIONSERVER_PORT, getPreDefinedPortNumberOrMakeOne(HConstants.REGIONSERVER_PORT));
    hBaseTestingUtility.getConfiguration()
    .set(“hbase.regionserver.info.port”, “-1″);
    hBaseTestingUtility.getConfiguration()
    .set(“hbase.regionserver.info.bindAddress”, “127.0.0.1″);
    hBaseTestingUtility.getConfiguration()
    .set(“hbase.master.dns.interface”, “lo”);
    hBaseTestingUtility.getConfiguration()
    .set(“hbase.regionserver.dns.interface”, “lo”);
    hBaseTestingUtility.startMiniZKCluster();

    // defined the DFS cluster more explicitly (than accept the defaults)
    MiniDFSCluster miniDFSCluster = new MiniDFSCluster.Builder(configuration)
    .clusterId(“test-cluster-id”)
    .numDataNodes(1)
    .hosts(new String[]{“127.0.0.1″})
    .nameNodePort(getPreDefinedPortNumberOrMakeOne(“hdfs.namenode.port”))
    .nameNodeHttpPort(getPreDefinedPortNumberOrMakeOne(“hdfs.namenode.http.port”))
    .build();
    // start HDFS filesystem
    hBaseTestingUtility.setDFSCluster(miniDFSCluster);

    But it fails with this error:
    09-16 13:30:19 | FATAL | Initialization failed for block pool Block pool BP-1667223652-10.35.57.200-1379352600221 (storage id DS-1871975488-10.35.57.200-61528-1379352618227) service to 127.0.0.1/127.0.0.1:48142
    org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.server.protocol.DisallowedDatanodeException): Datanode denied communication with namenode: DatanodeRegistration(127.0.0.1, storageID=DS-1871975488-10.35.57.200-61528-1379352618227, infoPort=61529, ipcPort=61532, storageInfo=lv=-40;cid=testClusterID;nsid=797600457;c=0)

    Why is it denying access to my localhost? I heard it was a firewall problem, so in windows I allowed java communication thru but it still fails?

    I also edited my hosts files but everything I tried did not work.

    ANY SUGGESTIONS? This is just for simple testing on local host.

Viewing 1 replies (of 1 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #38244

    abdelrahman
    Moderator

    Hi Nancy,

    This is a HDP on Windows issue. Please post your question in the correct section. By the way, it is not recommended to bind to Localhost.

    http://hortonworks.com/community/forums/forum/hdp-for-windows/

    Thanks

    -Abdelrahman

    Collapse
Viewing 1 replies (of 1 total)