HDP on Windows – Installation Forum

Cluster not Starting

  • #20540

    When I start HDInsigh Dashboard I get the message “Waiting for your cluster to start up!” and hangs. Apache Hadoop namenode Service is stopped and in the log I get following message

    2013-04-05 12:20:38,034 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 3740 loaded in 0 seconds.
    2013-04-05 12:20:38,034 ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed.
    java.io.IOException: Incorrect data format. logVersion is -32 but writables.length is 0.
    at org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:579)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:1021)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:839)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:377)
    at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:389)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:363)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:496)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1278)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1287)
    2013-04-05 12:20:38,034 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException: Incorrect data format. logVersion is -32 but writables.length is 0.
    at org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:579)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:1021)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:839)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:377)
    at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:389)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:363)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:496)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1278)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1287)

    2013-04-05 12:20:38,034 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at AD-DEV1/10…
    ************************************************************/

to create new topics or reply. | New User Registration

  • Author
    Replies
  • #20573
    Seth Lyubich
    Moderator

    Hi SUNDARARAJ ,

    For HDInsight issues please refer to HDInsight forum found here:
    http://social.msdn.microsoft.com/Forums/pl-PL/hdinsight/threads

    Hope this helps,

    Thanks,
    Seth

    #20576

    I tried to start the cluster from command prompt but getting same error.

    2013-04-05 12:20:38,034 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 3740 loaded in 0 seconds.
    2013-04-05 12:20:38,034 ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed.
    java.io.IOException: Incorrect data format. logVersion is -32 but writables.length is 0.
    at org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:579)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:1021)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:839)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:377)
    at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:389)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:363)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:496)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1278)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1287)
    2013-04-05 12:20:38,034 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException: Incorrect data format. logVersion is -32 but writables.length is 0.
    at org.apache.hadoop.hdfs.server.namenode.FSEditLog.loadFSEdits(FSEditLog.java:579)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSEdits(FSImage.java:1021)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.loadFSImage(FSImage.java:839)
    at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:377)
    at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:100)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:389)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:363)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:496)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1278)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1287)

    2013-04-05 12:20:38,034 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at AD-DEV1/10…
    ************************************************************/

    #20625
    tedr
    Moderator

    Hi Sundararaj,

    Is this an HDinsights cluster? or and HDP on windows cluster? if the former you really need to go to the link that Seth gave in his post.

    Thanks,
    Ted.

You must be to reply to this topic. | Create Account

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.