The Hortonworks Community Connection is now live. A completely rebuilt Q&A forum, Knowledge Base, Code Hub and more, backed by the experts in the industry.

You will be redirected here in 10 seconds. If your are not redirected, click here to visit the new site.

The legacy Hortonworks Forum is now closed. You can view a read-only version of the former site by clicking here. The site will be taken offline on January 31,2016

HDP on Linux – Installation Forum

cluster install

  • #8475
    Ben Cuthbert
    Member

    I have two nodes that I want to test the cluster install out on. When running the install the second node gives me a puppet timeout kick when trying to install HDFS. Both machines have DNS entires in our DNS server and resolve. I am able to ssh without password from the master HMC machine to the secondary machine. Do I need to start something on the secondary machine to get it up and running?

  • Author
    Replies
  • #8476
    Ben Cuthbert
    Member

    I did notice this in the hadoop logs. Seems the namenode is not being formatted.

    2012-08-20 08:47:07,499 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
    /************************************************************
    STARTUP_MSG: Starting NameNode
    STARTUP_MSG: host = ct-eu-db1.eu.celer-tech.com/144.10.1.6
    STARTUP_MSG: args = []
    STARTUP_MSG: version = 1.0.3.14
    STARTUP_MSG: build = -r ; compiled by ‘jenkins’ on Fri Jul 27 04:33:56 PDT 2012
    ************************************************************/
    2012-08-20 08:47:07,717 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
    2012-08-20 08:47:07,735 INFO org.apache.hadoop.metrics2.impl.MetricsSinkAdapter: Sink ganglia started
    2012-08-20 08:47:07,793 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
    2012-08-20 08:47:07,793 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
    2012-08-20 08:47:07,793 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system started
    2012-08-20 08:47:08,006 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered.
    2012-08-20 08:47:08,080 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm registered.
    2012-08-20 08:47:08,080 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source NameNode registered.
    2012-08-20 08:47:08,098 INFO org.apache.hadoop.hdfs.util.GSet: VM type = 64-bit
    2012-08-20 08:47:08,098 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory = 4.89625 MB
    2012-08-20 08:47:08,098 INFO org.apache.hadoop.hdfs.util.GSet: capacity = 2^19 = 524288 entries
    2012-08-20 08:47:08,098 INFO org.apache.hadoop.hdfs.util.GSet: recommended=524288, actual=524288
    2012-08-20 08:47:08,110 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=hdfs
    2012-08-20 08:47:08,110 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=hdfs
    2012-08-20 08:47:08,110 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled=true
    2012-08-20 08:47:08,114 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.block.invalidate.limit=100
    2012-08-20 08:47:08,114 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isAccessTokenEnabled=true accessKeyUpdateInterval=600 min(s), accessTokenLifetime=600 min(s)
    2012-08-20 08:47:08,537 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemStateMBean and NameNodeMXBean
    2012-08-20 08:47:08,551 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: dfs.namenode.edits.toleration.length = -1
    2012-08-20 08:47:08,551 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
    2012-08-20 08:47:08,565 INFO org.apache.hadoop.hdfs.server.common.Storage: Number of files = 1
    2012-08-20 08:47:08,568 INFO org.apache.hadoop.hdfs.server.common.Storage: Number of files under construction = 0
    2012-08-20 08:47:08,568 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 104 loaded in 0 seconds.
    2012-08-20 08:47:08,568 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Reading /data/celertech/hadoop/hdfs/namenode/current/edits: java.io.EOFException
    2012-08-20 08:47:08,568 INFO org.apache.hadoop.hdfs.server.common.Storage: Edits file /data/celertech/hadoop/hdfs/namenode/current/edits of size 4 edits # 0 loaded in 0 seconds.
    2012-08-20 08:47:08,569 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 104 saved in 0 seconds.
    2012-08-20 08:47:08,638 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: closing edit log: position=4, editlog=/data/celertech/hadoop/hdfs/namenode/current/edits
    2012-08-20 08:47:08,639 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: close success: truncate to 4, editlog=/data/celertech/hadoop/hdfs/namenode/current/edits
    2012-08-20 08:47:08,660 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 104 saved in 0 seconds.
    2012-08-20 08:47:08,683 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: closing edit log: position=4, editlog=/data/celertech/hadoop/hdfs/namenode/current/edits
    2012-08-20 08:47:08,683 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: close success: truncate to 4, editlog=/data/celertech/hadoop/hdfs/namenode/current/edits
    2012-08-20 08:47:08,687 INFO org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries 0 lookups
    2012-08-20 08:47:08,687 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading FSImage in 582 msecs
    2012-08-20 08:47:08,692 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Total number of blocks = 0
    2012-08-20 08:47:08,692 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of invalid blocks = 0
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of under-replicated blocks = 0
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of over-replicated blocks = 0
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode termination scan for invalid, over- and under-replicated blocks completed in 5 msec
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.StateChange: STATE* Leaving safe mode after 0 secs.
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.StateChange: STATE* Network topology has 0 racks and 0 datanodes
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.StateChange: STATE* UnderReplicatedBlocks has 0 blocks
    2012-08-20 08:47:08,852 INFO org.apache.hadoop.hdfs.security.token.block.BlockTokenSecretManager: Updating block keys
    2012-08-20 08:47:08,939 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list
    2012-08-20 08:47:08,940 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 1 msec
    2012-08-20 08:47:08,940 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 1 msec processing time, 1 msec clock time, 1 cycles
    2012-08-20 08:47:08,940 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
    2012-08-20 08:47:08,940 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
    2012-08-20 08:47:08,942 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source FSNamesystemMetrics registered.
    2012-08-20 08:47:09,441 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,444 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,445 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,445 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,448 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,459 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source RpcDetailedActivityForPort8020 registered.
    2012-08-20 08:47:09,459 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source RpcActivityForPort8020 registered.
    2012-08-20 08:47:09,460 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Namenode up at: ct-eu-db1.eu.celer-tech.com/144.10.1.6:8020
    2012-08-20 08:47:09,805 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
    2012-08-20 08:47:09,848 INFO org.apache.hadoop.http.HttpServer: Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
    2012-08-20 08:47:09,857 INFO org.apache.hadoop.http.HttpServer: dfs.webhdfs.enabled = false
    2012-08-20 08:47:09,872 INFO org.apache.hadoop.http.HttpServer: Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 50070
    2012-08-20 08:47:09,873 INFO org.apache.hadoop.http.HttpServer: listener.getLocalPort() returned 50070 webServer.getConnectors()[0].getLocalPort() returned 50070
    2012-08-20 08:47:09,873 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 50070
    2012-08-20 08:47:09,873 INFO org.mortbay.log: jetty-6.1.26
    2012-08-20 08:47:10,240 INFO org.mortbay.log: Started SelectChannelConnector@ct-eu-db1.eu.celer-tech.com:50070
    2012-08-20 08:47:10,241 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Web-server up at: ct-eu-db1.eu.celer-tech.com:50070
    2012-08-20 08:47:10,241 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
    2012-08-20 08:47:10,241 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8020: starting
    2012-08-20 08:47:10,246 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 8020: starting
    2012-08-20 08:47:10,257 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 8020: starting
    2012-08-20 08:47:10,258 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 8020: starting
    2012-08-20 08:47:10,262 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 10 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 11 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 12 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 13 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 14 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 15 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 16 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 17 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 19 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 20 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 21 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 22 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 23 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 24 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 25 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 26 on 8020: starting
    2012-08-20 08:47:10,266 INFO org.apache.hadoop.ipc.Server: IPC Server handler 27 on 8020: starting
    2012-08-20 08:47:10,266 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 8020: starting
    2012-08-20 08:47:10,292 INFO org.apache.hadoop.ipc.Server: IPC Server handler 29 on 8020: starting
    2012-08-20 08:47:10,298 INFO org.apache.hadoop.ipc.Server: IPC Server handler 98 on 8020: starting
    2012-08-20 08:47:10,298 INFO org.apache.hadoop.ipc.Server: IPC Server handler 99 on 8020: starting
    2012-08-20 08:47:10,298 INFO org.apache.hadoop.ipc.Server: IPC Server handler 97 on 8020: starting
    2012-08-20 08:47:10,300 INFO org.apache.hadoop.ipc.Server: IPC Server handler 96 on 8020: starting
    2012-08-20 08:47:10,300 INFO org.apache.hadoop.ipc.Server: IPC Server handler 95 on 8020: starting
    2012-08-20 08:47:10,300 INFO org.apache.hadoop.ipc.Server: IPC Server handler 94 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 53 on 8020: starting
    2012-08-20 08:47:10,312 INFO org.apache.hadoop.ipc.Server: IPC Server handler 52 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 54 on 8020: starting
    2012-08-20 08:47:10,312 INFO org.apache.hadoop.ipc.Server: IPC Server handler 51 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 55 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 50 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 56 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 49 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 57 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 48 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 58 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 47 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 59 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 46 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 60 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 45 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 61 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 44 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 62 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 43 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 63 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 42 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 64 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 41 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 65 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 40 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 66 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 39 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 67 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 38 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 68 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 37 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 69 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 36 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 70 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 35 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 71 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 34 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 72 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 33 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 73 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 32 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 74 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 31 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 75 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 30 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 76 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 77 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 93 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 78 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 79 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 80 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 81 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 82 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 83 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 84 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 85 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 86 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 87 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 88 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 89 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 90 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 91 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 92 on 8020: starting
    2012-08-20 09:31:13,280 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at ct-eu-db1.eu.celer-tech.com/144.10.1.6
    ************************************************************/
    2012-08-20 09:37:49,918 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
    /************************************************************
    STARTUP_MSG: Starting NameNode
    STARTUP_MSG: host = ct-eu-db1.eu.celer-tech.com/144.10.1.6
    STARTUP_MSG: args = []
    STARTUP_MSG: version = 1.0.3.14
    STARTUP_MSG: build = -r ; compiled by ‘jenkins’ on Fri Jul 27 04:33:56 PDT 2012
    ************************************************************/
    2012-08-20 09:37:50,562 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
    2012-08-20 09:37:50,600 INFO org.apache.hadoop.metrics2.impl.MetricsSinkAdapter: Sink ganglia started
    2012-08-20 09:37:50,722 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
    2012-08-20 09:37:50,724 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
    2012-08-20 09:37:50,724 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system started
    2012-08-20 09:37:51,083 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered.
    2012-08-20 09:37:51,098 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm registered.
    2012-08-20 09:37:51,098 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source NameNode registered.
    2012-08-20 09:37:51,141 INFO org.apache.hadoop.hdfs.util.GSet: VM type = 64-bit
    2012-08-20 09:37:51,141 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory = 4.60875 MB
    2012-08-20 09:37:51,141 INFO org.apache.hadoop.hdfs.util.GSet: capacity = 2^19 = 524288 entries
    2012-08-20 09:37:51,141 INFO org.apache.hadoop.hdfs.util.GSet: recommended=524288, actual=524288
    2012-08-20 09:37:51,183 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=hdfs
    2012-08-20 09:37:51,183 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=hdfs
    2012-08-20 09:37:51,183 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled=true
    2012-08-20 09:37:51,187 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.block.invalidate.limit=100
    2012-08-20 09:37:51,187 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isAccessTokenEnabled=true accessKeyUpdateInterval=600 min(s), accessTokenLifetime=600 min(s)
    2012-08-20 09:37:51,702 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemStateMBean and NameNodeMXBean
    2012-08-20 09:37:51,717 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: dfs.namenode.edits.toleration.length = -1
    2012-08-20 09:37:51,717 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
    2012-08-20 09:37:51,749 ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed.
    java.io.IOException: NameNode is not formatted.
    at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:331)
    at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:104)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:362)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:473)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1256)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1265)
    2012-08-20 09:37:51,750 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException: NameNode is not formatted.
    at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:331)
    at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:104)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:362)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:473)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1256)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1265)

    2012-08-20 09:37:51,750 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at ct-eu-db1.eu.celer-tech.com/144.10.1.6
    ************************************************************/
    2012-08-20 10:03:03,453 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
    /************************************************************

    #8480
    Sasha J
    Moderator

    Hi Ben,

    please refer to this post and let us know if that does not fix your issue:

    puppet kick timeout

    #8498
    Ben Cuthbert
    Member

    hi Sasha had to reinstall the entire machine. I have given up on installing a cluster setup as it does not seem to work. So I have gone back to a single node installation to test HDP

The forum ‘HDP on Linux – Installation’ is closed to new topics and replies.

Support from the Experts

A HDP Support Subscription connects you experts with deep experience running Apache Hadoop in production, at-scale on the most demanding workloads.

Enterprise Support »

Become HDP Certified

Real world training designed by the core architects of Hadoop. Scenario-based training courses are available in-classroom or online from anywhere in the world

Training »

Hortonworks Data Platform
The Hortonworks Data Platform is a 100% open source distribution of Apache Hadoop that is truly enterprise grade having been built, tested and hardened with enterprise rigor.
Get started with Sandbox
Hortonworks Sandbox is a self-contained virtual machine with Apache Hadoop pre-configured alongside a set of hands-on, step-by-step Hadoop tutorials.
Modern Data Architecture
Tackle the challenges of big data. Hadoop integrates with existing EDW, RDBMS and MPP systems to deliver lower cost, higher capacity infrastructure.