Home Forums HDP on Linux – Installation cluster install

This topic contains 3 replies, has 2 voices, and was last updated by  Ben Cuthbert 2 years, 1 month ago.

  • Creator
    Topic
  • #8475

    Ben Cuthbert
    Member

    I have two nodes that I want to test the cluster install out on. When running the install the second node gives me a puppet timeout kick when trying to install HDFS. Both machines have DNS entires in our DNS server and resolve. I am able to ssh without password from the master HMC machine to the secondary machine. Do I need to start something on the secondary machine to get it up and running?

Viewing 3 replies - 1 through 3 (of 3 total)

You must be logged in to reply to this topic.

  • Author
    Replies
  • #8498

    Ben Cuthbert
    Member

    hi Sasha had to reinstall the entire machine. I have given up on installing a cluster setup as it does not seem to work. So I have gone back to a single node installation to test HDP

    Collapse
    #8480

    Sasha J
    Moderator

    Hi Ben,

    please refer to this post and let us know if that does not fix your issue:

    puppet kick timeout

    Collapse
    #8476

    Ben Cuthbert
    Member

    I did notice this in the hadoop logs. Seems the namenode is not being formatted.

    2012-08-20 08:47:07,499 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
    /************************************************************
    STARTUP_MSG: Starting NameNode
    STARTUP_MSG: host = ct-eu-db1.eu.celer-tech.com/144.10.1.6
    STARTUP_MSG: args = []
    STARTUP_MSG: version = 1.0.3.14
    STARTUP_MSG: build = -r ; compiled by ‘jenkins’ on Fri Jul 27 04:33:56 PDT 2012
    ************************************************************/
    2012-08-20 08:47:07,717 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
    2012-08-20 08:47:07,735 INFO org.apache.hadoop.metrics2.impl.MetricsSinkAdapter: Sink ganglia started
    2012-08-20 08:47:07,793 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
    2012-08-20 08:47:07,793 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
    2012-08-20 08:47:07,793 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system started
    2012-08-20 08:47:08,006 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered.
    2012-08-20 08:47:08,080 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm registered.
    2012-08-20 08:47:08,080 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source NameNode registered.
    2012-08-20 08:47:08,098 INFO org.apache.hadoop.hdfs.util.GSet: VM type = 64-bit
    2012-08-20 08:47:08,098 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory = 4.89625 MB
    2012-08-20 08:47:08,098 INFO org.apache.hadoop.hdfs.util.GSet: capacity = 2^19 = 524288 entries
    2012-08-20 08:47:08,098 INFO org.apache.hadoop.hdfs.util.GSet: recommended=524288, actual=524288
    2012-08-20 08:47:08,110 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=hdfs
    2012-08-20 08:47:08,110 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=hdfs
    2012-08-20 08:47:08,110 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled=true
    2012-08-20 08:47:08,114 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.block.invalidate.limit=100
    2012-08-20 08:47:08,114 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isAccessTokenEnabled=true accessKeyUpdateInterval=600 min(s), accessTokenLifetime=600 min(s)
    2012-08-20 08:47:08,537 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemStateMBean and NameNodeMXBean
    2012-08-20 08:47:08,551 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: dfs.namenode.edits.toleration.length = -1
    2012-08-20 08:47:08,551 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
    2012-08-20 08:47:08,565 INFO org.apache.hadoop.hdfs.server.common.Storage: Number of files = 1
    2012-08-20 08:47:08,568 INFO org.apache.hadoop.hdfs.server.common.Storage: Number of files under construction = 0
    2012-08-20 08:47:08,568 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 104 loaded in 0 seconds.
    2012-08-20 08:47:08,568 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: Reading /data/celertech/hadoop/hdfs/namenode/current/edits: java.io.EOFException
    2012-08-20 08:47:08,568 INFO org.apache.hadoop.hdfs.server.common.Storage: Edits file /data/celertech/hadoop/hdfs/namenode/current/edits of size 4 edits # 0 loaded in 0 seconds.
    2012-08-20 08:47:08,569 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 104 saved in 0 seconds.
    2012-08-20 08:47:08,638 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: closing edit log: position=4, editlog=/data/celertech/hadoop/hdfs/namenode/current/edits
    2012-08-20 08:47:08,639 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: close success: truncate to 4, editlog=/data/celertech/hadoop/hdfs/namenode/current/edits
    2012-08-20 08:47:08,660 INFO org.apache.hadoop.hdfs.server.common.Storage: Image file of size 104 saved in 0 seconds.
    2012-08-20 08:47:08,683 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: closing edit log: position=4, editlog=/data/celertech/hadoop/hdfs/namenode/current/edits
    2012-08-20 08:47:08,683 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: close success: truncate to 4, editlog=/data/celertech/hadoop/hdfs/namenode/current/edits
    2012-08-20 08:47:08,687 INFO org.apache.hadoop.hdfs.server.namenode.NameCache: initialized with 0 entries 0 lookups
    2012-08-20 08:47:08,687 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Finished loading FSImage in 582 msecs
    2012-08-20 08:47:08,692 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Total number of blocks = 0
    2012-08-20 08:47:08,692 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of invalid blocks = 0
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of under-replicated blocks = 0
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Number of over-replicated blocks = 0
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.StateChange: STATE* Safe mode termination scan for invalid, over- and under-replicated blocks completed in 5 msec
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.StateChange: STATE* Leaving safe mode after 0 secs.
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.StateChange: STATE* Network topology has 0 racks and 0 datanodes
    2012-08-20 08:47:08,693 INFO org.apache.hadoop.hdfs.StateChange: STATE* UnderReplicatedBlocks has 0 blocks
    2012-08-20 08:47:08,852 INFO org.apache.hadoop.hdfs.security.token.block.BlockTokenSecretManager: Updating block keys
    2012-08-20 08:47:08,939 INFO org.apache.hadoop.util.HostsFileReader: Refreshing hosts (include/exclude) list
    2012-08-20 08:47:08,940 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 1 msec
    2012-08-20 08:47:08,940 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: ReplicateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 1 msec processing time, 1 msec clock time, 1 cycles
    2012-08-20 08:47:08,940 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue QueueProcessingStatistics: First cycle completed 0 blocks in 0 msec
    2012-08-20 08:47:08,940 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: InvalidateQueue QueueProcessingStatistics: Queue flush completed 0 blocks in 0 msec processing time, 0 msec clock time, 1 cycles
    2012-08-20 08:47:08,942 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source FSNamesystemMetrics registered.
    2012-08-20 08:47:09,441 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,444 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,445 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,445 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,448 INFO org.apache.hadoop.ipc.Server: Starting SocketReader
    2012-08-20 08:47:09,459 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source RpcDetailedActivityForPort8020 registered.
    2012-08-20 08:47:09,459 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source RpcActivityForPort8020 registered.
    2012-08-20 08:47:09,460 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Namenode up at: ct-eu-db1.eu.celer-tech.com/144.10.1.6:8020
    2012-08-20 08:47:09,805 INFO org.mortbay.log: Logging to org.slf4j.impl.Log4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog
    2012-08-20 08:47:09,848 INFO org.apache.hadoop.http.HttpServer: Added global filtersafety (class=org.apache.hadoop.http.HttpServer$QuotingInputFilter)
    2012-08-20 08:47:09,857 INFO org.apache.hadoop.http.HttpServer: dfs.webhdfs.enabled = false
    2012-08-20 08:47:09,872 INFO org.apache.hadoop.http.HttpServer: Port returned by webServer.getConnectors()[0].getLocalPort() before open() is -1. Opening the listener on 50070
    2012-08-20 08:47:09,873 INFO org.apache.hadoop.http.HttpServer: listener.getLocalPort() returned 50070 webServer.getConnectors()[0].getLocalPort() returned 50070
    2012-08-20 08:47:09,873 INFO org.apache.hadoop.http.HttpServer: Jetty bound to port 50070
    2012-08-20 08:47:09,873 INFO org.mortbay.log: jetty-6.1.26
    2012-08-20 08:47:10,240 INFO org.mortbay.log: Started SelectChannelConnector@ct-eu-db1.eu.celer-tech.com:50070
    2012-08-20 08:47:10,241 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Web-server up at: ct-eu-db1.eu.celer-tech.com:50070
    2012-08-20 08:47:10,241 INFO org.apache.hadoop.ipc.Server: IPC Server Responder: starting
    2012-08-20 08:47:10,241 INFO org.apache.hadoop.ipc.Server: IPC Server listener on 8020: starting
    2012-08-20 08:47:10,246 INFO org.apache.hadoop.ipc.Server: IPC Server handler 0 on 8020: starting
    2012-08-20 08:47:10,257 INFO org.apache.hadoop.ipc.Server: IPC Server handler 1 on 8020: starting
    2012-08-20 08:47:10,258 INFO org.apache.hadoop.ipc.Server: IPC Server handler 2 on 8020: starting
    2012-08-20 08:47:10,262 INFO org.apache.hadoop.ipc.Server: IPC Server handler 3 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 4 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 5 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 6 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 7 on 8020: starting
    2012-08-20 08:47:10,263 INFO org.apache.hadoop.ipc.Server: IPC Server handler 8 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 9 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 10 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 11 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 12 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 13 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 14 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 15 on 8020: starting
    2012-08-20 08:47:10,264 INFO org.apache.hadoop.ipc.Server: IPC Server handler 16 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 17 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 18 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 19 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 20 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 21 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 22 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 23 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 24 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 25 on 8020: starting
    2012-08-20 08:47:10,265 INFO org.apache.hadoop.ipc.Server: IPC Server handler 26 on 8020: starting
    2012-08-20 08:47:10,266 INFO org.apache.hadoop.ipc.Server: IPC Server handler 27 on 8020: starting
    2012-08-20 08:47:10,266 INFO org.apache.hadoop.ipc.Server: IPC Server handler 28 on 8020: starting
    2012-08-20 08:47:10,292 INFO org.apache.hadoop.ipc.Server: IPC Server handler 29 on 8020: starting
    2012-08-20 08:47:10,298 INFO org.apache.hadoop.ipc.Server: IPC Server handler 98 on 8020: starting
    2012-08-20 08:47:10,298 INFO org.apache.hadoop.ipc.Server: IPC Server handler 99 on 8020: starting
    2012-08-20 08:47:10,298 INFO org.apache.hadoop.ipc.Server: IPC Server handler 97 on 8020: starting
    2012-08-20 08:47:10,300 INFO org.apache.hadoop.ipc.Server: IPC Server handler 96 on 8020: starting
    2012-08-20 08:47:10,300 INFO org.apache.hadoop.ipc.Server: IPC Server handler 95 on 8020: starting
    2012-08-20 08:47:10,300 INFO org.apache.hadoop.ipc.Server: IPC Server handler 94 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 53 on 8020: starting
    2012-08-20 08:47:10,312 INFO org.apache.hadoop.ipc.Server: IPC Server handler 52 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 54 on 8020: starting
    2012-08-20 08:47:10,312 INFO org.apache.hadoop.ipc.Server: IPC Server handler 51 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 55 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 50 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 56 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 49 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 57 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 48 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 58 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 47 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 59 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 46 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 60 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 45 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 61 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 44 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 62 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 43 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 63 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 42 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 64 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 41 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 65 on 8020: starting
    2012-08-20 08:47:10,313 INFO org.apache.hadoop.ipc.Server: IPC Server handler 40 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 66 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 39 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 67 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 38 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 68 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 37 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 69 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 36 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 70 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 35 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 71 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 34 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 72 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 33 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 73 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 32 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 74 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 31 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 75 on 8020: starting
    2012-08-20 08:47:10,314 INFO org.apache.hadoop.ipc.Server: IPC Server handler 30 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 76 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 77 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 93 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 78 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 79 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 80 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 81 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 82 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 83 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 84 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 85 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 86 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 87 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 88 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 89 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 90 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 91 on 8020: starting
    2012-08-20 08:47:10,301 INFO org.apache.hadoop.ipc.Server: IPC Server handler 92 on 8020: starting
    2012-08-20 09:31:13,280 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at ct-eu-db1.eu.celer-tech.com/144.10.1.6
    ************************************************************/
    2012-08-20 09:37:49,918 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
    /************************************************************
    STARTUP_MSG: Starting NameNode
    STARTUP_MSG: host = ct-eu-db1.eu.celer-tech.com/144.10.1.6
    STARTUP_MSG: args = []
    STARTUP_MSG: version = 1.0.3.14
    STARTUP_MSG: build = -r ; compiled by ‘jenkins’ on Fri Jul 27 04:33:56 PDT 2012
    ************************************************************/
    2012-08-20 09:37:50,562 INFO org.apache.hadoop.metrics2.impl.MetricsConfig: loaded properties from hadoop-metrics2.properties
    2012-08-20 09:37:50,600 INFO org.apache.hadoop.metrics2.impl.MetricsSinkAdapter: Sink ganglia started
    2012-08-20 09:37:50,722 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source MetricsSystem,sub=Stats registered.
    2012-08-20 09:37:50,724 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: Scheduled snapshot period at 10 second(s).
    2012-08-20 09:37:50,724 INFO org.apache.hadoop.metrics2.impl.MetricsSystemImpl: NameNode metrics system started
    2012-08-20 09:37:51,083 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source ugi registered.
    2012-08-20 09:37:51,098 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source jvm registered.
    2012-08-20 09:37:51,098 INFO org.apache.hadoop.metrics2.impl.MetricsSourceAdapter: MBean for source NameNode registered.
    2012-08-20 09:37:51,141 INFO org.apache.hadoop.hdfs.util.GSet: VM type = 64-bit
    2012-08-20 09:37:51,141 INFO org.apache.hadoop.hdfs.util.GSet: 2% max memory = 4.60875 MB
    2012-08-20 09:37:51,141 INFO org.apache.hadoop.hdfs.util.GSet: capacity = 2^19 = 524288 entries
    2012-08-20 09:37:51,141 INFO org.apache.hadoop.hdfs.util.GSet: recommended=524288, actual=524288
    2012-08-20 09:37:51,183 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: fsOwner=hdfs
    2012-08-20 09:37:51,183 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: supergroup=hdfs
    2012-08-20 09:37:51,183 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isPermissionEnabled=true
    2012-08-20 09:37:51,187 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: dfs.block.invalidate.limit=100
    2012-08-20 09:37:51,187 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: isAccessTokenEnabled=true accessKeyUpdateInterval=600 min(s), accessTokenLifetime=600 min(s)
    2012-08-20 09:37:51,702 INFO org.apache.hadoop.hdfs.server.namenode.FSNamesystem: Registered FSNamesystemStateMBean and NameNodeMXBean
    2012-08-20 09:37:51,717 INFO org.apache.hadoop.hdfs.server.namenode.FSEditLog: dfs.namenode.edits.toleration.length = -1
    2012-08-20 09:37:51,717 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: Caching file names occuring more than 10 times
    2012-08-20 09:37:51,749 ERROR org.apache.hadoop.hdfs.server.namenode.FSNamesystem: FSNamesystem initialization failed.
    java.io.IOException: NameNode is not formatted.
    at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:331)
    at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:104)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:362)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:473)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1256)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1265)
    2012-08-20 09:37:51,750 ERROR org.apache.hadoop.hdfs.server.namenode.NameNode: java.io.IOException: NameNode is not formatted.
    at org.apache.hadoop.hdfs.server.namenode.FSImage.recoverTransitionRead(FSImage.java:331)
    at org.apache.hadoop.hdfs.server.namenode.FSDirectory.loadFSImage(FSDirectory.java:104)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.initialize(FSNamesystem.java:388)
    at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.(FSNamesystem.java:362)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.initialize(NameNode.java:276)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.(NameNode.java:473)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.createNameNode(NameNode.java:1256)
    at org.apache.hadoop.hdfs.server.namenode.NameNode.main(NameNode.java:1265)

    2012-08-20 09:37:51,750 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: SHUTDOWN_MSG:
    /************************************************************
    SHUTDOWN_MSG: Shutting down NameNode at ct-eu-db1.eu.celer-tech.com/144.10.1.6
    ************************************************************/
    2012-08-20 10:03:03,453 INFO org.apache.hadoop.hdfs.server.namenode.NameNode: STARTUP_MSG:
    /************************************************************

    Collapse
Viewing 3 replies - 1 through 3 (of 3 total)