Replies: 3
I have set up fully distributed cluster for hadoop with namenode, secondary namenode and 6 datanodes on different containers of docker on same machine.After formatting namenode, when I start all processes using ./start-dfs.sh. I am able see namenode and seconday namenode processes, but not datanode. I am facing below error in logs of datanode:
FATAL org.apache.hadoop.hdfs.server.datanode.DataNode: Initialization failed for block pool Block pool BP-1934698098-..-1406095928965 (storage id DS-1439452174-10.15.10.209-50010-1405956351221) service to /..:8020
java.io.IOException: Incompatible clusterIDs in /root/datanode: namenode clusterID = CID-7553ffee-bf82-44ba-8eea-75d96fc9ffee; datanode clusterID = CID-58e351b4-e758-4051-8267-1857e1de1fb0
at org.apache.hadoop.hdfs.server.datanode.DataStorage.doTransition(DataStorage.java:391)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:191)
at org.apache.hadoop.hdfs.server.datanode.DataStorage.recoverTransitionRead(DataStorage.java:219)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initStorage(DataNode.java:837)
at org.apache.hadoop.hdfs.server.datanode.DataNode.initBlockPool(DataNode.java:808)
at org.apache.hadoop.hdfs.server.datanode.BPOfferService.verifyAndSetNamespaceInfo(BPOfferService.java:280)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.connectToNNAndHandshake(BPServiceActor.java:222)
at org.apache.hadoop.hdfs.server.datanode.BPServiceActor.run(BPServiceActor.java:664)
at java.lang.Thread.run(Thread.java:744)
2014-07-23 16:10:42,809 WARN org.apache.hadoop.hdfs.server.datanode.DataNode: Ending block pool service for: Block pool BP-1934698098-..-1406095928965 (storage id DS-1439452174-..-50010-1405956351221) service to /..:8020