Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

What if datanode cannot start after hadoop has been formatted many times?

2025-02-24 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)06/01 Report--

This article introduces the relevant knowledge of "what to do if datanode cannot be started after hadoop has been formatted many times". In the operation of actual cases, many people will encounter such a dilemma, so let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

Hadoop namenode-format

Datanode cannot be started after multiple formatting

0.20.2 solution:

1. View the namespaceid in the VERSION file in the / usr/hadoop0.20.2/hadoop-huanghz/dfs/name/current/ folder on the name node (that is, the hadoop.tmp.dir parameter path configured in the configuration file)

2. The VERSION file namespaceid in the current folder is consistent with the name node under the path of the dfs.data.dir configuration modified by the two data nodes.

Version 2.20 solution

/ data/hadoop/dfs/name/current/VERSION

Use the clusterID under name to modify the clusterID in / data/hadoop/dfs/data/current/VERSION of datanode

Each time it is formatted, the clusterID of the VERSION under name will generate a new ID, and the clusterID of the VERSION of each node will be modified.

…… / dfs/data/current

StorageID=DS-1959445666-10.161.138.100-50010-1386493413986clusterID=CID-64a3a726-29e4-4d80-86a6-035ef33a225bcTime=0storageType=DATA_NODElayoutVersion=-47

…… / dfs/name/current/VERSION

# Fri Jan 03 10:37:48 CST 2014namespaceID=1667984727clusterID=CID-42c6d540-c3ca-44df-95e8-01a6d87effb5cTime=0storageType=NAME_NODEblockpoolID=BP-220196921-10.161.138.100-1388716668863layoutVersion=-47 "what to do if datanode cannot be started after hadoop has been formatted many times". Thank you for reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report