Network Security Internet Technology Development Database Servers Mobile Phone Android Software Apple Software Computer Software News IT Information

In addition to Weibo, there is also WeChat

Please pay attention

WeChat public account

Shulou

How to solve the problem of NN single point failure by Hadoop2.x

2025-01-16 Update From: SLTechnology News&Howtos shulou NAV: SLTechnology News&Howtos > Servers >

Share

Shulou(Shulou.com)05/31 Report--

This article introduces Hadoop2.x how to solve the NN single point failure problem, the content is very detailed, interested friends can refer to, hope to be helpful to you.

Hadoop solves the problem of single point of failure mainly in two ways:

1. NFS file sharing

2. Proposed by CLOUDERA in QJM mode.

There are two nn in Hadoop2.x, one is active namenode state is active, the other is standy namenode state is standy, both are switched, but there is one and only one active!

Nfs is a heavyweight that needs to be deployed and maintained separately. As a storage for data sharing between namenode and standy namenode, the disadvantage is that if active, then node or standy namenode has a network failure with nfs, it will cause data synchronization problems.

QJM solves the problems faced by nfs. Data is shared between active namenode and standy namenode through a set of journalnode odd numbers. Active nn writes the latest edits files to 2n+1. Only 1 journalnode writes successfully, and then standy nn starts to read. This way supports fault tolerance!

About Hadoop2.x how to solve the NN single point failure problem is shared here, I hope the above content can be of some help to you, can learn more knowledge. If you think the article is good, you can share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.

Views: 0

*The comments in the above article only represent the author's personal views and do not represent the views and positions of this website. If you have more insights, please feel free to contribute and share.

Share To

Servers

Wechat

© 2024 shulou.com SLNews company. All rights reserved.

12
Report