Shulou(Shulou.com)06/01 Report--

This article introduces the relevant knowledge of "what are the advantages of HADOOP HDFS". In the operation of practical cases, many people will encounter such a dilemma. Then let the editor lead you to learn how to deal with these situations. I hope you can read it carefully and be able to achieve something!

With HADOOP 2.x as the background.

First, the HDFS of the warehouse (depositing silver taels).

In order to get rich, Hu Xueyan shopkeeper opened (Fukang Bank). First of all, he had to find a place to put silver taels, buy a piece of land in Beijing and build a house. This is the HDFS, which has a characteristic. Besides Beijing (Node 1), it can also be built in Hebei (Node 2) and Anhui (Node 3). Moreover, the silver banks in these three places can be interlinked. Depositors Zuo Zongtang can save money in Beijing. Anhui can take it.

Benefits:

1. To solve the single point of failure, the Beijing Bank was robbed.

2. Due to the problem that the hardware can be expanded at low cost, the land price in Beijing is expensive.

3. Hebei can also withdraw money from the nearest use of the data.

4. High expansibility. The business is large, the bank can also be built in Henan, the business is small, and the bank in Hebei can be rented out.

5, suitable for big data processing, 3 warehouses can access silver and silver at the same time. As long as there are enough warehouses (1w warehouses), spend hundreds of millions. GB,TB,PB .

Disadvantages:

1. Low latency data access, it is slow to put two pieces of silver into the warehouse

2. Suitable for storing silver ingots (large files), but not suitable for dealing with broken silver.

3, suitable for silver, not suitable for silver exchange.

When there is a warehouse, there must be someone in charge of the warehouse, (Fukang Bank) will start business.

1. Treasury Manager: namenode:

Manage the namespace of HDFS, Beijing warehouse is called Beiku, Hebei warehouse is Hebei warehouse, Anhui warehouse is Huiku.

Manage the mapping information of data blocks (block) and record where the left adult's money is placed.

Configure the replica policy.

Handle client read and write requests and receive silver storage requests.

2. The person in charge of the branch warehouse: Hu Beijing, Hu Hebei, Hu Anhui (datanode)

Store actual data blocks and put in two pieces of silver

Perform the read and write operation of the data block, and specifically operate the storage of silver and silver.

The files are stored.

Hadoop1.0 one silver ingot 64MB

Hadoop2.0 one silver ingot 128MB

3. Assistant to the manager of the warehouse: Hu Xiaoer (Hu er's assistant):

Assist namenode to share the workload.

Regularly merge fsimage and fsedits and push them to namenode. Hu Xiaoer usually records and stores accounts.

When the emergency is small, it can assist in the restoration of namenode, and Hu Xiaoer will take over Hu's job.

4. Customer: depositor client

Save money, upload files, save zero

Withdraw money

And Hu er read the location information of the file

And Hu Beijing read the data.

Second, let's talk about the saving process (HDFS file writing) and the money withdrawing process (HDFS file reading).

1. Zuo Zongtang's savings process.

Zuo Zongtang is looking for Hu er. I want to save money.

Hu er first judged whether Zuo Zongtang had the authority to save money or not, and then allocated the treasury to Zuo Zongtang.

Zuo Zongtang took a note (storing information) and went to the Beijing warehouse to deposit the money in the Beijing warehouse.

Zuo Zongtang fed back the stored information to Hu er.

2. Zuo Zongtang's process of withdrawing money.

Zuo Zongtang wanted to withdraw money and asked Hu er money in which warehouse.

Hu er told Zuo Zongtang that the money was in Hu's warehouse in Beijing.

Zuo Zongtang went to Hu Beijing's warehouse to withdraw two taels of silver.

If you withdraw too much money, you need to use a rickshaw to pull many times. Zuo Zongtang withdraws money once and needs to tell Hu er once.

When the withdrawal is over, tell Hu er.

This is the end of the content of "what are the advantages of HADOOP HDFS". Thank you for reading. If you want to know more about the industry, you can follow the website, the editor will output more high-quality practical articles for you!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.