Shulou(Shulou.com)05/31 Report--

This article will explain in detail how to design HDFS in Hadoop. The editor thinks it is very practical, so I share it with you for reference. I hope you can get something after reading this article.

HDFS is the abbreviation of Hadoop Distrbition FileSystem, distributed file system. The idea of this design comes from the operating system, and on the whole, it is also the control mode of master/slave. The main uses of the design are as follows:

Hardware requirements:

1. Current files can be stored on ordinary pc hard drives, but there are no high hardware requirements.

The way files are handled:

1. It is not cost-effective to deal with larger files, but smaller files are not cost-effective

2. A file is stored in the form of a file stream, which is actually written at once and read many times.

3. Later files can be appended to existing files, provided that a single user cannot be used to do so.

Efficiency of processing:

It is mainly suitable for data analysis with large delay, but not for real-time data processing.

This is the end of the article on "how to design HDFS in Hadoop". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, please share it for more people to see.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.