Shulou(Shulou.com)06/01 Report--

This article introduces the relevant knowledge of "what are the advantages and disadvantages of Hadoop technology". In the operation process of actual cases, many people will encounter such difficulties. Next, let Xiaobian lead you to learn how to deal with these situations. I hope you can read carefully and learn something!

Benefits of Hadoop Technology

(1)Hadoop has high reliability in terms of bit-wise storage and processing capabilities.

(2)Hadoop distributes data to complete storage and compute tasks through clusters of available computers, which can easily scale to thousands of nodes with high scalability.

(3)Hadoop can dynamically move data between nodes, and ensure the dynamic balance of each node, processing speed is very fast, with high efficiency.

(4)Hadoop can automatically save multiple copies of data and automatically redistribute failed tasks, with high fault tolerance.

Disadvantages of Hadoop

(1)Hadoop is not suitable for low-latency data access.

(2)Hadoop cannot efficiently store large numbers of small files.

(3)Hadoop does not support multiple users to write and modify files arbitrarily.

Core components of Hadoop

Since the birth of Hadoop, Hadoop1, Hadoop2 and Hadoop3 have appeared.

HDFS and MapReduce are the core components of Hadoop1, and many components in the Hadoop ecosystem are based on HDFS and MapReduce. Hadoop1 was followed by Hadoop2, which improved upon Hadoop1. Compared to Hadoop1, the three core components of Hadoop2 are HDFS, MapReduce and Yarn. Most businesses currently use Hadoop2, and this book uses Hadoop 2.7.3.

A common module and three core components of Hadoop2 make up four modules, which are described below.

Hadoop Common: Provides infrastructure for other Hadoop modules.

HDFS: Distributed file system with high reliability and high throughput.

(3)MapReduce: Based on Yarn system, distributed offline parallel computing framework.

(4)Yarn: A framework responsible for job scheduling and cluster resource management.

"What are the advantages and disadvantages of Hadoop technology" is introduced here. Thank you for reading it. If you want to know more about industry-related knowledge, you can pay attention to the website. Xiaobian will output more high-quality practical articles for everyone!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.