Shulou(Shulou.com)06/02 Report--

This article mainly explains "what are the characteristics of Storm". Interested friends may wish to have a look at it. The method introduced in this paper is simple, fast and practical. Let's let the editor take you to learn what are the characteristics of Storm.

1. Hadoop ecosystem  

Hadoop   is a distributed system infrastructure developed by the Apache Foundation. Users can develop distributed programs without knowing the underlying details of the distribution. Make full use of the power of the cluster for high-speed computing and storage. Hadoop implements a distributed file system (Hadoop   Distributed   File   System), referred to as HDFS.  

The Hadoop   "stack" consists of several components. Including:  

1. Hadoop distributed File system (HDFS): the default storage layer for all Hadoop clusters.

2.   name node: in a Hadoop cluster, a node that provides data storage location and node failure information.  

3.   secondary node: backup of the name node, which will copy and store the data of the name node periodically in case the name node fails.  

4.   job tracker: the node in the Hadoop cluster that initiates and coordinates MapReduce jobs or data processing tasks.  

5.   from the node: the ordinary node of the Hadoop cluster, stores data from the node and obtains data processing instructions from the job tracker.  

2. Spark ecosystem  

Spark   is an open source cluster computing environment similar to   Hadoop  , but there are some differences between the two. These useful differences make   Spark   perform better in some workloads. In other words, Spark   enables in-memory distributed datasets to optimize iterative workloads in addition to interactive queries.

Spark   is implemented in the   Scala   language, which uses   Scala   as its application framework. Unlike   Hadoop  , Spark   and   Scala   can be tightly integrated, where   Scala   can manipulate distributed datasets as easily as local collection objects.  

Third, Storm real-time development of  

Storm is a free and open source distributed real-time computing system. Using Storm can easily and reliably handle unlimited data streams, just like Hadoop batch processing big data, Storm can process data in real time. Storm is simple and can be used in any programming language.  

Storm has the following characteristics:  

1. Programming is simple: developers only need to focus on application logic, and like Hadoop, the programming primitives provided by Storm are also very simple.

2. High performance and low latency: it can be applied to scenarios where advertising search engines require real-time response to the actions of advertisers.  

3. Distributed: it can easily deal with scenarios with a large amount of data and can not be handled by a single machine.

4. Scalable: with the development of   business, the amount of data and calculation is getting larger and larger, and the system can be expanded horizontally.

5. Fault tolerance: the failure of a single node does not affect the application.  

6. Message is not lost: guarantee message processing.

At this point, I believe you have a deeper understanding of "what are the characteristics of Storm?" you might as well do it in practice. Here is the website, more related content can enter the relevant channels to inquire, follow us, continue to learn!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.