Shulou(Shulou.com)05/31 Report--

This article mainly explains the "Storm topology concurrency degree how to achieve", the article explains the content is simple and clear, easy to learn and understand, the following please follow the editor's ideas slowly in depth, together to study and learn "Storm topology concurrency degree how to achieve" it!

1 Storm distinguishes the topologies that run for a century in a Storm cluster according to the following three main parts:

1: worker

2:Executor (Thread)

3:tasks

The following figure simply illustrates their relationship. Okay, this is a repeatedly published structure diagram:

For the above, a Task, that is:

An Executor is a thread generated by a worker process that may be running one of the same components Spout and bolt or

Multiple task

A task performs actual data processing, and each spout or bolt you implement in code is equivalent to many task distributed throughout the cluster.

In the life cycle of 1 topology, the number of task of 1 component is always the same, but the number of executor (threads) of 1 component can be changed over time.

Change from time to time. This means that the following conditions are always true: the number of thread

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.