Shulou(Shulou.com)06/01 Report--

In this issue, the editor will bring you about what is the scheme of flow restriction and peak elimination in big data. The article is rich in content and analyzes and narrates it from a professional point of view. I hope you can get something after reading this article.

1. Common pain points:

The connection resources are exhausted, the distributed cache capacity is burst, and the database throughput is reduced, which eventually leads to the system avalanche. 2. the conventional means to deal with high concurrency and large traffic: expanding capacity, dynamic and static separation cache service, downgrading and current restriction.

Current limiting scheme:

1. Current limiting algorithm

1. Token bucket algorithm: mainly used to limit the average inflow rate of traffic 2, leaky bucket algorithm: limit outflow rate 3, counter algorithm: to realize rush purchase and current limit

II. Practical application

1. Use Google Guava (open source) to achieve average rate limit. 2. Use Nginx to achieve access layer current limit.

Peak elimination scheme

First, the peak elimination scheme based on time slicing is used to disperse the peak flow.

1. The activity is divided into different periods to achieve peak elimination. Eg: the number of 5000 is divided into 10 periods. 2. Peak elimination is achieved through answer verification, which can successfully block the second killer and reduce the peak flow. Eg:12306 verification code

Second, asynchronous call requirements

1. Use MQ to realize the decoupling between systems, eg:Apache open source ActiveMQ, Ali open source RocketMQ, Kafka. The above is the big data flow limit and peak elimination plan shared by the editor. If you happen to have similar doubts, you might as well refer to the above analysis to understand. If you want to know more about it, you are welcome to follow the industry information channel.

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.