Shulou(Shulou.com)05/31 Report--

Editor to share with you what applications there are in the Redis cluster control layer in Tumblr. I hope you will get something after reading this article. Let's discuss it together.

Tumblr is the most popular light blogging service in the world, with 20.9 million users at last count, surpassing WordPress, the largest blogging service in the world. What are the applications of Tumblr's Redis cluster control layer? what is the performance of Tumblr's Redis cluster control layer?

What are the applications of Tumblr's Redis cluster control layer

In the early days of Tumblr, its notification system was composed of the traditional architecture of MySQL+Memcached, but due to the huge addition operation of the notification system, the burden of MySQL was so heavy that InnoDBglobaltransactionmax (1024) was often exceeded. So they plan to rebuild the messaging system. First of all, they analyzed the application characteristics of the message system:

Sort by time

Uniqueness, every message is unique

The reading-writing ratio is about 60% and 30%.

There must be a certain number of messages per user

The data is divided by users, and each user can only read their own messages.

Tumblr's Redis Cluster Control layer Architecture

Based on the consideration of the above application characteristics, Tumblr chose Redis's sortedsets as its data storage.

They are stored as follows:

Assign a sortedsets to each user, where each item saves a notification

Each notification is sorted in sortedsets by timestamp as score

Perform trim operation after more than 100 notifications

The amount of data in Tumblr: 23 million BLOG, each BLOG100 message, each message body about 160bytes.

Response time: provide about 7500 requests per second, and the response time for each request is less than 5ms.

Considering the disaster tolerance and the possible rapid growth of the amount of data, Tumblr planned to use preshard to structure their Redis cluster, so they developed Staircar (a Redis cluster scheduling management component that provides HTTP services). The following is their notification system architecture diagram:

In fact, before developing Staircar, they examined a number of other products with similar features, but none of them met all their needs (or too many features).

What is the performance of Tumblr's Redis cluster control layer?

Staircar is written by C language, uses libevent as the network driver layer, and provides RESTFul interface in JSON format. Its performance exceeds the imagination of Tumblr engineers, and its response time at its peak is also below 5ms. Its performance test result is about 30000 requests per second.

After reading this article, I believe you have a certain understanding of "what are the applications of Redis cluster control layer in Tumblr". If you want to know more about it, you are welcome to follow the industry information channel. Thank you for reading!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.