Shulou(Shulou.com)06/01 Report--

This article is about how Spring Boot solves the problem of Redis caching + MySQL bulk storage. The editor thinks it is very practical, so share it with you as a reference and follow the editor to have a look.

Architecture design

Architecture diagram:

Time sequence diagram

Record the basic data MySQL table structure

CREATE TABLE `zh_article_ count` (`id`bigint (20) NOT NULL AUTO_INCREMENT, `bu_ no` varchar (32) DEFAULT NULL COMMENT 'business code', `customer_ id` varchar (32) DEFAULT NULL COMMENT 'user code', `type`int (2) DEFAULT'0' COMMENT 'statistical type: 0APP article reading', `article_ no`varchar (32) DEFAULT NULL COMMENT 'article code', `read_ time`datetime DEFAULT NULL COMMENT 'reading time, `create_ time`datetime DEFAULT CURRENT_TIMESTAMP COMMENT' creation time' `param1` datetime DEFAULT CURRENT_TIMESTAMP COMMENT 'update time', `param1` int (2) DEFAULT NULL COMMENT 'reserved field 1, `param2` int (4) DEFAULT NULL COMMENT' reserved field 2, `param3` int (11) DEFAULT NULL COMMENT 'reserved field 3, `param4` varchar (20) DEFAULT NULL COMMENT' reserved field 4, `param5` varchar (32) DEFAULT NULL COMMENT 'reserved field 5, `param6` varchar (64) DEFAULT NULL COMMENT' reserved field 6, PRIMARY KEY (`id`) UNIQUE KEY `key_zh_article_count_ buno` (`bu_ no`), KEY `key_zh_article_count_ sign` (`customer_ id`), KEY `key_zh_article_count_ ano` (`article_ no`), KEY `key_zh_article_count_ rtime` (`read_ time`) ENGINE=InnoDB DEFAULT CHARSET=utf8mb4 COMMENT=' article reading statistics'

Technical implementation scheme

SpringBoot

Redis

MySQL

Code implementation

Complete code (GitHub, welcome to Star,Fork,Watch)

Https://github.com/dangnianchuntian/springboot

Main code presentation

Controller

/ * Copyright (c) 2020. Zhanghan_java@163.com All Rights Reserved. * Project name: Spring Boot practical solution for high concurrency data storage: Redis cache + MySQL batch storage * Class name: ArticleCountController.java * founder: Zhang Han * contact information: zhanghan_java@163.com * open source address: https://github.com/dangnianchuntian/springboot * blog address: https://zhanghan.blog.csdn.net * / package com.zhanghan.zhredistodb.controller;import org.springframework.beans.factory.annotation.Autowired Import org.springframework.validation.annotation.Validated;import org.springframework.web.bind.annotation.RequestBody;import org.springframework.web.bind.annotation.RequestMapping;import org.springframework.web.bind.annotation.RequestMethod;import org.springframework.web.bind.annotation.RestController;import com.zhanghan.zhredistodb.controller.request.PostArticleViewsRequest;import com.zhanghan.zhredistodb.service.ArticleCountService;@RestControllerpublic class ArticleCountController {@ Autowired private ArticleCountService articleCountService / * * record user access record * / @ RequestMapping (value = "/ post/article/views", method = RequestMethod.POST) public Object postArticleViews (@ RequestBody @ Validated PostArticleViewsRequest postArticleViewsRequest) {return articleCountService.postArticleViews (postArticleViewsRequest) } / * synchronize the data in the cache to MySQL (simulate scheduled task operation) * / @ RequestMapping (value = "/ post/batch", method = RequestMethod.POST) public Object postBatch () {return articleCountService.postBatchRedisToDb ();}

Service

/ * Copyright (c) 2020. Zhanghan_java@163.com All Rights Reserved. * Project name: Spring Boot practical solution for high concurrency data storage: Redis cache + MySQL batch storage * Class name: ArticleCountServiceImpl.java * founder: Zhang Han * contact information: zhanghan_java@163.com * open source address: https://github.com/dangnianchuntian/springboot * blog address: https://zhanghan.blog.csdn.net * / package com.zhanghan.zhredistodb.service.impl;import java.util.ArrayList;import java.util.Date;import java.util.List Import java.util.stream.Collectors;import org.slf4j.Logger;import org.slf4j.LoggerFactory;import org.springframework.beans.factory.annotation.Autowired;import org.springframework.beans.factory.annotation.Value;import org.springframework.data.redis.core.RedisTemplate;import org.springframework.stereotype.Service;import org.springframework.util.CollectionUtils;import com.alibaba.fastjson.JSON;import com.zhanghan.zhredistodb.controller.request.PostArticleViewsRequest;import com.zhanghan.zhredistodb.dto.ArticleCountDto;import com.zhanghan.zhredistodb.mybatis.mapper.XArticleCountMapper Import com.zhanghan.zhredistodb.service.ArticleCountService;import com.zhanghan.zhredistodb.util.wrapper.WrapMapper;import cn.hutool.core.util.IdUtil;@Servicepublic class ArticleCountServiceImpl implements ArticleCountService {private static Logger logger = LoggerFactory.getLogger (ArticleCountServiceImpl.class); @ Autowired private RedisTemplate strRedisTemplate; private XArticleCountMapper xArticleCountMapper; @ Value ("${zh.article.count.redis.key:zh}") private String zhArticleCountRedisKey @ Value ("# {T (java.lang.Integer) .parseInt ('${zh..article.read.num:3}')}") private Integer articleReadNum; / * * record user access record * / @ Override public Object postArticleViews (PostArticleViewsRequest postArticleViewsRequest) {ArticleCountDto articleCountDto = new ArticleCountDto (); articleCountDto.setBuNo (IdUtil.simpleUUID ()); articleCountDto.setCustomerId (postArticleViewsRequest.getCustomerId ()) ArticleCountDto.setArticleNo (postArticleViewsRequest.getArticleNo ()); articleCountDto.setReadTime (new Date ()); String strArticleCountDto = JSON.toJSONString (articleCountDto); strRedisTemplate.opsForList (). RightPush (zhArticleCountRedisKey, strArticleCountDto); return WrapMapper.ok ();} * synchronize the data in the cache to MySQL public Object postBatchRedisToDb () {Date now = new Date () in batches While (true) {List strArticleCountList = strRedisTemplate.opsForList (). Range (zhArticleCountRedisKey, 0, articleReadNum); if (CollectionUtils.isEmpty (strArticleCountList)) {return WrapMapper.ok ();} List articleCountDtoList = new ArrayList () StrArticleCountList.stream () .forEach (x-> {ArticleCountDto articleCountDto = JSON.parseObject (x, ArticleCountDto.class); articleCountDtoList.add (articleCountDto);}) / / filter out the cached data before this scheduled task to prevent the endless loop List beforeArticleCountDtoList = articleCountDtoList.stream (). Filter (x-> x.getReadTime (). Before (now)) .destroy (Collectors.toList ()); if (CollectionUtils.isEmpty (beforeArticleCountDtoList)) {xArticleCountMapper.batchAdd (beforeArticleCountDtoList); Integer delSize = beforeArticleCountDtoList.size () StrRedisTemplate.opsForList () .trim (zhArticleCountRedisKey, delSize,-1L);}} Test

Simulate a user request to access the background (multiple requests)

View the data accessed in the cache

The analog timing task synchronizes the data in the cache to the DB

At this time, the data in the cache is gone.

View database table structure

Thank you for reading! This is the end of this article on "Spring Boot how to solve the problem of Redis cache + MySQL bulk storage". I hope the above content can be of some help to you, so that you can learn more knowledge. if you think the article is good, you can share it out for more people to see!

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.