Shulou(Shulou.com)06/03 Report--

This article mainly introduces the example analysis of SpringBoot+SpringBatch+Quartz integration of timed batch tasks, which has a certain reference value, and interested friends can refer to it. I hope you will gain a lot after reading this article.

I. introduction

The requirements are as follows:

The PC web page triggers a device upgrade record (below), and the backend needs to update the equipment in batches at regular intervals. Quartz is regularly used here, and SpringBatch is used for batch data processing. This requirement can be accomplished by the combination of the two.

As I had not used SpringBatch before, I looked up the information on the Internet and found that there was not much to refer to, so I had to look through the official documents slowly.

If you encounter a lot of problems, just record it.

Second, the specific implementation of the code 1, pom file org.springframework.boot spring-boot-starter-web org.postgresql postgresql org.springframework.boot spring-boot-starter-jdbc org.springframework.boot spring-boot-starter-batch org.projectlombok lombok org.springframework.boot spring-boot-starter-batch 2, Application.yaml file spring: datasource: username: thinklink password: thinklink url: jdbc:postgresql://172.16.205.54:5432/thinklink driver-class-name: org.postgresql.Driver batch: job: enabled: falseserver: port: 8073#upgrade-dispatch-base-url: http://172.16.205.125:8080/api/rpc/dispatch/command/upgrade-dispatch-base-url: http://172.16.205.211:8080 / api/noauth/rpc/dispatch/command/# the amount of data per batch processing The default is 5000batch-size: 50003, Service implementation class

The entry that triggers the batch task and executes a job

@ Service ("batchService") public class BatchServiceImpl implements BatchService {/ / Framework automatic injection @ Autowired private JobLauncher jobLauncher; @ Autowired private Job updateDeviceJob / * create a Job * @ param taskId * @ throws Exception * / @ Override public void createBatchJob (String taskId) throws Exception {JobParameters jobParameters = new JobParametersBuilder () .addString ("taskId", taskId) .addString ("uuid", UUID.randomUUID (). ToString (). Replace ("-", ")) .toJobParameters () / / pass in a Job task and the parameters required by the task jobLauncher.run (updateDeviceJob, jobParameters);}} 4, SpringBatch configuration class

This section is the most important (☆)

@ Configurationpublic class BatchConfiguration {private static final Logger log = LoggerFactory.getLogger (BatchConfiguration.class); @ Value ("${batch-size:5000}") private int batchSize; / / Framework automatic injection @ Autowired public JobBuilderFactory jobBuilderFactory; / / Framework automatic injection @ Autowired public StepBuilderFactory stepBuilderFactory; / / data filter, pay attention to the data read from the database, pay attention to the operation @ Autowired public TaskItemProcessor taskItemProcessor / / receive the job parameter public Map parameters; public Object taskId; @ Autowired private JdbcTemplate jdbcTemplate / / read database operation @ Bean @ StepScope public JdbcCursorItemReader itemReader (DataSource dataSource) {String querySql = "SELECT" + "e. ID AS taskId," + "e.user_id AS userId,"+" e.timing_startup AS startTime, "+" u.device_id AS deviceId "+" d.app_name AS appName, "+" d.compose_file AS composeFile, "+" e.failure_retry AS failureRetry, "+" e.tetry_times AS retryTimes "+" e.device_managered AS deviceManagered "+" FROM "+" eiot_upgrade_task e "+" LEFT JOIN eiot_upgrade_device u ON e. ID = u.upgrade_task_id "+" LEFT JOIN eiot_app_detail d ON e.app_id = D. ID "+" WHERE "+" ("+" u.device_upgrade_status = 0 "+" OR u.device_upgrade_status = 2 "+") "+" AND e.tetry_times > u.retry_times "+" AND E. ID =? " Return new JdbcCursorItemReaderBuilder () .name ("itemReader") .SQL (querySql) .DataSource (dataSource) .queryArguments (new Object [] {parameters.get ("taskId"). GetValue ()}) .rowMapper (new DispatchRequest.DispatchRequestRowMapper ()) .build () } / / write the result back to the database @ Bean @ StepScope public ItemWriter itemWriter () {return new ItemWriter () {private int updateTaskStatus (DispatchRequest dispatchRequest, int status) {log.info ("update taskId: {}, deviceId: {} to status {}", dispatchRequest.getTaskId (), dispatchRequest.getDeviceId (), status) Integer retryTimes = jdbcTemplate.queryForObject ("select retry_times from eiot_upgrade_device where device_id =? And upgrade_task_id =? ", new Object [] {dispatchRequest.getDeviceId (), dispatchRequest.getTaskId ()}, Integer.class); retryTimes + = 1; int updateCount = jdbcTemplate.update (" update eiot_upgrade_device set device_upgrade_status =?, retry_times =? "+" where device_id =?? And upgrade_task_id =? ", status, retryTimes, dispatchRequest.getDeviceId (), dispatchRequest.getTaskId (); if (updateCount)

Welcome to subscribe "Shulou Technology Information " to get latest news, interesting things and hot topics in the IT industry, and controls the hottest and latest Internet news, technology news and IT industry trends.