Batch job scheduling adaptive method based on Redis

Abstract

The invention discloses a Redis-based batch job scheduling adaptive method, which comprises the following steps: S1, job loading: creating Redis job channels, receiving to-be-processed batch jobs, and pressing the jobs into the corresponding job channels according to the scale of the jobs; S2, job scheduling: corresponding to a Redis job channel, establishing a response task receiving pool for checking a to-be-processed task of the corresponding channel; S3, job processing: receiving the to-be-processed task of the corresponding channel through the response task receiving pool, and performing job processing; and S4, after the current job is processed, releasing the resources, and returning to S3. According to the method, multiple channels are established by means of the redis cache technology, the concurrence efficiency is improved, and a scheduling mechanism of batch switching connection is realized by means of the mature redis technology; the to-be-processed batches are classified and grouped according to the scale of each batch, and each group is processed in parallel, so that long-time waiting of the to-be-processed batches under extreme conditions is prevented.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a Redis-based batch job scheduling adaptive method. Background technique [0002] With the rapid development of computer technology, computer and Internet technologies are widely used in various industries, and cluster systems are gradually applied in various fields. [0003] When the bank accepts the business needs of group customers for batch distribution, it may only need to send two details in one batch, or it may need to send 1 million details in one batch, all possibilities exist. When the company accepts multiple batches of dropshipping from multiple customers at the same time, the system may respond to 1 million dropshipping requests for a long time without processing two detailed dropshipping requests, or the system has been processing small dropshipping requests The processing of multiple detailed orders will be delayed due to batch batches, which may delay the proce...

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to provide an adaptive method for batch job scheduling based on Redis, which aims to solve the problem of low efficiency of proxy distribution in the prior art when the bank accepts the batch business needs of group customers, and there are problems caused by processing long jobs for a long time. A problem that caused short-job starvation situations to occur

Images