Request dispatch processing method and request dispatch processing system

By introducing multiple candidate request processing queues into the file system, and performing traffic splitting and fine-grained scheduling based on request type and file identifier, the fairness issue between read/write requests and files is resolved, thereby improving the system's throughput efficiency and stability.

CN122363624APending Publication Date: 2026-07-10ALIBABA CLOUD COMPUTING CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202610825955.3
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-06-09
Publication Date
2026-07-10

AI Technical Summary

Technical Problem

Traditional single-queue distribution mechanisms can lead to read requests being starved by write requests and small files being starved by large files in high-concurrency, mixed-load scenarios, affecting system performance and resource utilization.

Method used

Multiple candidate request processing queues are used to divert file processing requests to independent target request processing queues based on request type and file identifier, thereby achieving physical isolation and resource decoupling of read and write requests. Requests are added in a fine-grained manner using file identifiers, and orderly and fair scheduling is carried out through the target request processing queues.

Benefits of technology

It improves the overall throughput efficiency, response stability, and resource utilization of the file system under mixed workload scenarios such as big data and artificial intelligence training, and avoids the problems of read requests being starved by write requests and small files being starved by large files.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122363624A_ABST
    Figure CN122363624A_ABST
Patent Text Reader

Abstract

This specification provides a request distribution processing method and a request distribution processing system. The request distribution processing method includes: obtaining file processing requests for target files; determining a target request processing queue set from multiple candidate request processing queue sets based on the request type of the file processing request, wherein the multiple candidate request processing queue sets correspond to different request types; determining a target request processing queue from the target request processing queue set based on the file identifier of the target file, and adding the file processing request to the target request processing queue; and invoking the request distribution resource corresponding to the target request processing queue to distribute and process the target requests in the target request processing queue. This eliminates the risk of read requests being starved due to resource contention, ensuring low-latency response for data loading; and ensures that processing requests for massive numbers of small files can obtain a fair scheduling opportunity, thereby preventing small files from being starved by large files.
Need to check novelty before this filing date? Find Prior Art