Flow control method and device, electronic equipment and storage medium

Through the combination of sliding window and token bucket algorithm, the token allocation of requests of different priority levels is dynamically adjusted, which solves the problem of resource waste and current limit in traffic control in large-scale service, and achieves efficient and accurate traffic management.

CN119324897AActive Publication Date: 2025-01-17BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF 9 Cites 0 Cited by

Patent Information

Application Number
CN202411303574.6
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-09-18
Publication Date
2025-01-17
Estimated Expiration
2044-09-18

AI Technical Summary

Technical Problem

When traffic control is controlled in large-scale services, it is difficult to effectively manage access requests of different priority levels, resulting in waste of resources and incorrect flow restriction phenomena, especially in the allocation of quota between high-priority requests and low-priority requests. then.

Method used

Using the sliding window mechanism combined with the token bucket algorithm, dynamically adjust the number of tokens allocation in the sliding window in the current time and the remaining tokens in the target token bucket to ensure that high-priority requests are not affected by low priority and maximum Resource utilization rate.

Benefits of technology

Adaptive priority control is realized, which avoids resource waste and wrong current limiting, ensures the stability of high-priority requests, and improves the accuracy and efficiency of flow control.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119324897A_ABST
    Figure CN119324897A_ABST
Patent Text Reader

Abstract

The invention provides a flow control method and device, electronic equipment and a storage medium, and relates to the field of artificial intelligence such as distributed storage, large model service and the Internet. The method comprises the following steps: acquiring an access request of a user, determining a first sliding window which takes current time as end time and has a preset length, and determining a priority of the request as a current priority; according to the number of successful requests of the current priority in the first sliding window, the number of requests of all high priorities in the first sliding window and the number of remaining tokens in a target token bucket corresponding to the current request, the number of tokens allowed to be used is determined, and the high priorities are priorities higher than the current priority; one token is placed in the target token bucket every preset time, and the number of the stored tokens needs to be smaller than or equal to a preset upper limit; responding to the request in response to the fact that the number of tokens needing to be consumed by the request is smaller than or equal to the number of tokens allowed to be used.
Need to check novelty before this filing date? Find Prior Art

Citation Information

Patent Citations

  • Data transmission method and device based on speed limiting strategy

    CN113726682A

  • System current limiting method and device

    CN113742114A

  • Flow limiting method and device, task response system, electronic equipment and storage medium

    CN115357363A

  • Flow rate limiting method based on priority, and DPU message forwarding method and device

    CN115766592A

  • Private cloud access control method and device, equipment and medium

    CN116264522A