Batch request peak clipping processing method and system based on dynamic dormancy and partition polling
By employing a batch request peak-shaving method combining dynamic sleep and partitioned polling, this approach utilizes a reinforcement learning model to predict load trends, dynamically calculates the sleep time window, and performs content feature extraction and deduplication within the sleep window. This solves the problems of resource waste and system instability in high-concurrency scenarios, achieving efficient peak-shaving and resource optimization.
Patent Information
- Application Number
- CN202610135394.4
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Filing Date
- 2026-01-30
- Publication Date
- 2026-05-26
AI Technical Summary
In high-concurrency scenarios, traditional peak-shaving methods such as thread sleep, queue discarding, or fixed-frequency polling are difficult to cope with highly unpredictable peak pressure, leading to resource waste and system instability. In addition, a large number of semantically similar requests cause the server to perform far more operations than necessary.
A batch request peak shaping method based on dynamic sleep and partitioned polling is adopted. The load trend is predicted by the reinforcement learning model, the sleep time window is dynamically calculated, and content feature extraction, similarity clustering and content-level deduplication are performed within the sleep window to generate a deduplicated request set. The same type of request is processed uniformly to reduce the actual number of executions.
It significantly reduces processing rhythm fluctuations, improves system carrying capacity and stability, reduces resource waste, optimizes server resource utilization, adapts to business changes and load fluctuations, and achieves non-linear peak shaving effect.