High-concurrency-resistant three-level caching method suitable for server

By adopting a three-level caching method and dynamic request scheduling mechanism on the server, the performance bottlenecks and cache failure problems of traditional caching technology in high concurrency scenarios are solved, and more efficient cache management and response speed are achieved.

CN119691012APending Publication Date: 2025-03-25CHENGDOU HUAQIYUN TECH CO LTD
0 Cites 1 Cited by

Patent Information

Application Number
CN202411772611.8
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2024-12-04
Publication Date
2025-03-25

AI Technical Summary

Technical Problem

Traditional caching technology is prone to performance bottlenecks in high concurrency scenarios, cache failure leads to increased back-end pressure, and lacks efficient multi-level cache management methods.

Method used

The third-level caching method is adopted to analyze the request type through the load balancer. Hotspot requests are forwarded to the first-level cache layer first, and long-tail requests are forwarded to the second-level or third-level cache layer. Combined with Varnish, Facade and Kafka cache layers, the user behavior analysis and time series model predict hotspot data to achieve dynamic request scheduling.

Benefits of technology

Improve cache hit rate and response speed, reduce the number of times the application server accesses the database, reduce the backend load, avoid cache avalanches and breakdowns, and optimize processing efficiency and response speed.

✦ Generated by Eureka AI based on patent content.
Patent Text Reader

Abstract

The invention relates to the technical field of server access, in particular to an anti-high-concurrency three-level caching method and system suitable for a server side, and the method comprises the following steps: a terminal device sends a request, analyzes the type of the request when the request enters a load balancer, and judges whether the request is a hotspot request or a long-tail request; if it is judged that the request is a hotspot request, the request is forwarded to a first-level cache layer; if the data required by the request does not exist in the cache, forwarding the request to a next-level cache layer step by step until the data is found; if the request is judged to be a long-tail request, the request is forwarded to a second-level cache layer or a third-level cache layer, and if data needed by the request does not exist in a corresponding cache, the request is gradually forwarded to a next-level cache layer until the data is found. The method has the advantages that the cache access path can be adjusted in a self-adaptive mode, and resources are prevented from being wasted in invalid requests; the hot data can be predicted more accurately, and cache distribution is optimized.
Need to check novelty before this filing date? Find Prior Art