Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Hot spot data storage method and terminal

A technology of hotspot data and data, applied in the Internet field, can solve problems such as performance bottlenecks and hotspots, and achieve the effects of improving efficiency, avoiding downtime, and alleviating performance bottlenecks

Pending Publication Date: 2019-07-09
FUJIAN TIANQUAN EDUCATION TECH LTD
View PDF3 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Many systems use single-point redis or cluster redis to store a large amount of cached data information. However, whether it is a cache collection composed of multiple single-point redis or an independent cluster redis to store data, there may be hot spots
Hotspots are cached data that are accessed in a large amount in a short period of time. Usually, hotspot data happens to be in a certain node in the cache. At this time, it will put a lot of pressure on the CPU, IO, and gateway bandwidth, resulting in performance bottlenecks.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Hot spot data storage method and terminal
  • Hot spot data storage method and terminal
  • Hot spot data storage method and terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0064] Please refer to figure 1 and image 3 , a method for storing hotspot data, comprising the steps of:

[0065] S1. Count the requested access times of the data in the ordinary cache, and judge whether there is hot data in the data in the ordinary cache according to the requested access times, and if so, perform step S2;

[0066] Wherein, the ordinary cache is an ordinary redis cluster or an ordinary single-point redis collection;

[0067] Specifically, it is judged by the hotspot calculation module whether the number of requested visits of the data in the common cache within the preset time is greater than the preset number of times, if yes, the data is hot data, if not, the data is not Hot data;

[0068] Preferably, the preset time is 1 minute, and the preset number of times is 100,000 times;

[0069] For example, if the number of access requests of an organization ID in the same interface occurs 100,000 times within one minute, it is determined that the data require...

Embodiment 2

[0085] The difference between this embodiment and Embodiment 1 is that it also includes:

[0086] In a specific data request, the interface receives the data request from the client, and the data request includes the original cache key of the data;

[0087] Specifically, the client requests the interface, and the interface queries the data in the local memory;

[0088] When the switch sign indicates that access to the hotspot cache is closed, the interface directly accesses the common cache to obtain data;

[0089] When the switch sign indicates that hotspot cache access is enabled, the interface judges whether the data needs to query the hotspot cache, that is, judges whether the data is hotspot data;

[0090] If so, according to the mapping relationship between the saved original cache key and the hotspot cache key corresponding to different nodes, a hotspot cache key is randomly selected according to a certain random algorithm, and obtained from the corresponding node in t...

Embodiment 3

[0098] The difference between this embodiment and embodiment one or embodiment two is that it also includes:

[0099] When acquiring the hotspot data from the common cache, acquire the expiration time of the hotspot data in the common cache;

[0100] When saving the hotspot data in different nodes in the hotspot cache, setting the expiration time of the hotspot data in the hotspot cache;

[0101] Wherein, the expiration time of the hotspot data in the hotspot cache is consistent with the expiration time of the hotspot data in the common cache.

[0102]Preferably, when the quantity of hotspot data is lower than a preset value, only its expiration time in the hotspot cache is set, and it can be automatically deleted when the hotspot data expires; when the quantity of hotspot data reaches a preset value, then While setting the expiration time, you can also manage the hotspot data in the hotspot cache according to certain rules, for example, delete the preset number of hotspot da...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a hot spot data storage method and a terminal. The method comprises the following steps of judging whether hot spot data exist in data in a common cache or not by counting therequested access frequency of the data in the common cache; if so, slowly storing the hotspot data to different nodes in a hotspot cache, so as to find hot spot data in time. Different from the priorart in which data is only stored in one node, the hotspot data are stored in different nodes in the hotspot cache, balanced access of the hotspot data is achieved through redistribution of the hotspotdata storage positions, the access pressure of the hotspot data can be reduced, the downtime condition caused by a large amount of access to the same data in a short time is avoided, the performancebottleneck problem is effectively relieved, and the data access efficiency is improved.

Description

technical field [0001] The invention relates to the technical field of the Internet, in particular to a storage method and a terminal for hotspot data. Background technique [0002] When developing a high-concurrency system, caching, degradation, and current limiting are usually used to protect the system. In some scenarios, the use of caching can greatly reduce the pressure on the system and improve the throughput of the system interface. There are two ways to implement caching. One is a clustered unified cache, such as redis cluster, memchche cluster cache, etc. The relevant information is placed in the cluster cache uniformly, and each project reads information from the cluster cache; the other is Local caching refers to directly caching information with a small amount and occupying less memory resources locally. [0003] Many systems use single-point redis or cluster redis to store a large amount of cached data information. However, whether it is a cache collection comp...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/2455G06F16/22
Inventor 刘德建林伟郭玉湖
Owner FUJIAN TIANQUAN EDUCATION TECH LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com