Unlock instant, AI-driven research and patent intelligence for your innovation.

Data acquisition method and system

A data acquisition and data technology, applied in the information field, can solve problems affecting the cache hit rate and increase the pressure of real-time query database, so as to improve the cache hit rate, reduce the pressure of back-to-source query database, and improve business performance.

Active Publication Date: 2022-07-05
SUNING CLOUD COMPUTING CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing caching strategy, the caching time is fixed, and the latest data can only be retrieved when the time is up. That is to say, no matter how you request during the caching period, the obtained data will always be the same. Such data cannot be changed in real time. Update, and in order to ensure a fast data update speed, the cache time is often sacrificed to obtain the latest data faster, so that the pressure on the back-end real-time database search will increase, affecting the cache hit rate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition method and system
  • Data acquisition method and system
  • Data acquisition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] figure 1 is the flow chart of the data acquisition method provided in Embodiment 1 of the present invention, such as figure 1 As shown, the data acquisition method includes the following steps:

[0042] 101. The front end sends the user data request to the proxy server.

[0043] Specifically, the user sends a user data request from the front end, and then the front end sends the user data request to the proxy server of the reverse proxy layer. The front-end here only refers to the user's local page, which only needs to initiate a data request, that is, the local cache. The cache data layer can adopt varnish, Memcache, redis or any other possible technical solutions in the prior art. The embodiment of the present invention does not It is specifically limited. In addition to nginx, the proxy server of the reverse proxy layer can also use other web servers, such as Apache, IIS, Nginx, Resin, Tomcat, etc., or use any other possible proxy servers in the prior art, which a...

Embodiment 2

[0055] figure 2 is the flow chart of the data acquisition method provided in Embodiment 2 of the present invention, such as figure 2 As shown, the data acquisition method includes the following steps:

[0056] 201. The front end sends the user data request to the proxy server.

[0057] Specifically, the user sends a user data request from the front end, and then the front end sends the user data request to the proxy server of the reverse proxy layer. Here, the front end includes a cache server, that is, a local cache, and the cache data layer may adopt varnish, Memcache, redis, or any possible technical solution in the prior art, which is not particularly limited in the embodiment of the present invention. In addition to nginx, the proxy server of the reverse proxy layer can also use other web servers, such as Apache, IIS, Nginx, Resin, Tomcat, etc., or use any other possible proxy servers in the prior art, which are not particularly limited in the embodiment of the presen...

Embodiment 3

[0068] image 3 It is a schematic diagram of the composition of the data acquisition system provided in Embodiment 3 of the present invention, such as image 3 As shown, the data acquisition system provided by the embodiment of the present invention includes a front end 31, a proxy server 32, a cache server 33 and a back end 34. The front end 31 sends a user data request to the proxy server 32; Request the current data version number of the corresponding data, preferably splicing the current data version number with the user data request to generate a new data acquisition request, wherein the current data version number is generated according to the backend 33 data update; preferably, the cache server 33 parses the data acquisition request, obtains the current data version number, determines whether there is data corresponding to the current data version number, and directly acquires the corresponding data from the cache server 33 if the determination result is yes.

[0069] ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data acquisition method and system, belonging to the field of information technology. The method includes: the front end sends a user data request to a proxy server; the proxy server generates a new data acquisition request according to the user data request and the current data version number of the data corresponding to the user data request, wherein the current data acquisition request is The data version number is generated after the back-end data is updated; the cache server determines whether there is data corresponding to the current data version number, and if the determination result is yes, directly obtains the corresponding data from the cache server. The data acquisition method and system provided by the present invention ensure faster data update, reduce the pressure of back-to-source database checking, thereby improving the cache hit rate and at the same time ensuring a sufficiently long cache time.

Description

technical field [0001] The invention relates to the field of information technology, in particular to a data acquisition method and system. Background technique [0002] At present, in order to reduce the number of source searches, most systems use caching technology, so that most data requests do not penetrate back to the source, and data with a small change rate can be obtained. It is generally used in scenarios where data accuracy is not high. The specific method is generally based on redis, varnish, cdn, etc. to passively cache for a certain period of time, thereby reducing the data pressure of real-time database query on the backend. [0003] In the existing caching strategy, the caching time is fixed, and the latest data can be retrieved only when the time is up. That is to say, no matter how the request is made during the caching period, the retrieved data will always be the same, and such data cannot be changed in real time. Update, and in order to ensure fast data ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): H04L67/568H04L67/63
CPCH04L67/568H04L67/63
Inventor 赵超陆磊汪少俊周文兵
Owner SUNING CLOUD COMPUTING CO LTD