Unlock instant, AI-driven research and patent intelligence for your innovation.

Data acquisition method and system

A data acquisition and data technology, applied in the information field, can solve the problems affecting the cache hit rate and increase the pressure of real-time database search, so as to improve the cache hit rate, reduce the pressure of back-to-source database search, and ensure the cache time.

Active Publication Date: 2019-12-31
SUNING CLOUD COMPUTING CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] In the existing caching strategy, the caching time is fixed, and the latest data can only be retrieved when the time is up. That is to say, no matter how you request during the caching period, the obtained data will always be the same. Such data cannot be changed in real time. Update, and in order to ensure a fast data update speed, the cache time is often sacrificed to obtain the latest data faster, so that the pressure on the back-end real-time database search will increase, affecting the cache hit rate

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data acquisition method and system
  • Data acquisition method and system
  • Data acquisition method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0041] figure 1 It is a flow chart of the data acquisition method provided by Embodiment 1 of the present invention, such as figure 1 As shown, the data acquisition method includes the following steps:

[0042] 101. The front end sends the user data request to the proxy server.

[0043] Specifically, the user sends a user data request from the front end, and then the front end sends the user data request to the proxy server of the reverse proxy layer. The front end here only refers to the user's local page, and only needs to initiate a data request, that is, local cache. The cache data layer can use varnish, Memcache, redis or any possible technical solution in other existing technologies. The embodiment of the present invention is not correct. It is specifically limited. The proxy server of the reverse proxy layer can also use other web servers, such as Apache, IIS, Nginx, Resin, Tomcat, etc., except nginx, or use any other possible proxy servers in the prior art, and the ...

Embodiment 2

[0055] figure 2 It is a flow chart of the data acquisition method provided by Embodiment 2 of the present invention, such as figure 2 As shown, the data acquisition method includes the following steps:

[0056] 201. The front end sends the user data request to the proxy server.

[0057] Specifically, the user sends a user data request from the front end, and then the front end sends the user data request to the proxy server of the reverse proxy layer. Here, the front end includes a cache server, that is, a local cache, and the cache data layer can adopt varnish, Memcache, redis or any other possible technical solution in the prior art, which is not particularly limited in the embodiments of the present invention. The proxy server of the reverse proxy layer can also use other web servers, such as Apache, IIS, Nginx, Resin, Tomcat, etc., except nginx, or use any other possible proxy servers in the prior art, and the embodiment of the present invention is not particularly lim...

Embodiment 3

[0068] image 3 It is a schematic diagram of the composition of the data acquisition system provided by Embodiment 3 of the present invention, such as image 3 As shown, the data acquisition system provided by the embodiment of the present invention includes a front end 31, a proxy server 32, a cache server 33 and a back end 34. The front end 31 sends the user data request to the proxy server 32; Request the current data version number of the corresponding data, preferably splicing the current data version number and the user data request to generate a new data acquisition request, wherein the current data version number is generated after updating the data according to the backend 33; preferably, the cache server 33 parse the data acquisition request, obtain the current data version number, judge whether there is data corresponding to the current data version number, if the judgment result is yes, directly obtain the corresponding data from the cache server 33 .

[0069] In ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a data acquisition method and system, and belongs to the technical field of information. The method comprises the steps that a front end sends a user data request to a proxy server; the proxy server generates a new data acquisition request according to the user data request and a current data version number of data corresponding to the user data request, and the current data version number is generated after the rear-end data is updated; and the cache server judges whether data corresponding to the current data version number exists or not, and if yes, the cache serverdirectly obtains the corresponding data from the cache server. According to the data obtaining method and system, it is guaranteed that data updating is fast, and the back-to-source library checking pressure is reduced, so the cache hit rate is increased, and meanwhile enough long cache time can be guaranteed.

Description

technical field [0001] The present invention relates to the field of information technology, in particular to a data acquisition method and system. Background technique [0002] At present, most systems use caching technology to reduce the number of source searches, so that most data requests will not penetrate back to the source, and you can get data with a small change rate, which is generally used in scenarios where data accuracy is not high. The specific method is generally based on redis, varnish, cdn, etc. to passively cache for a certain period of time, thereby reducing the data pressure of the back-end real-time query database. [0003] In the existing caching strategy, the caching time is fixed, and the latest data can only be retrieved when the time is up. That is to say, no matter how you request during the caching period, the obtained data will always be the same. Such data cannot be changed in real time. Update, and in order to ensure a fast data update speed, ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): H04L29/08
CPCH04L67/568H04L67/63
Inventor 赵超陆磊汪少俊周文兵
Owner SUNING CLOUD COMPUTING CO LTD