Distributed caching mechanism for multi-source heterogeneous electronic commerce big data

A multi-source heterogeneous, high-speed caching technology, applied in electrical digital data processing, memory systems, instruments, etc., can solve problems such as expanding servers and implementing difficulties, saving resources, improving cache response speed, and reducing load.

Inactive Publication Date: 2017-03-22
杭州数强网络科技有限公司
View PDF7 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this case, a single server or a few servers are far from meeting the processing requirements of these data, and the situation cannot be changed by simply improving the server performance, so the only possible way is to expand the scale of the server
There are usually two methods for server scale expansion: one is to still use the relational database, and then deploy the entire database to a cluster by vertically and horizontally cutting the database. The advantage of this method is that it can use relational database (RDBMS ) technology, but the disadvantage is that it is very difficult to implement for specific applications; another method is the method adopted by Google and Amazon, which abandons relational databases and uses Key-Value storage, which can greatly enhance the system’s scalability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Distributed caching mechanism for multi-source heterogeneous electronic commerce big data
  • Distributed caching mechanism for multi-source heterogeneous electronic commerce big data
  • Distributed caching mechanism for multi-source heterogeneous electronic commerce big data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0027] The present invention will be further described below in conjunction with the accompanying drawings and specific embodiments.

[0028] Such as figure 1 As shown, a distributed caching mechanism for multi-source heterogeneous e-commerce big data specifically includes the following steps:

[0029] 101 Generate a key-value pair, and generate a key-value pair to be read by the multi-level cache;

[0030] 102 calls the thread cache, after step 101, when the system wants to call the corresponding data, it first executes the thread cache to search the corresponding key-value pair to obtain the corresponding data;

[0031] 103 call the virtual machine cache, if the corresponding key-value pair cannot be found in step 102, then search in the virtual machine cache, if find existing data in the virtual machine cache, then decide to update the thread cache according to the cache mechanism;

[0032] 104 call the cluster cache, if the corresponding key-value pair cannot be found in...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention puts forward a distributed caching mechanism for multi-source heterogeneous electronic commerce big data. The distributed caching mechanism comprises three levels of cache locations which are respectively a thread cache, a virtual machine cache and a cluster cache; along with the raising of a hierarchy, cache access efficiency is lowered, maintenance cost is increased, a cache capacity is increased, ability for providing cache service is higher, cache layering can further improve cache response speed, and system resources are saved.

Description

technical field [0001] The invention belongs to the technical field of computer caching, and in particular relates to a distributed caching mechanism for multi-source heterogeneous e-commerce big data. Background technique [0002] With the continuous application of mobile Internet, Internet of Things, cloud computing and other emerging information technologies in the field of e-commerce, the global data volume is showing an unprecedented explosive growth trend. At the same time, complex features such as the diversity of data types and sources, the real-time nature of data generation and analysis, and the low value density of data are becoming increasingly prominent. E-commerce big data is generated in real time along with the behavior of consumers and enterprises, and is widely distributed on e-commerce platforms, social media, smart terminals, internal systems of enterprises and other third-party service platforms. There are various types of e-commerce data, including con...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F12/0806
CPCG06F12/0806
Inventor 龚一峰殷章华
Owner 杭州数强网络科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products