Second level method and device and computer readable storage medium

A secondary cache and cache technology, applied in the field of big data, can solve problems such as large impact on problems, online connections, low available capacity of occupied application memory, etc., and achieve the effect of efficient query and efficient storage

Pending Publication Date: 2020-01-10
CHINA PING AN PROPERTY INSURANCE CO LTD
View PDF0 Cites 22 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] At present, the popular cache in the industry is divided into two types: in-process cache and out-of-process cache. The in-process cache includes Ehcache / guava cache, etc. The application allows the same JVM memory, but the main disadvantage is that the available memory capacity of the application is low, which limits the throughput of the application. , updates consume resources and do not support inter-app sharing
The commonly used out-of-process cache is memcached. The main disadvantage is that it is shared by multiple applications. If there is a problem, it will have a huge impact, and if the number of connections goes online, there will be contention for high-concurrency hotspot data.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Second level method and device and computer readable storage medium
  • Second level method and device and computer readable storage medium
  • Second level method and device and computer readable storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0037] The invention provides a secondary cache method. refer to figure 1 As shown, it is a schematic flowchart of a secondary cache method provided by an embodiment of the present invention. The method may be performed by a device, and the device may be implemented by software and / or hardware.

[0038] In this embodiment, the secondary cache method includes:

[0039] S1. Obtain an original data set obtained from a webpage, and divide the original data set into high-frequency data, common data, and fuzzy data according to preset rules.

[0040] In a preferred embodiment of the present invention, the original data set is obtained by crawling from webpages through crawler technology. Wherein, the crawler refers to a program or script that automatically grabs information on the World Wide Web according to certain rul...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to a big data technology, and discloses a second-level caching method, which comprises the following steps: obtaining an original data set obtained from a webpage, and dividing the original data set into high-frequency data, common data and fuzzy data; creating a first-level cache in a local process, and storing the high-frequency data into the first-level cache; building a common second-level cache outside the local process, and storing the common data into the common second-level cache; constructing a fuzzy secondary cache outside a local process, and storing the fuzzydata into the fuzzy secondary cache; and receiving a query command input by a client, performing data query on the query command according to the first-level cache, the common second-level cache and the fuzzy second-level cache, and returning a query result to the client. The invention further provides a second-level caching device and a computer readable storage medium. According to the second-level caching method, efficient storage and query of data are realized.

Description

technical field [0001] The present invention relates to the technical field of big data, in particular to a secondary cache method, device and computer-readable storage medium based on in-process + out-of-process. Background technique [0002] At present, the popular cache in the industry is divided into two types: in-process cache and out-of-process cache. The in-process cache includes Ehcache / guava cache, etc., and its application allows the same JVM memory. The main disadvantage is that the available memory capacity of the application is low, which limits the throughput of the application. , updates consume resources and do not support sharing between apps. The commonly used out-of-process cache is memcached. The main disadvantage is that it is shared by multiple applications. If there is a problem, it will have a huge impact, and if the number of connections goes online, there will be contention for high-concurrency hotspot data. Contents of the invention [0003] The...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/957G06F16/2455G06F12/0897
CPCG06F12/0897G06F16/24552G06F16/9574G06F2212/154G06F2212/163
Inventor 张帆李小广陈镇文
Owner CHINA PING AN PROPERTY INSURANCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products