Combined query cache establishment method and system for time series data, combined query cache method and system for time series data

A time series, time data technology, applied in memory systems, electrical digital data processing, special data processing applications, etc., can solve problems such as low efficiency of time series data

Inactive Publication Date: 2016-07-27
SHANGHAI CTRIP COMMERCE CO LTD
View PDF4 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] The object of the present invention is to provide a method and system for establishing a combined query cache of time series data, a method and system for a combined query cache of time series data, which can establish an efficient and high-performance query cache for time series data, which can be used when querying When caching, the cache hit rate and system storage requirements are significantly improved to solve the problem of low efficiency of the existing general-purpose key / value cache system in processing time series data

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Combined query cache establishment method and system for time series data, combined query cache method and system for time series data
  • Combined query cache establishment method and system for time series data, combined query cache method and system for time series data
  • Combined query cache establishment method and system for time series data, combined query cache method and system for time series data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0037] Such as figure 1 As shown, the metadata of Query takes QueryPattern as an organizational unit, and there are two files in the storage unit of a query result (here and in the subsequent expressions of this article, the files can be stored on the disk, or a section in the memory. Structured data), the first file is a unique identification file (file 1), which is used to store the TimeSeriesKey of all TimeSeries in the Query result, and the second file is the query time range file (file 2), which is used to store the QueryTimeRange of the Query Information collection, such as Query is to query the information from 3 o’clock to 5 o’clock, then after it is cached, add a record [3,5] to the time information file of this Query, indicating that this Query has a cache from 3 o’clock to 5 o’clock, then download Second, if you query the data from 1 o'clock to 6 o'clock, the data between 3 o'clock and 5 o'clock can be obtained from the cache.

[0038] Such as figure 2 As shown, ...

Embodiment 2

[0051] Such as Figure 4 As shown, the present invention also provides a method for combined query caching of time series data, including:

[0052] Step S21, when inquiring from the cache whether the current query has a corresponding query result, first locate the storage unit of the corresponding query result according to the query keyword of the current query;

[0053] Step S22, judging whether all or part of the query time range of the current query is included in the query time range file of the storage unit of the query result, if yes, then go to step S23, if not, then go to step S24;

[0054] Step S23, obtaining the unique identifier corresponding to all or part of the included query time range of the current query from the unique identifier file of the storage unit of the query result, and locating the corresponding time series data according to the unique identifier The storage unit, from the query time range file of the storage unit of time series data, obtains the t...

Embodiment 3

[0059] Such as Figure 7 As shown, the present invention also provides another system for establishing a combined query cache of time series data, including a first positioning module 11 , a first judging module 12 , a second positioning module 13 and a checking module 14 .

[0060] The first positioning module 11 is configured to locate the storage unit of the time series data according to the unique identifier of each time series data in the query results when a certain query result obtained according to the query keywords is written into the cache.

[0061]The first judging module 12 is used to judge for each storage unit of time series data whether all or part of the query time range of the query result is not included in the query time range file in the storage unit of time series data , if all or part of it is not included, write all or part of the query time range that is not included in the query time range file of the storage unit of the time series data, and then wri...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides an establishment method, method and system for a time series data combined query cache. Relative to a general key / value cache, the time series data combined query cache established by the establishment method, method and system comprises a storage unit of time series data and a storage unit of query results, wherein the storage unit of the time series data comprises a time data set file and a query time range file, and the storage unit of the query results comprises a unique identification file and a query time range file. The combined query cache has two remarkable improvements regarding to the processing of the time series data: firstly, the hit rate of the cache is remarkably improved, and due to the fact that the combined query cache can identify hit of a part of time intervals, query pressure of a back end storage system is obviously reduced; secondly, storage capacity of a caching system is obviously reduced, and data redundancy in storage is completely eliminated due to the facts that the storage particle size of data in the combined query cache is small and metadata information is rich.

Description

technical field [0001] The invention relates to the design of combined query cache of time series data, in particular to a method and system for establishing a combined query cache of time series data, and a method and system for combined query cache of time series data. Background technique [0002] Traditional caching systems, such as Squid, are based on key / value matching. A key corresponds to a value. When there is any change in the key, the cache will not be hit, and the association between keys and values ​​​​is not considered. Therefore, currently There is an urgent need for a method and system for establishing a combined query cache for time series data based on the correlation between keys and values ​​based on the characteristics of time series data, and a method and system for combining query cache for time series data to significantly improve the cache. Hit ratio and system storage requirements. Contents of the invention [0003] The object of the present inve...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F17/30G06F12/08G06F12/0866G06F12/0802
Inventor 李欣张勇江伟李东泽
Owner SHANGHAI CTRIP COMMERCE CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap