Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A hierarchical storage method based on hot and cold classification of time series data

A time-series data and hierarchical storage technology, applied in the input/output process of data processing, electrical digital data processing, instruments, etc., can solve the problem that only supports floating-point values, the time accuracy is only up to seconds, and no solution is proposed, etc. problems, to achieve the effect of maximizing storage space, maximizing utilization, and reducing costs

Active Publication Date: 2021-04-30
北京航天云路有限公司
View PDF7 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, there are some limitations in Beringei, such as only supporting floating-point values, the time precision is only up to seconds, and data can only be written in timestamp order
At the same time, since all data is cached in memory, the cost is high
[0004] For the problems in related technologies, no effective solutions have been proposed yet

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A hierarchical storage method based on hot and cold classification of time series data
  • A hierarchical storage method based on hot and cold classification of time series data
  • A hierarchical storage method based on hot and cold classification of time series data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0015] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments are only some, not all, embodiments of the present invention. All other embodiments obtained by persons of ordinary skill in the art based on the embodiments of the present invention belong to the protection scope of the present invention.

[0016] Such as Figures 1 to 5 As shown, a hierarchical storage method based on hot and cold classification of time series data according to an embodiment of the present invention includes the following steps:

[0017] S1 Establish a UID system, and use UID to uniformly identify time series data;

[0018] S2 divides the data into real-time data, weekly data, historical data and cold data through specific time rules, and establishes real-time data layer, weekly data layer, historical data lay...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a hierarchical storage method based on time series data cold and hot classification, comprising the following steps: establishing a UID system, using the UID to uniformly identify the time series data; dividing the data into real-time data, weekly Data, historical data, and cold data, establish a real-time data layer, weekly data layer, historical data layer, and cold data layer, which are stored in memory, SSD storage hard disk, HDD storage hard disk, and distributed storage system HDFS in turn; establish a unified Data insertion and query interfaces route query requests to their respective storage query interfaces through the query time range, providing different storage access for different data. Beneficial effects: By storing data with different access frequencies in a hierarchical manner, the storage space is maximized, query performance is ensured, and costs are also reduced.

Description

technical field [0001] The present invention relates to the field of industrial internet of things, in particular to a hierarchical storage method based on hot and cold classification of time series data. Background technique [0002] Time is an important feature of time-series data. The more recent data, the more users pay attention to it, and the more queries are made. It belongs to hot data. The storage of this part of data needs to support high-concurrency and low-latency interactive queries, so higher storage is required. Cost; the longer the data is queried, the less it is, and it is cold data. These data are not as sensitive to the query delay as interactive scenarios, and have lower requirements for the read and write performance of the storage medium. According to the characteristics of time-series data storage, hierarchical storage will be a method to balance cost and performance. [0003] Beringei is an in-memory time-series database open sourced by Facebook. Ber...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0607G06F3/0629G06F3/0674
Inventor 徐汕单酉刘强黄文峰童奥姜桥
Owner 北京航天云路有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com