Time series data storing and querying method and storing and processing platform

A time-series data and database technology, applied in the database field, can solve problems such as slow writing and reading speed, inability to store and data, performance and scale difficult to meet user requirements, etc., and achieve the effect of increasing the writing speed

Active Publication Date: 2018-08-14
BEIJING DAZHONG YIKANG TECH
View PDF8 Cites 21 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] At present, for the storage and processing of time series data, relational databases are usually used for processing, but due to the inherent disadvantages of relational databases, they cannot perform efficient storage and data query, especially when storing massive time series data. Common shortcomings such as high data redundancy and slow writing and reading speed
In addition, the emerging NoSQL non-relational database is not customized for time series data, and it is difficult to meet user requirements in terms of performance and scale

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Time series data storing and querying method and storing and processing platform
  • Time series data storing and querying method and storing and processing platform
  • Time series data storing and querying method and storing and processing platform

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0031] Such as figure 1 As shown, it is a schematic flowchart of a method for storing time series data provided by an embodiment of the present invention. The method is applied to a database, and the database includes index files and data files. figure 1 It can be seen that the steps of the method for storing time series data include:

[0032] Step S101: Receive time series data to be stored and compress to obtain compressed time series data.

[0033] First, the database receives the time series data to be stored and the compression algorithm identification of the time series data to be stored. The compression algorithm identification is selected by the user according to the user's own needs and sent to the database.

[0034]Second, compare the compression algorithm identifier with the algorithm identifier corresponding to the compression function in the database. Here, the interface definition of the time series data compression and decompressor: ICompressor is defined in ...

Embodiment 2

[0062] The embodiment of the present invention also provides a query method for time series data, which is applied to a database, such as image 3 As shown, it is a schematic flowchart of a time series data query method provided by an embodiment of the present invention, which is represented by image 3 It can be seen that the query method of the time series data includes the following steps:

[0063] Step S301: Receive a query request from a client.

[0064] Step S302: Analyze the time range of the query request, and search the index file for index entries with timestamps within the time range.

[0065] The time range of the query request includes the start time and end time of the request. Considering the monotonically increasing nature of time series data timestamps, the timestamps stored in the index file are naturally ordered, and a simple dichotomy can be used for searching. It has the simplicity of implementation and the efficiency of query.

[0066] Step S303: Find ...

Embodiment 3

[0080] The embodiment of the present invention also provides a method for storing, querying and processing time series data.

[0081] First, a time series data platform system is deployed on a computer server, through which the interactive communication between the server and the application program can be realized. Such as Figure 4 As shown, it is a schematic diagram of a time series data transmission process provided by the embodiment of the present invention, which is represented by Figure 4 It can be seen that the application program sends time series data to the database platform through various channels (TCP, named pipe, HTTP, etc.). For application developers, they only need to select the corresponding implementation call, and do not need to deal with the technical details of the channel by themselves, which fully improves the developer's efficiency and saves development time. At the same time, application developers can also expand with multiple systems and customi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a time series data storing and querying method and a storing and processing platform, and relates to the technical field of databases. The time series data storing and queryingmethod and the storing and processing platform are applied to a database, and the database comprises an indexing file and a data file. The time series data storing method comprises the following steps: receiving time series data to be stored and compressing the time series data to obtain compressed time series data; writing the compressed time series data to the tail of a data file; determining the offset, timestamp and data length of the compressed time series data; and when the compressed time series data are written successfully, constructing an index entry according to the timestamp, offset and data length, and writing the index entry to the tail of an index file. An embodiment of the invention aims to provide the time series data storing and querying method and the storing and processing platform so as to rapidly store, query and process a bulk of time series data, and time series database service which is high in disaster tolerance ability, convenient to use and efficient is provided.

Description

technical field [0001] The invention relates to the technical field of databases, in particular to a storage and query method and a storage and processing platform for time series data. Background technique [0002] With the development of information technology, more and more data are generated by various industries or applications, and the generation speed is getting faster and faster. As a very important kind of data, time series data has more and more requirements for the storage and query of time series data. high. Time series data refers to time series data. Time series data are columns of data recorded in chronological order for the same unified metric. Each data in the same data column must be of the same caliber, requiring comparability. Time series data can be period numbers or time points. Time series data is mainly collected and generated by various types of real-time monitoring, inspection and analysis equipment in the power industry, chemical industry, etc....

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/30
CPCG06F16/2474
Inventor 王晋平杜磊
Owner BEIJING DAZHONG YIKANG TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap