A storage method for supporting double-dimension query of mass monitoring data

A monitoring data, two-dimensional technology, applied in the storage field that supports two-dimensional query of massive monitoring data, can solve problems such as unsatisfactory

Active Publication Date: 2019-05-10
HENAN SPLENDOR SCI & TECH
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, the commonly used relational databases are stored in the

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A storage method for supporting double-dimension query of mass monitoring data
  • A storage method for supporting double-dimension query of mass monitoring data
  • A storage method for supporting double-dimension query of mass monitoring data

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0016] A storage method that supports two-dimensional query of massive monitoring data, used to store historical data collected by industrial monitoring systems, including:

[0017] Create a data file group and an index file; the data file group includes several data files arranged in chronological order; each data file includes several data blocks, and the data block is divided into several sub-data blocks by collection points; a sub-data file The data block stores the historical data of a collection point for a period of time, and each sub-data block is stored in the data block in order of ID.

[0018] Obtain the historical data of the acquisition equipment, and store the historical data in the same data block; wherein, abstract the acquired equipment into analog data or state data; the analog data includes open state data and analog data , the state quantity data includes the contact state of the relay, the color information displayed by the signal lamp, etc., which can be ...

Embodiment 2

[0039] The difference between this embodiment and Embodiment 1 is that: the index file includes an index file header, the number of file directory entries and several file directory entries;

[0040] A file directory entry corresponds to describe the start time, start record number, end time and end record number of a data file.

[0041] The index file describes the data in multiple data files, and describes the start and end time of the data in each data file. When querying data, first search the data file according to the content of the index file, which can avoid traversing the data file and speed up the search.

[0042]

[0043] The data file includes: a file header, a directory block, and a data block. The entire data file includes a file header, a directory block and a data block, wherein there is only one file header, which is located at the file header and has a fixed size. One directory block describes the data information of multiple data blocks, and the number ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a storage method supporting double-dimension query of mass monitoring data. The storage method is used for storing and querying historical data when an industrial monitoring system collects data in real time. The storage method comprises the following steps: creating a data file group and an index file; wherein the data file group comprises a plurality of data files arrangedaccording to a time sequence; wherein each data file comprises a plurality of data blocks, and each data block is divided into a plurality of sub-data blocks according to collection points; wherein each sub-data block is stored according to the ID sequence of the collection points and simultaneously stores the directory and index information of the data points; Storing the historical data collected within a period of time in the same data block of the data file; and the index file records time information of data in the data file. The storage mode has the advantages of supporting double-dimension query and being efficient in retrieval.

Description

technical field [0001] The invention relates to the technical field of massive monitoring data storage and query, and specifically relates to a storage method supporting two-dimensional query of massive monitoring data. Background technique [0002] The centralized railway signal monitoring system needs to convert the collected state quantity data and analog quantity data into floating point numbers and integers for storage. However, there are many channels to be collected, usually ranging from thousands to tens of thousands of channels; and the collection period is short, usually about 1 second, and sometimes it may be shorter. Then, the amount of collected data is very large, up to trillions of pieces of data a year, which puts forward high requirements for the storage and subsequent query of collected data. [0003] At present, the centralized railway signal monitoring system needs to query the stored historical data from two different dimensions, namely: (1) From the di...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F16/14G06F16/13
Inventor 张鲲鹏刘伟石成
Owner HENAN SPLENDOR SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products