Data Formatting and File Storage Method Based on Real-time Acquisition Data Characteristics

Abstract

The invention relates to a data formatting and file storage method based on real-time acquired data characteristics. The data formatting and file storage method comprises the following steps: (1) establishing a unified data storage rule based on acquired data characteristics; (2) establishing an acquired data formatting mechanism based on a time slicing mode; (3) establishing an acquired data read-write management mechanism based on file blocking and multilevel index; (4) establishing an acquired data read-write event mechanism; (5) unifying a data access interface of the acquired data. Compared with the prior art, the data formatting and file storage method has the function of unifying access modes of various acquired data, data access performance can be improved by reducing the number of stored files, reducing the storage space consumption, reducing system IO consumption, and the like, and meanwhile the time length of historical data storage can be increased, so that the overall usability of the system can be improved.

Description

technical field [0001] The present invention relates to a railway signal system, in particular to a data formatting and file storage method based on real-time collected data characteristics, through which the storage and access methods of various collected data are unified, and the number of stored files and the consumption of storage space are reduced. Increase the historical time length of collected data storage, improve data storage and query performance, thereby improving the overall availability of the system. Background technique [0002] Acquisition data storage is the basic function of monitoring systems. The traditional collection data storage method adopts different processing methods for various collection data, resulting in inconsistent data access methods, which increases the difficulty and cost of upper-level development of the system; in addition, traditional data storage The method adopts the method of dividing files according to time or data identification f...

AI Technical Summary

Problems solved by technology

[0002] Acquisition data storage is the basic function of monitoring systems. The traditional collection data storage method adopts different processing methods for various collection data, resulting in inconsistent data access methods, which increases the difficulty and cost of upper-level development of the system; in addition, traditional data storage The method adopts the method of dividing files according to time or data identification for high-frequency large-scale collection of data, which leads to excessive data files and increasing disk fragments, which eventually leads to system performance degradation; at the same time, the traditional data storage method adopts the non-differential full record method, even in the It also consumes a lot of storage space when the collected data does not change, making it impossible to store historical data for a long time

Images