A kind of data record storage method

Abstract

The invention discloses a method for storing data records. The steps include: 1) when receiving a data packet to be stored, assigning continuous codes to various data contents representing different meanings in the data packet to be stored; 2) judging whether the data packet to be stored is is the first data packet received, if it is, record and store each data content in the data packet to be stored and the corresponding code in sequence; if not, go to step 3); 3) combine the data packet to be stored with the received Each item of data content in the last data packet received is compared in turn according to the corresponding code, and is recorded and stored according to the comparison result; when each item is compared, if the comparison result is within the preset range, the record is not stored; Otherwise, record and store the corresponding data content and encoding. The invention can reduce the record storage of the same content data, and has the advantages of simple storage implementation, less storage space occupation, high storage efficiency and easy realization of data restoration.

Description

technical field [0001] The invention relates to the technical field of real-time data collection and storage, in particular to a data record storage method suitable for real-time data storage. Background technique [0002] At present, in real-time data collection and storage, the record storage of data packets is usually completely stored in the order of the original content. For example, when data packet 1, data packet 2, data packet 3... are received in sequence, they are finally stored as data packets in sequence 1. Data packet 2, data packet 3..., and each data packet is a complete original data packet. In the process of real-time data collection, there are often a lot of duplicate content between data packets, and there is a large correlation between data packets. If the above record storage method is used, it will result in a large number of records of the same data content, thus consuming too much memory. space, resulting in a waste of storage space. [0003] At pre...

AI Technical Summary

Problems solved by technology

In the process of real-time data collection, there are often a lot of duplicate content between data packets, and there is a large correlation between data packets. If the above record storage method is used, it will result in a large number of records of the same data content, thus consuming too much memory. space, resulting in a waste of storage space

[0003] At present, some practitioners have proposed to use duplicate data judgment to remove duplicate data to solve the problem of duplicate recording of the same data. However, on the one hand, the duplicate data judgment and storage process of this kind of scheme are more complicated, which increases the complexity of data storage. Affects storage efficiency and is not easy to achieve data restoration; on the other hand, this type of scheme is usually based on repeated judgments of the data itself, and the same data may have completely different meanings, while in real-time data collection, the meaning of the data corresponds to the required collection. important information content, so this type of solution is not suitable for the collection and storage of real-time data

Images