Data processing method and device

Abstract

The invention discloses a data processing method and device. The method comprises the following steps: calling a preset database abstract interface, and accessing a preset K-V type database; calling apreset database index interface to obtain an operation command sent by an external application; and calling a preset file system interface, and triggering a preset Linux file system to arrange storage units in the K-V type database and execute the operation command, wherein the storage format of data in the K-V type database is a key value pair, the values of the key value pairs are used for storing data entries, keys are used for recording timestamps of the data entries, the timestamps indicate storage moments of the data entries, each data entry is packaged in a storage unit in the form ofa data unit, and the storage date of each data entry in the storage unit is consistent with the creation date of the storage unit. Based on the data processing method provided by the invention, the K-V type database can completely replace a time sequence database, and the requirements of embedded Linux data acquisition equipment on a local database are met.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a data processing method and device. Background technique [0002] Embedded Linux data acquisition equipment, in practical applications, there is a need to store the collected data locally, for example, the common long-distance public network transmission or wireless transmission in the oil and gas gathering and transportation industry, but the network is unstable or unexpectedly interrupted In some cases, the data acquisition equipment cannot transmit the collected data to the data center for the time being, and the collected data needs to be stored locally. Therefore, a local database that provides a storage environment for data acquisition equipment emerges as the times require. Since the collected data is basically a time-continuous digital or analog quantity, the time when the data is generated is usually recorded by a timestamp. Therefore, the local database th...

AI Technical Summary

Problems solved by technology

However, limited by network communication resources, the efficiency of reading and writing data to the database will be very low

[0005] 2. Provide too many complex functions (for example, data redundancy function, and data rollback function), however, the functions required by embedded Linux application scenarios are relatively simple (mainly adding, deleting, modifying or checking data) , therefore, the overall design of the database is too bloated, which will cause a lot of waste of resources

However, the computing resources of the CPU, RAM, and FLASH inside the data acquisition device are limited, and there are no conditions for developing or adapting these runtime libraries.

[0007] In summary, the existing time-series database cannot meet the needs of embedded Linux data acquisition equipment for local databases.

Images