Data storage control method and device, equipment and storage medium

Abstract

An embodiment of the invention discloses a data storage control method, a data storage control device, equipment and a storage medium. The data storage control method comprises the steps of: when to-be-stored target data is received, acquiring at least one item of data attribute information matched with the target data according to at least one preset filtering type; processing the data attributeinformation by adopting a filtering processing rule matched with the filtering type to generate a filtering comparison identifier matched with the target data; judging whether the filtering comparisonidentifier is stored in a pre-established identifier database or not; if so, performing data filtering on the target data; otherwise, storing the target data in a target database, and updating the identifier database according to the filtering comparison identifier. According to the data storage control method and the data storage control device of the invention, massive data can be cleaned according to user requirements, and meanwhile, the data is filtered before being stored in the database, so that IO resources are saved, and data storage control performance is improved.

Description

technical field [0001] Embodiments of the present invention relate to data processing technologies, and in particular, to a data storage control method, device, device, and storage medium. Background technique [0002] With the development of the Internet and various acquisition devices, more and more things in the real society can form a huge network with the Internet by collecting the required information such as sound, light, image, and location in real time. This giant network is called for the Internet of Things. [0003] Due to the characteristics of the Internet of Things, it is easy to generate a large amount of data in a short period of time during the data collection process. If the data generated in the Internet of Things is stored in the database of the server, it will occupy a large amount of storage resources. At the same time, the above data has the disadvantages of data redundancy and high repetition. In view of this, it is necessary to clean the data in ord...

AI Technical Summary

Problems solved by technology

If the data generated in the Internet of Things is stored in the database of the server, it will occupy a large amount of storage resources. At the same time, the above data has the disadvantages of data redundancy and high repetition. In view of this, it is necessary to clean the data in order to effectively use the Internet of Things. information

[0004] The traditional data storage control method is to store the IoT data in the database, and then perform data storage control based on preset cleaning rules. This process includes a large number of I / O operations, and all data needs to be stored in the database in advance. The cleaning operation can only be performed, which takes up a large amount of storage resources, resulting in inefficiency in data storage control and performance degradation of the database server

Images