Hierarchical storage and migration method of industrial real-time data

Abstract

The invention provides a hierarchical storage and migration method and system of industrial real-time data. The method comprises the following steps: monitoring a hierarchical storage system in fixed time, and triggering data migration calculation after the storage volume use ratio of advanced storage equipment achieves a first preset threshold value; during migration, firstly, carrying out value assessment on each data object in the storage equipment to obtain the value of each data object and sort the data object according to the value; and according to sorting, setting a migration strategy, picking up the data object to be migrated, and forming and migrating a migration queue. The method and the system set the migration strategy according to different storage equipment priorities and the value sorting of the current data objects, wherein value calculation considers a time factor, number of access users, other data object situations associated with the data object, the access contrast ratio of different storage equipment and the own size of the data object, and the time factor, the number of access users, other data object situations associated with the data object, the access contrast ratio of different storage equipment and the own size of the data object affect data object migration efficiency. The method improves data value judgment accuracy.

Description

technical field

[0001] The invention relates to the technical field of data access and storage processing, in particular to a method for hierarchical storage and migration of industrial real-time data. Background technique

[0002] With the expansion of the scale of industrial systems and the continuous development of automation information technology, the application of massive data in industrial automation systems has led to a sharp increase in the number of concurrent accesses to distributed file systems, and the pressure to read and write files must be considered. system bottleneck. At the same time, many applications in process control have high requirements for real-time data. Considering that the performance and cost of different storage devices are different, and data access has time and space locality, hierarchical storage is required, so that frequently accessed data tends to be stored in high-performance devices, and is not frequently read and written in the most...

Images