Migration speed control method and device for distributed object storage system and medium

Abstract

The invention discloses a hierarchical storage migration speed control method and device for a distributed object storage system and a computer readable storage medium. The method comprises the steps:calculating real-time time delay of a current period according to collected front-end user IO processing time delay data; calculating a matched time delay value based on the target set value of the front-end IO concurrent speed, and taking the time delay value as a reference time delay. According to a preset speed adjustment rule, a migration speed value of the cold and hot pool in the current period is calculated based on a numerical value relationship between the real-time time delay and the reference time delay; the maximum speed value of the migration data of each migration module is determined according to the total number of the migration modules in the cold and hot pool and the migration speed value; the migration speed of the cold and hot pool is controlled based on the maximum speed value of each migration module, so that the data migration speed of each level of storage area in the distributed object storage system can be effectively controlled, and the data migration does not influence the processing speed of a user request.

Description

technical field [0001] The present application relates to the technical field of distributed storage, and in particular to a method, device and computer-readable storage medium for controlling hierarchical storage migration speed of a distributed object storage system. Background technique [0002] The distributed object storage system is a distributed storage cluster composed of multiple object storage servers, which is used to handle massive and highly concurrent storage service requests. widely used. [0003] At present, HDD (Hard Disk Drive, hard disk drive) mechanical hard disks are widely used in distributed object storage systems, but with new storage media such as SSD (Solid State Drives, referred to as solid disk, solid state disk) and NVME As the price of Volatile Memory express Solid State Drives (VOLatile Memory express Solid State Drives) drops, the storage system has also begun to configure some SSD hard disks to replace HDD as storage media. In this configura...

AI Technical Summary

Problems solved by technology

When data is written, it will be written into the hot pool first, and then the data in the hot pool will be migrated to the cold pool after it becomes cold. In the actual test process, there will be a problem. The data migration process consumes the CPU of the device. (Central Processing Unit, central processing unit), bandwidth, and IO resources. If the migration speed is too fast, it will affect the speed at which front-end users write data to the storage pool. If the migration speed is too slow, there may be too much data in the hot pool and cannot Cases where new data was successfully written

Images