Data storage method, device and system

Abstract

The invention discloses a data storage method, device and system.The method is applied to the storage system.The storage system comprises control equipment and two or more sets of external storage equipment.The control equipment receives data to be stored and divides the data to be stored into N data blocks to be stored.Each subarea set comprises i subareas.The control equipment obtains subarea information corresponding to each data block to be stored according to a benchmark subarea list and stores each data block to be stored into the corresponding external storage equipment according to the subarea information.According to the data storage method, device and system, calculation is conducted through the benchmark subarea list, thereby subarea information of each subarea in the required subarea set is obtained, and space required for storing the subarea information in the storage system is reduced.

Description

technical field [0001] The present invention relates to the technical field of storage, in particular to a data storage method, device and system. Background technique [0002] The emerging large-scale distributed storage system is facing the problem of distributing PB-level data to thousands of storage devices. The existing storage structure includes a tree-shaped hierarchical topology, starting from the virtual root node, going down to racks, control devices, and disks, and finally putting data into disks. When storing metadata, a copy-based storage mode is often used, and when storing common data, a PT group-based storage mode is usually used. Massive data is distributed to these storage devices through the partition algorithm, and the security, balance, type balance and decentralization of the distributed data are guaranteed. [0003] In PT group-based storage mode, a PT group includes multiple PTs. If the number of PTs in a PT group is the same, it means the same sca...

AI Technical Summary

Problems solved by technology

[0005] However, the storage system is a dynamic system, and the system may undergo storage expansion—increasing racks, control devices and disks, and may also reduce capacity—reducing storage devices due to scale reduction or equipment damage

If the size of the PT group is large, or the number of PT groups is constantly increasing, the storage space required for storing the partition information table will also increase accordingly.

Images