Distributed storage system based on storage pool virtualization management and data read-write method

Abstract

The invention discloses a distributed storage system based on storage pool virtualization management and a data read-write method. In the storage system, part or all of OSD on at least one storage server is / are vOSD of a virtual volume deployed on a storage pool; wherein the storage pool is composed of all or part of physical hard disks on a single storage server, and the physical hard disks are HDD disks and / or SSD disks. The data are stored through a random algorithm according to a set data distribution strategy, and furthermore, the storage pool not only stores the data blocks of the vOSD,but also stores the check code of each corresponding data block so as to ensure the integrity and consistency of the data. Two-layer data protection is achieved through combination of disk pooling andvirtualization management and cross-node RAID protection, and only master and slave copies need to be stored, so that the same or similar data protection and service continuity capabilities of the three copies are achieved. And the IO bottleneck caused by non-uniform OSD load can be effectively avoided, the cost is greatly reduced, and meanwhile, the integrity and consistency of the data are ensured.

Description

technical field [0001] The invention belongs to the technical field of distributed storage, and relates to a novel distributed storage implementation method, in particular to a distributed storage system based on storage pool virtualization management and a data reading and writing method. Background technique [0002] With the deepening of digital transformation, massive data puts forward new requirements for storage. Although traditional disk arrays have the advantages of mature technology, good performance, and high availability, in the face of massive data, their shortcomings are becoming more and more obvious: such as poor scalability and high cost. In order to overcome the above shortcomings and meet the storage needs of massive data, distributed storage technologies have emerged on the market. [0003] A distributed storage system usually includes multiple storage servers (storage nodes) and multiple clients. Its core is to evenly distribute a large amount of data o...

AI Technical Summary

Problems solved by technology

[0007] Purpose of the invention: Aiming at the problems caused by the direct deployment of OSD on the physical hard disk in the prior art, the purpose of the invention is to provide a new storage pool virtualization-based management Distributed storage system, through the pooling and virtualization management of all or part of the disks in the node, and combining with cross-node RAID protection to achieve two-layer data protection, and build a clustered OSD based on virtual volumes, namely vOSD, The workload on the vOSD is evenly distributed on all the disks of the storage pool supporting the vOSD, effectively avoiding the IO bottleneck caused by the uneven load of the OSD; further, the present invention provides a data reading and writing method for the above-mentioned storage system to improve the system Overall IO performance and cost savings

Images