A Data Reconstruction Method Based on Storage Objects

A technology for storing objects and data reconstruction, which is applied in the field of storage systems, can solve problems such as impact on SSD lifespan, inability to achieve priority reconstruction, and linear increase in data reconstruction process time, so as to avoid reconstruction

Active Publication Date: 2022-07-22
MEMBLAZE TECH BEIJING
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In this process, all write operations will finally be concentrated on the spare drive 88 and the new drive, so that the data reconstruction performance of the RAID system in the prior art is limited to the performance of a single drive
[0004] There are at least the following problems in the RAID system of the prior art: (1) the data domain and the physical domain are a tightly coupled relationship (stripes directly correspond to physical storage locations), and this tightly coupled relationship will cause the RAID data reconstruction process to be extremely difficult. Long time, the performance of RAID system data reconstruction cannot grow linearly with the number of disks
And as the drive capacity increases, the data reconstruction process time will increase linearly
[0005] (2) Due to the long reconstruction time, a large amount of data reading and writing during the reconstruction process increases the burden on the drive, making the drive more prone to failure
[0006] (3) Partial reconstruction cannot be achieved. When a drive in the drive group fails, traditional RAID technology will perform reconstruction operations on all storage spaces of the entire drive, and the reconstruction of the entire drive will take a lot of time
[0007] (4) It is impossible to refactor according to priority, and traditional refactoring cannot perform priority refactoring according to fault level
[0008] (5) Data awareness cannot be achieved. The existing RAID system located at the block device layer has a fixed data layout and cannot know the data semantics of the upper-layer application. Therefore, data-aware reconstruction operations cannot be achieved. Recover data by means of a full drive rebuild
For the new solid-state drive (SSD, Solid State Drive), if the full drive reconstruction method is adopted, it will cause the spare drive or the replaced drive to be completely rewritten, which not only leads to a significant decline in performance, but also leads to SSD failure. Lifespan is affected

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Data Reconstruction Method Based on Storage Objects
  • A Data Reconstruction Method Based on Storage Objects
  • A Data Reconstruction Method Based on Storage Objects

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] see figure 1 , figure 1 The architecture of a storage system according to an embodiment of the present invention is shown. A storage system according to the present invention includes a computer or server (collectively referred to as a host) and a plurality of drives coupled to the host. Preferably, the drive is a solid state drive (SSD). Optionally, a disk drive may also be included in embodiments according to the present invention.

[0046] Storage resources provided by individual drives are maintained through storage resource pools. The storage resource pool records data blocks or data chunks (chunks, chunks for short) in each drive. As an example, the large data block is a plurality of consecutive data blocks in logical space or physical space of a predetermined size. The size of the chunk of data, for example, can be in the hundreds of KB or MB. Optionally, what is recorded in the storage resource is data blocks or large data blocks that have not been alloc...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Provides data reconstruction methods based on storage objects. The provided data reconstruction method includes, in response to the failure of the first drive in the storage pool, obtaining a storage object using the data block provided by the first drive; obtaining the first data block in an idle state from the storage pool and assigning it to the storage object; the storage object; storing the data stored in the data block of the first drive in the storage object to the first data block.

Description

technical field [0001] The present invention relates to storage systems, and more particularly, to a method and system for rebuilding data when a drive in the storage system fails. Background technique [0002] The existing RAID (Redundant Arrays of Independent Disks, redundant array of independent disks) technology aggregates multiple physical drives (for example, disks) into a disk group, divides the disk group into stripes, and uses redundancy technology on each stripe. Provide protection for data. In the RAID system of the prior art, when one or more of the multiple drives fails, a spare drive is activated and data reconstruction is performed to maintain the data protection capability and performance of the RAID system. After the failed drive is replaced, the data from the spare drive needs to be copied back to the new drive. RAID systems can provide various levels of data protection, for example, a RAID5 system can correct the failure of one drive, while a RAID6 syste...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06F3/06
CPCG06F3/0604G06F3/0629G06F3/064G06F3/0689
Inventor 李琳孙守取易正利刘昌吴忠杰
Owner MEMBLAZE TECH BEIJING
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products