Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Method for building array by adding mirror image structure to check-based RAID and read-write system

A construction method and technology of mirror structure, applied in the direction of response error generation, input/output to record carrier, redundant data error detection in operation, etc., can solve the problems of decreased space utilization, low I/O performance, Poor space utilization and other issues, to alleviate the problem of write amplification, improve write performance, and improve performance

Active Publication Date: 2015-06-17
HUAZHONG UNIV OF SCI & TECH
View PDF9 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

First, there is no redundant structure. The representative array is RAID0. RAID0 uses data stripping technology (Data stripping) to disperse data to all disks, so that disks can be operated in parallel, which improves the read and write speed. Its space utilization rate is the highest in the array structure, but it also leads to its low reliability. Any disk failure in the array will cause the entire system to be damaged.
Second, based on parity RAID, the representative array is RAID5. RAID5 also uses data striping technology to store data in all disks in blocks, so that the disks can be operated in parallel. Unlike RAID0, Each stripe has a parity value, and all parity values ​​are evenly distributed among all disks, which has the advantage of improving reliability. If any disk in the array fails, the system can calculate it based on the remaining disks. The data of the failed disk; due to the addition of the redundant structure, the space utilization rate has decreased, and its redundant structure requires a total capacity of one disk. At the same time, due to its redundant structure, it leads to the problem of write amplification, that is, a write operation , will generate four actual IO operations, including two reads and two writes; in the reconstruction mode, it is necessary to read the data of all remaining disks to calculate the data of the faulty disk; in the degraded mode, the request to access the faulty disk is broken down into multiple I / O requests, which will result in long refactoring times, degraded mode, and low I / O performance in refactored mode
Third, mirror-based RAID. The representative array is RAID1. RAID1 is also called disk mirroring. It mirrors the data of one disk to another disk. Since the data is copied on different disks, I / O offloading can be realized. , so that access can be evenly distributed in the mirror, and if any disk in the array fails, the data will not be lost. The request to access the faulty disk can be directly converted into the request to access its mirror disk, and will not be decomposed into multiple I / O, and can directly read the data of the mirror disk corresponding to the faulty disk during reconstruction, the reconstruction time is short, and the I / O performance is high, but its space utilization rate is poor, and only half of the array capacity can be used

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for building array by adding mirror image structure to check-based RAID and read-write system
  • Method for building array by adding mirror image structure to check-based RAID and read-write system
  • Method for building array by adding mirror image structure to check-based RAID and read-write system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0046] The system provided by embodiment 1 includes an I / O module, a mirror image management module, an address translation module and a RAID module based on verification;

[0047] Described I / O module accepts upper layer read and write request; Mirror image management module judges the image data segment of the original data segment that search address points to according to the address information in the read and write request, returns mirror image data segment address; Address conversion module logical address according to Segment address layout and data layout based on verification RAID are mapped to physical addresses on the disk. If it is a write request, it is also necessary to calculate the physical address of the verification block corresponding to the original data and mirror data; the I / O module decomposes the read and write requests, and the following Send to the disk corresponding to the physical address; based on the verification RAID module, it is used to execute...

Embodiment 2

[0053] In embodiment 2, the array construction method based on verifying RAID and adding mirror structure is applied to the array read-write system of the present invention, including four steps of address layout, data layout, data access and data reconstruction, as follows:

[0054] (1) Address layout:

[0055] (1.1) Set the number of stripes in the segment according to the number of disks M, and the number of stripes in the segment is an integer multiple of M;

[0056] (1.2) determine the segment number K according to the number of data blocks in the disk and the number of stripes in the segment, the number of segments K=the number of data blocks in the disk / segment number of stripes;

[0057] (1.3) Get N=K / 2; Interleave the segments whose segment numbers are 1 to N with the segments whose segment numbers are N+1 to K: store the segment whose number is N+1 after the segment whose number is 1, and then store For the segment numbered 2, the segment numbered N+2 will be stored...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a method for building an array by adding a mirror image structure to a check-based RAID and read-write system. The method comprises the four steps of address layout, data layout, data access and data reconstruction. The read-write system comprises an I / O module, a mirror image management module, an address mapping module and the check-based RAID module. On the basis of the check-based RAID, the mirror image structure is added, so that the I / O performance of the array is improved; the reconstruction time is shortened by using mirror image data reconstruction; the novel address layout mode puts original data and mirror image data at the adjacent positions as much as possible, and the movement distance of a head is shortened; checking information is updated in the background, the write amplification problem of the check-based RAID is relieved, and the write performance of the array is improved; as the mirror image data exist, the fault-tolerant ability of the array is improved, and the availability and reliability of the array are greatly improved.

Description

technical field [0001] The invention belongs to the technical field of data storage, and more specifically relates to an array construction method and a read-write system based on a verification RAID and adding a mirror structure. Background technique [0002] Redundant Arrays of Independent Disks (Redundant Arrays of Independent Disks, RAID) has been widely used in large-scale distributed parallel storage systems because of its performance and reliability. In terms of performance, RAID achieves high throughput through striping. In terms of reliability, RAID uses redundant data such as mirroring or checksums to improve reliability. [0003] RAID can be divided into three types according to its redundant structure. First, there is no redundant structure. The representative array is RAID0. RAID0 uses data stripping technology (Data stripping) to disperse data to all disks, so that disks can be operated in parallel, which improves the read and write speed. The remaining struc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F3/06G06F11/14
Inventor 姚杰曹强吴思谢长生
Owner HUAZHONG UNIV OF SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products