RAID 5 Write Buffering and Parity Batching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The Read-Modify-Write (RMW) method in RAID 5 systems is I/O intensive, leading to performance bottlenecks due to the requirement of multiple I/O operations and parity calculations for each write operation, limiting the number of simultaneous writes that can be performed.

Innovation Solution

The RMW_variant method combines multiple write operations into a single operation by using additional temporary buffers and an XOR processor capable of performing operations on multiple blocks, reducing the number of I/O operations and parity calculations needed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the conventional RMW method is used to maintain data integrity and parity in RAID 5, then data redundancy is ensured, but the number of I/O operations increases significantly

Engineering Contradiction:
Improvedata redundancyVSAvoidI/O operation count
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent combines multiple write operations targeting different chunks within the same stripe into a single unified write operation. Instead of performing separate read-modify-write cycles for each chunk, the system aggregates these operations, reads the necessary data once, performs all parity calculations in batch, and writes all results in a single operation sequence, thereby reducing total I/O overhead while maintaining RAID 5 redundancy requirements

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent performs preliminary actions by pre-calculating intermediate parity values and organizing write operations before executing the final write. The system prepares parity information in advance using XOR operations on the old data and new data, and organizes the write sequence to minimize I/O operations, rather than performing calculations and writes in a straightforward sequential manner for each chunk

Inventive Principle:
Principle #10Preliminary action

2Reliability

If multiple separate write operations are performed in RAID 5, then data integrity is maintained through individual parity updates, but the processing time increases

Engineering Contradiction:
Improvedata integrityVSAvoidprocessing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent merges multiple write operations into a single batched operation, combining the reading of old data, the calculation of new parity values, and the writing of new data and parity information into one coordinated process. This batching approach maintains data integrity through proper parity updates while significantly reducing the total processing time compared to executing separate write operations for each chunk

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent ensures continuity of useful action by maintaining the parity update process throughout the batched write operation. Instead of interrupting the process between individual chunk writes, the system continuously performs parity calculations and coordinate writes across all target chunks in a unified operation, eliminating idle time and maintaining productive work throughout the entire write sequence

Inventive Principle:
Principle #20Continuity of useful action

3Reliability

If the RMW method updates each chunk individually with separate parity calculations, then data consistency is ensured, but the system complexity increases

Engineering Contradiction:
Improvedata consistencyVSAvoidoperation sequence complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent merges the control logic for multiple individual write operations into a single unified operation sequence. The system uses a unified control mechanism to manage the batched read, calculate all necessary parity values using consistent logic, and coordinate the writes across multiple chunks atomically, thereby reducing the complexity of managing multiple separate operation sequences while ensuring data consistency through the unified approach

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach reduces the total number of I/O operations and parity calculations, enhancing the performance of write operations in RAID 5 systems by allowing more simultaneous writes without increasing I/O operations, thus addressing the performance bottlenecks of the conventional RMW method.

Implementation Method 1

Calculate intermediate parity Pi=P⊕D1 and store it in a temporary buffer; Calculate new parity information P′=Pi⊕D1′ and store it in a temporary buffer, where the symbol ⊕ represents an exclusive OR logical operation, also denoted herein by XOR

Methodology Applied
Scientific EffectXOR logical operation:

Data Source

PatentUS7831768B2Method and apparatus for writing data to a disk array
Publication Date: 2010.11.09 VALTRUS INNOVATIONS LTD
  • US7831768B2 patent drawing
  • US7831768B2 patent drawing
  • US7831768B2 patent drawing

AI summary

A method for writing data to a RAID 5 configuration of hard disks writes two or more items of data to a data stripe together. The method includes the determining of the suitability of data items to be written together, the storing of the new data items to temporary buffers, the reading of the original data and parity from the hard disk to the temporary buffers, the modification of the parity and the writing of the new data and new parity to the hard disks.