Ring-Structured Erasure Coding for Faster Data Recovery

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional storage systems face inefficiencies in recovery performance, reliability, and storage overhead due to the use of erasure codes like RAID 6 and replication techniques, which trade off recovery performance for storage efficiency and reliability.

Innovation Solution

A method that converts a data chunk into a ring algebraic structure by appending extra data and performing exclusive or (XOR) operations for erasure coding, replacing costly multiplication with efficient pointer movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If Reed-Solomon erasure coding is used to improve data reliability and storage efficiency, then storage overhead is reduced and reliability is improved, but recovery performance deteriorates due to complex multiplication operations

Engineering Contradiction:
Improvedata reliabilityVSAvoidrecovery performance
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The patent changes the algebraic parameters by mapping data to a ring structure where multiplication by powers of x becomes equivalent to cyclic bit-shift operations. This parameter transformation allows maintaining the mathematical properties needed for Reed-Solomon coding while changing the operation type from complex multiplication to simple bit-shifting, thereby improving recovery performance while preserving reliability

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent substitutes the mechanical multiplication operation with a bit-shift and XOR operation system. By representing data polynomials in a ring structure where multiplication by x^k corresponds to left-shifting by k positions, the system replaces computationally expensive multiplication with efficient bitwise operations, significantly accelerating recovery performance

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If conventional erasure coding methods are used to maintain data redundancy, then reliability is improved, but storage overhead increases and efficiency decreases

Engineering Contradiction:
Improvedata redundancyVSAvoidstorage overhead
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent transforms the data representation parameters to enable more efficient encoding. By organizing data into a ring structure where elements are polynomials modulo x^n - 1, the system achieves the same redundancy goals with optimized storage layout, reducing the overhead while maintaining the mathematical guarantees of Reed-Solomon error correction

Inventive Principle:
Principle #35Parameter changes

3Quantity of substance

If Reed-Solomon coding is used to improve storage efficiency, then storage overhead is reduced, but computational complexity increases due to multiplication operations

Engineering Contradiction:
Improvestorage overheadVSAvoidcomputational complexity
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent replaces the complex multiplication mechanism with a simpler bit-shift and XOR mechanism. In the ring structure, multiplying a polynomial by x^k is equivalent to left-shifting the coefficient array by k positions and wrapping around, which can be implemented with simple memory operations and XOR gates, dramatically reducing computational complexity while maintaining storage efficiency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent segments the computational process into independent bit-level operations. By representing polynomials as arrays of coefficients and using bit-shift operations, each multiplication step becomes a series of independent, parallelizable bit operations, reducing the overall computational complexity and enabling more efficient implementation

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10657001B2Converting a data chunk into a ring algebraic structure for fast erasure coding
Publication Date: 2020.05.19 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US10657001B2 patent drawing
  • US10657001B2 patent drawing
  • US10657001B2 patent drawing

AI summary

One embodiment provides a method comprising arranging a first data chunk into a ring structure, tagging the first data chunk by appending extra data to the first data chunk, and performing erasure coding on the first data chunk utilizing only exclusive or (XOR) operations.