Storage Controller Check-Matrix Coding for Faster Data Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing erasure code encoding and decoding technologies in storage systems have low efficiency, which affects the overall performance and reliability of data recovery in large-scale storage scenarios.
Innovation Solution
A storage controller and data processing method that divides data into chunks and generates check chunks using a check matrix, allowing for efficient encoding and decoding by performing exclusive OR operations across multiple storage media, reducing recovery overhead and improving efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If existing erasure code encoding and decoding technologies are used, then data redundancy and reliability are maintained, but encoding and decoding efficiency is low
Solution Approach 1:
The patent segments data into multiple chunks and distributes them across different storage media, with check chunks stored separately. This segmentation enables parallel processing during encoding and decoding operations, significantly improving efficiency while maintaining data reliability through distributed redundancy.
Solution Approach 2:
The patent changes the mathematical parameters of erasure code by using a check matrix with specific properties (where R+1 is a prime number and R+1>K). This parameter optimization enables faster encoding and decoding operations while preserving the reliability guarantees of erasure code technology.
2Reliability
If traditional RAID erasure code technology is used, then data protection against failures is achieved, but recovery overhead is high
Solution Approach 1:
The patent performs preliminary encoding actions by pre-calculating and storing check chunks in optimized positions across storage media. When failures occur, the system can immediately perform decoding operations using these pre-positioned check chunks, significantly reducing recovery time and overhead.
Solution Approach 2:
The patent introduces check chunks as intermediary elements that mediate between data chunks and recovery operations. These check chunks are strategically positioned and structured to enable efficient recovery operations, reducing the time and computational resources needed for data reconstruction after failures.
3Productivity
If check matrix operations are performed across multiple storage media, then encoding efficiency is improved, but system complexity increases
Solution Approach 1:
The patent designs a universal check matrix structure that can be applied across different storage configurations and failure scenarios. This multi-functional approach allows the same encoding framework to work efficiently across multiple storage media while maintaining manageable system complexity through standardized operations.
Solution Approach 2:
The patent optimizes the check matrix parameters (with R+1 being a prime number and R+1>K) to balance encoding efficiency with system complexity. These carefully chosen parameters enable efficient parallel encoding operations across multiple storage media while keeping the mathematical operations manageable and the system architecture comprehensible.
Data Source
Figure 1-1
Figure 1-2
Figure 2A
AI summary
This application discloses a storage controller. When running, the storage controller encodes, according to a check matrix, K to-be-coded data chunks obtained from a client, to generate two check chunks. In this way, if any chunk is damaged subsequently, the damaged chunk can be recovered by using the check matrix and an undamaged chunk. The storage controller improves efficiency of recovering the damaged chunk.