Parallel RS-RAID Checksum Architecture for Low-Latency Throughput
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The throughput of RAID data storage architectures is reduced due to high latency in communication fabrics when a single RAID controller performs checksum and encoding calculations, limiting the efficiency of fault-tolerant data storage.
Innovation Solution
A parallel Reed-Solomon RAID architecture is implemented, where multiple RAID controllers communicate over a common communication fabric, with each controller interposed between storage devices, using a Vandermonde matrix to calculate and maintain checksum symbols, allowing for distributed error correction and data recovery, thereby reducing computational burden and latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a single RAID controller is used to perform checksum encoding and decoding calculations, then fault tolerance is achieved, but throughput and data storage retrieval rate are reduced
Solution Approach 1:
The patent divides the single RAID controller into multiple parallel RAID controllers (first, second, third, and fourth controllers), each handling specific subsets of data storage devices and checksum calculations. This segmentation allows simultaneous processing of multiple data streams, thereby maintaining fault tolerance while significantly improving throughput and reducing the bottleneck effect of a single controller.
2Productivity
If multiple RAID controllers are used to increase throughput, then data storage and retrieval rate improves, but latency in communication fabric increases
Solution Approach 1:
The patent merges the checksum calculation functions of multiple RAID controllers through a coordinated approach where controllers share intermediate checksum values via the communication fabric. The first and second controllers calculate intermediate checksums that are combined by the third and fourth controllers to produce final checksums. This merging strategy allows parallel processing to improve throughput while minimizing communication fabric latency through optimized data sharing.
3Adaptability or versatility
If multiple RAID controllers communicate over a common communication fabric, then scalability is improved, but computational burden and latency increase
Solution Approach 1:
The patent segments the computational burden by assigning specific calculation tasks to different controllers. Each controller computes intermediate checksums for specific data stripes rather than all data, reducing individual computational load. The segmentation of checksum calculation into intermediate and final stages across multiple controllers enables scalable architecture while managing computational complexity through distributed processing.
4Productivity
If intermediate checksums are calculated and shared across controllers, then throughput is improved, but communication fabric traffic increases
Solution Approach 1:
The patent implements continuous checksum calculation and sharing operations where intermediate checksums are computed and transmitted in parallel across the communication fabric without interruption to data storage operations. This continuous action allows throughput to improve while communication traffic is optimized through efficient, non-blocking data exchange between controllers that maintains system operations without停顿.
Data Source
AI summary
The parallel RS-RAID data storage architecture can aggregate that data and checksums within each cluster into intermediate or partial sums that are transferred or distributed to other clusters. The use of intermediate data symbols, intermediate checksum symbols, cluster configuration information on the assignment of data storage devices to clusters and the operational status of data storage devices, and the like, can reduce the computational burden and latency for the error correction calculations while increasing the scalability and throughput of the parallel RS-RAID distributed data storage architecture.