Fault-Tolerant Access Coordination Protocol for Erasure Coded Data
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed computational data storage systems, ensuring the integrity and fault-tolerance of erasure coded data during read and write operations across multiple processes is challenging, particularly in maintaining atomicity and preventing data corruption due to failing storage devices.
Innovation Solution
A fault-tolerant access coordination protocol that ensures exclusive write access by a client, utilizing a system with a memory that stores files as a plurality of data blocks allocated to data groups, including coding blocks, and a server with multiple data storage devices, where a client acquires stripe leases to retrieve and update files, ensuring atomicity through a coordination protocol that piggy-backs access coordination messages on erasure coding operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If a centralized coordination component is used to manage access to erasure coded data, then data integrity and fault tolerance are improved, but system scalability and performance deteriorate due to centralized bottlenecks
Solution Approach 1:
The patent divides the centralized coordination function into distributed stripe lease components, where each stripe is independently managed by its own lease mechanism. This segmentation allows multiple clients to access different stripes simultaneously without centralized bottlenecks, improving scalability while maintaining data integrity through distributed coordination.
Solution Approach 2:
The patent introduces a new dimension of coordination through stripe leases that operate at the stripe level rather than requiring centralized file-level coordination. This dimensional shift from centralized to distributed coordination enables parallel access to different stripes while maintaining fault tolerance.
2Reliability
If strict access coordination protocols are implemented to ensure atomicity, then data corruption prevention is improved, but message overhead and operation complexity increase
Solution Approach 1:
The patent merges the access coordination protocol with the erasure coding operations by piggy-backing stripe lease acquisition and release on the existing coding and decoding message exchanges. This consolidation reduces message overhead while maintaining atomicity, as the same communication channels are used for both coordination and data operations.
Solution Approach 2:
The stripe lease mechanism serves multiple functions simultaneously: it provides access coordination, ensures atomicity through lease acquisition/release, and enables fault tolerance through distributed management. This multi-functionality reduces the need for separate coordination protocols and minimizes overall system complexity.
Data Source
AI summary
Technologies are provided to ensure integrity of erasure coded data that is subject to read and write access from distributed processes. Multiple processes that access erasure coded data can be coordinated in an efficient, scalable and fault-tolerant manner so that integrity of the original data is maintained. The Technologies include a fault-tolerant access coordination protocol that ensures exclusive write access by a client. The coordination protocol achieves scalability by not relying on centralized components, and achieves efficiency and performance by piggy-packing access coordination messages on operations of the underlying erasure coding protocol.