Steady State Data Replication Protocol with Quorum Formation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data replication systems face challenges in maintaining steady state data distribution and efficient quorum formation, especially in failure situations, leading to data loss and inefficiencies in updating replica machines.
Innovation Solution
A high-throughput data replication protocol that enables steady state data distribution and a three-phase commit quorum formation protocol, combined with enhanced B+ trees and operation logs for efficient updates, allowing multiple outstanding prepare operations and minimizing data copying and quorum elections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional data replication protocols are used, then data safety is maintained, but system throughput and update efficiency deteriorate due to excessive quorum elections and data copying
Solution Approach 1:
The patent segments the replication protocol into distinct phases (prepare, commit, update) and allows multiple prepare operations to be outstanding simultaneously. This segmentation enables parallel processing of replication tasks while maintaining data safety through phased commitment, directly resolving the contradiction between throughput and reliability.
Solution Approach 2:
The patent implements preliminary actions by pre-establishing quorum formation rules and data distribution strategies before failures occur. The steady-state data distribution protocol prepares the system in advance, reducing the need for emergency quorum elections and minimizing data copying when failures happen, thus improving throughput without compromising data safety.
2Productivity
If steady state data distribution is implemented with multiple outstanding prepare operations, then system efficiency improves, but complexity of quorum formation increases
Solution Approach 1:
The patent introduces dynamic quorum formation that adapts to the current system state. The quorum formation protocol dynamically adjusts based on which replica machines are available, allowing efficient operation under various failure scenarios. This dynamic approach maintains high replication efficiency while managing complexity through adaptive rather than static rules.
Solution Approach 2:
The patent incorporates feedback mechanisms where replica machines report their status and data consistency to the coordinator. This feedback loop enables the system to automatically adjust quorum formation strategies based on actual system conditions, maintaining efficiency while managing complexity through information-driven adaptation.
3Reliability
If data is replicated across multiple machines, then fault tolerance improves, but data loss risk increases during failure situations due to inconsistent state
Solution Approach 1:
The patent applies beforehand cushioning by implementing a steady-state data distribution protocol that ensures data is properly replicated and acknowledged before operations complete. This preventive approach cushions against potential data loss by ensuring consistency is achieved prior to failure scenarios, allowing the system to tolerate failures without losing data.
Solution Approach 2:
The patent uses controlled copying mechanisms where data is replicated to multiple machines only when consistency is guaranteed. The replication protocol ensures that copies are created and synchronized properly, maintaining fault tolerance while preventing data loss through coordinated copying rather than uncontrolled replication.
4Speed
If traditional update protocols are used, then data consistency is maintained, but update speed deteriorates due to sequential processing requirements
Solution Approach 1:
The patent implements continuity of useful action by allowing multiple prepare operations to proceed in parallel rather than sequentially. The protocol maintains continuous data flow and update operations across replica machines, improving update speed while preserving consistency through the structured phases of the replication protocol.
Solution Approach 2:
The patent replaces traditional mechanical sequential update mechanisms with a more efficient protocol-based system. By substituting the sequential update mechanism with a phased parallel protocol, the system achieves faster update speeds while maintaining data consistency through rule-based coordination rather than mechanical sequencing.
Data Source
AI summary
Steady state data distribution is provided between a client application, a leader machine, and a plurality of replica machines. The distribution comprises the leader machine receiving an operation request from the client application, the leader machine sending the prepare message to each of the plurality of replica machines, the replica machines recording in their logs information on the operation, the replica machines sending acknowledgement messages to the leader machine, and the leader machine sending commit command messages to the replica machines. A new quorum of the replica machines is created by using log information. Replica machines that become part of the new quorum are updated in an efficient manner.