Quorum-Based Data Volume Replication Across Fault Tolerance Zones

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing techniques for replicating data volume updates across fault tolerance zones are complex and time-consuming, often requiring permission or locks from other clients, which can hinder performance and availability.

Innovation Solution

Implementing a quorum-based block replication method that allows clients to directly replicate changes across different fault tolerance zones without needing permission from other clients, using write and read quorum protocols to ensure data consistency and availability across multiple replicas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional permission-based replication is used, then data consistency is maintained, but system complexity and operation time increase

Engineering Contradiction:
Improvedata consistencyVSAvoidreplication complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent extracts the permission-granting function from the replication process itself. Instead of requiring permission from other clients during replication, the system uses pre-configured access control lists (ACLs) that define permissions in advance. This separates the permission management (done once during configuration) from the replication operation (done frequently), reducing the complexity of each replication event while maintaining data consistency through the pre-established ACL rules.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system performs permission configuration in advance by creating access control lists (ACLs) that specify which clients can replicate to which volume replicas. This preliminary action eliminates the need for real-time permission negotiation during replication operations. The ACLs are established beforehand, allowing clients to directly replicate data without seeking permission at the time of replication, thus simplifying the replication process while ensuring consistency through pre-defined access rules.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If permission-based replication is used, then data integrity is protected, but replication speed decreases

Engineering Contradiction:
Improvedata integrityVSAvoidreplication speed
Core Design Contradiction:
ReliabilityVSSpeed

Solution Approach 1:

The patent removes the permission-checking step from the critical replication path. By extracting permission validation into pre-configured ACLs that are evaluated without real-time interaction with other clients, the system eliminates the time-consuming permission negotiation process. Data integrity is maintained through the ACL enforcement mechanism, while replication speed improves because clients can proceed with replication immediately based on pre-established permissions without waiting for permission grants.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Permission validation is performed preliminarily through the configuration of access control lists before replication operations occur. The ACLs contain pre-determined permission rules that allow the system to validate client access rights instantly during replication without requiring real-time permission requests. This preliminary configuration approach ensures data integrity through enforced access control while enabling high-speed replication by eliminating runtime permission negotiation delays.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If locks are required from other clients, then conflict prevention is achieved, but availability decreases

Engineering Contradiction:
Improveconflict preventionVSAvoidsystem availability
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent extracts the conflict prevention mechanism from the replication execution phase and places it in the configuration phase through ACLs. Instead of requiring clients to acquire locks from other clients during replication (which reduces availability), the system uses pre-configured ACLs that define which clients are authorized to replicate to which volume replicas. This extraction eliminates the need for runtime lock acquisition, maintaining conflict prevention through access control while preserving system availability by allowing simultaneous replication operations from multiple authorized clients.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

Conflict prevention is achieved preliminarily through the establishment of access control lists that define client permissions before replication operations begin. The ACLs pre-determine which clients can access and replicate to which volume replicas, eliminating the need for dynamic lock management during replication. This preliminary configuration approach prevents conflicts through access control rules rather than runtime locking, thereby maintaining high system availability by allowing multiple clients to replicate simultaneously without acquiring locks from one another.

Inventive Principle:
Principle #10Preliminary action

4Productivity

If multiple clients access the same volume, then resource utilization improves, but conflict risk increases

Engineering Contradiction:
Improveresource utilizationVSAvoidconflict risk
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent segments the access control mechanism into individual access control list entries for each client-volume replica pair. Instead of using a centralized lock management system that requires coordination between multiple clients (increasing conflict risk), the system divides permissions into discrete, pre-configured ACL entries. Each client has specific permissions defined in the ACLs for each volume replica they can access. This segmentation allows multiple clients to access and replicate to different volume replicas simultaneously without conflicts, as their permissions are independently defined in the segmented ACL structure, thereby improving resource utilization while maintaining reliability.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11336723B1Replicating data volume updates from clients accessing the data volume across fault tolerance zones
Publication Date: 2022.05.17 AMAZON TECH INC
  • US11336723B1 patent drawing
  • US11336723B1 patent drawing
  • US11336723B1 patent drawing

AI summary

Updates for clients accessing a data volume across fault tolerance zones may be replicated. Requests to write or read a block of a logical volume with replicas located in different fault tolerance zones may be sent to the different replicas. Responses for the different requests may be evaluated to determine whether quorum is satisfied for the write or read of the block of the logical volume. For writes that satisfy quorum, a request to commit the write may be sent to the replicas of the logical volume.