Primary Bias Negotiation for Mediator-Less Storage Failover
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multi-site distributed storage systems face disruptions due to temporary connectivity issues with external mediators, leading to split-brain situations and data consistency problems when multiple sites attempt to serve I/O operations independently.
Innovation Solution
A primary bias feature is negotiated between storage sites to establish a primary I/O serving role, anchored at a storage cluster with a locally stored consensus, allowing seamless failover without mediator intervention, using a two-step process with generation indicators to handle race conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If an external mediator is used to manage failover between storage sites, then data consistency is maintained, but system availability is reduced due to mediator connectivity issues and single point of failure
Solution Approach 1:
The patent extracts the mediator dependency from the failover process by implementing a mediator-less negotiation mechanism. Storage sites directly negotiate primary bias state with each other using distributed consensus algorithms, eliminating the external mediator that causes connectivity issues and single point of failure, while still ensuring data consistency through cryptographic proofs and consensus validation
Solution Approach 2:
Storage sites perform self-service failover management by autonomously negotiating and determining primary bias states without external mediator intervention. Each site independently validates consensus decisions using cryptographic proofs and locally executes failover actions, enabling the system to serve itself during mediator outages
2Productivity
If a mediator-less negotiation process is implemented, then system availability is improved during mediator outages, but the complexity of handling race conditions and consensus increases
Solution Approach 1:
The patent introduces cryptographic proofs and consensus algorithms as intermediary mechanisms to manage the complexity of mediator-less negotiation. These intermediaries facilitate automated race condition handling through deterministic conflict resolution rules, generation number comparisons, and cryptographic validation, reducing the need for complex manual coordination while maintaining system availability
Solution Approach 2:
The system performs preliminary actions by pre-establishing negotiation protocols, consensus rules, and conflict resolution mechanisms before failures occur. Generation indicators and cryptographic proof structures are prepared in advance, enabling automated handling of race conditions and consensus determination without complex real-time decision-making during outages
Data Source
AI summary
Systems and methods include negotiating a primary bias state for primary and secondary storage sites when a mediator is temporarily unavailable for a multi-site distributed storage system. In one example, a computer-implemented method comprises detecting, with the primary storage site having a primary storage cluster, a temporary loss of connectivity to a mediator or a failure of the mediator. The computer-implemented method includes negotiating the primary bias state and setting the primary bias state on a secondary storage cluster of the secondary storage site when the secondary storage cluster detects a temporary loss of connectivity to the mediator, determining whether the primary storage cluster receives a confirmation of the secondary storage cluster setting the primary bias state, and setting the primary bias state on the primary storage cluster when the primary storage cluster receives the confirmation.