Dynamic Membership Management in Distributed Database Replication
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional transactional database replication techniques require stopping databases during replication, which is undesirable and disrupts system availability.
Innovation Solution
Dynamic membership management in a distributed environment allows for modifying persistent membership without interrupting replication, using a registrar to manage membership changes, initialize databases, and handle failures, enabling continuous operation through fault-tolerant distributed lock management and coordinated database updates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional replication techniques are used, then data consistency is maintained, but system availability deteriorates due to required database shutdowns
Solution Approach 1:
The system performs preliminary actions by creating a consistent snapshot of the database before membership changes occur. This snapshot is taken in advance and stored, allowing the new member to initialize from this pre-prepared state rather than requiring the database to be stopped during initialization.
Solution Approach 2:
A snapshot mediator mechanism is introduced that captures and stores a consistent view of the database state. This intermediary snapshot serves as a bridge between the existing replication group and the new member, allowing initialization without interrupting the operational databases of existing members.
2Stability of the object's composition
If database shutdown is performed for membership changes, then replication consistency is ensured, but operational continuity deteriorates
Solution Approach 1:
Instead of modifying the live database during membership changes, the system creates a copy of the consistent database state in the form of a snapshot. This copied state is then distributed to new members, allowing them to initialize without affecting the operational continuity of the original database and its members.
Solution Approach 2:
The consistent snapshot is prepared in advance before the new member joins. This preliminary capture of database state ensures that when the new member initializes, it receives a pre-validated consistent state, eliminating the need to stop databases during the membership change process.
3Measurement precision
If manual membership modification is used, then control precision is maintained, but time consumption increases due to administrator intervention
Solution Approach 1:
The system enables self-service automation where the replication manager automatically handles membership changes. When a new member is added or an existing member leaves, the system autonomously captures snapshots, distributes them to appropriate members, and updates the membership configuration without requiring administrator intervention, thus maintaining precise control while eliminating manual time consumption.
Solution Approach 2:
The system implements automated feedback mechanisms that monitor membership changes and trigger appropriate snapshot creation and distribution processes. This feedback loop ensures that membership updates are automatically managed with precise control, eliminating the time loss associated with manual administrator intervention while maintaining the integrity of the replication group.
Data Source
AI summary
Transactional database replication techniques are disclosed that do not require altering of the database management system implementation. A replicator module includes a dynamic membership manager, which is configured to manage the persistent membership of a coordination group. The persistent membership can be, for example, a durable set of sites that can replicate changes amongst themselves. Changes from sites not in the persistent membership are discarded. The set of recovered members is a subset of the persistent membership. The persistent membership changes incrementally by either removing or adding members. Failed members may still be part of the persistent membership. The dynamic membership manager module manages the modification of the persistent membership, initialization of replicas, and propagation of membership information.