Distributed Database Index Splitting via Chairman Node Coordination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed databases, existing methods for splitting indexes across multiple nodes can lead to race conditions and performance degradation, as they are not readily applicable without quiescing the system, which is inefficient in concurrent and consistent database operations.
Innovation Solution
A distributed database management system that allows for the splitting of index atoms by designating a chairman node to manage the split process, ensuring that all nodes with index copies receive split messages and update their index structures concurrently, eliminating the need for system quiescence and minimizing performance impact.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional index splitting methods are used in distributed databases, then index splitting can be completed, but system performance degrades due to race conditions and the need for system quiescence
Solution Approach 1:
The patent introduces a chairman node as an intermediary to coordinate the index splitting process across all database nodes. The chairman node receives split requests, determines the split key, and broadcasts the split operation to all nodes, thereby preventing race conditions and ensuring consistent splitting without requiring full system quiescence.
Solution Approach 2:
The system performs preliminary actions by having the chairman node determine the split key and prepare the split operation before executing it across all nodes. This preliminary coordination ensures that all nodes are ready for the split operation simultaneously, avoiding race conditions while maintaining system performance.
2Reliability
If system quiescence is implemented during index splitting, then consistency is maintained, but system availability and concurrency are reduced
Solution Approach 1:
The chairman node acts as a mediator that coordinates the split operation, allowing nodes to continue processing other operations while the index split is being performed. This eliminates the need for complete system quiescence while maintaining consistency through centralized coordination.
Solution Approach 2:
The system dynamically manages the index splitting process by allowing different nodes to be in different states during the split operation. Nodes can continue normal operations until the split is coordinated by the chairman, providing dynamic adaptability that maintains both consistency and availability.
3Productivity
If multiple nodes independently process index splitting requests, then concurrency is improved, but race conditions occur leading to erroneous outcomes
Solution Approach 1:
The chairman node serves as a central intermediary that receives split requests from any node, determines the appropriate split key, and coordinates the execution across all nodes. This centralized coordination maintains high concurrency while preventing race conditions by ensuring all nodes follow the same split operation.
Solution Approach 2:
The patent merges the split request handling function into a single chairman node, combining multiple potential split initiators into one coordinated entity. This merging approach allows concurrent requests to be processed through a single coordination point, ensuring correctness while maintaining system-wide concurrency.
Data Source
AI summary
A distributed data processing system for a database composed of data records organized into tables for responding to a request to split an index in a consistent and concurrent fashion. A request to split an index atom at any given node is processed by a designated “chairman” for that index atom. The chairman splits its index by maintaining a lower portion thereof and by moving the contents of an upper portion to a newly created index atom as the right sibling. Each other node takes appropriate steps to assure orderly transfer of this information from the chairman consistently and concurrently across the distributed database processing system.