Control Node Data Transmission for Database Clusters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In a cluster system with a shared storage architecture, the frequent broadcast of modification information from the primary node to multiple standby nodes leads to excessive CPU consumption and network bandwidth waste due to unnecessary data transmission.
Innovation Solution
A control node is introduced to receive operation logs from the primary node, determine the relevant operation records for each standby node using a mapping table, and send only the necessary records to the standby nodes, reducing redundant data transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the primary node frequently performs read/write transactions and continuously broadcasts modification information to all standby nodes, then data synchronization is maintained, but CPU consumption and network bandwidth usage increase excessively
Solution Approach 1:
The patent extracts only the necessary modification information that is relevant to each standby node from the complete operation log. Instead of broadcasting all modification records to all standby nodes, the system identifies and transmits only those records that affect the local cache of each specific standby node, thereby reducing unnecessary processing and network traffic while maintaining data synchronization.
Solution Approach 2:
The patent segments the operation log into multiple parts based on relevance to different standby nodes. By dividing the modification information into node-specific subsets, the system enables each standby node to process only its relevant segment, reducing overall CPU consumption across the cluster while ensuring each node maintains proper data synchronization for its assigned data pages.
2Reliability
If the primary node continuously broadcasts all modification information to standby nodes, then data synchronization is ensured, but network bandwidth resources are wasted due to massive data transmission
Solution Approach 1:
The system extracts and transmits only the essential modification records that are relevant to each standby node's local cache. By filtering out irrelevant operation records before transmission, the patent significantly reduces network bandwidth consumption while ensuring that each standby node receives sufficient information to maintain data synchronization for its assigned pages.
3Reliability
If all standby nodes process all broadcast modification information, then data consistency is maintained, but processing efficiency decreases due to excessive CPU consumption
Solution Approach 1:
Each standby node extracts and processes only the modification records that are relevant to its local cache from the received operation log. This selective processing approach maintains data consistency for each node's assigned pages while significantly improving processing efficiency by eliminating unnecessary computation on irrelevant records.
Solution Approach 2:
The patent segments the processing workload by assigning different subsets of operation records to different standby nodes based on their respective local cache contents. This segmentation enables parallel processing of relevant records across multiple nodes, improving overall system productivity while ensuring each node maintains proper data consistency for its assigned data.
Data Source
AI summary
A primary node-standby node data transmission method includes an indication that a control node obtains an operation log generated by a primary node, where the operation log includes at least one operation record, and each operation record indicates a record of performing, by the primary node, a write operation on a local cache or a storage unit in a storage device. The method further includes the control node determining a first storage unit set that corresponds to a first standby node, the control node determining a second storage unit set that corresponds to the at least one operation record, the control node obtaining an operation record from the operation log, and the control node sending the corresponding operation record to the first standby node, where the storage unit intersection set is an intersection set of storage units in the first storage unit set and the second storage unit set.