Adaptive Heartbeat Mechanism for Distributed Storage Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed storage systems using the Raft consistency algorithm, fixed heartbeat times lead to excessive signaling between storage devices, particularly those with low read/write frequencies, resulting in high system overheads and impaired read/write performance.
Innovation Solution
Adaptive determination of heartbeat times based on the read/write frequencies of data block groups, allowing the primary device to adjust the heartbeat time according to access status information, thereby optimizing communication frequency and reducing unnecessary signaling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If fixed heartbeat time is used to ensure timely synchronization of high-frequency data block groups, then data synchronization reliability is improved, but system overhead increases due to excessive signaling in low-frequency data block groups
Solution Approach 1:
The patent implements dynamic heartbeat time adjustment by introducing a heartbeat time adaptation module that automatically adjusts the heartbeat interval based on the read/write frequency of each data block group. High-frequency groups use shorter heartbeat intervals to ensure timely synchronization, while low-frequency groups use longer intervals to reduce signaling overhead. This dynamic adaptation resolves the contradiction by making the heartbeat time flexible rather than fixed.
Solution Approach 2:
The patent changes the parameter of heartbeat time from a fixed value to a variable value that adapts based on data block group characteristics. By monitoring the read/write frequency and adjusting the heartbeat interval accordingly, the system optimizes the balance between synchronization reliability and signaling overhead for different data access patterns.
2Loss of time
If short heartbeat interval is used for high read/write frequency data block groups, then data synchronization timeliness is improved, but communication frequency increases causing high system overhead
Solution Approach 1:
The patent applies different heartbeat intervals to different data block groups based on their local characteristics (read/write frequency). Instead of using a uniform heartbeat interval for all groups, the system tailors the heartbeat time to each group's specific access pattern, ensuring timely synchronization for high-frequency groups while avoiding excessive communication for low-frequency groups.
Solution Approach 2:
The heartbeat interval becomes a dynamic parameter that changes based on the observed access frequency of each data block group. The adaptation module continuously monitors access patterns and adjusts the heartbeat time accordingly, making the system responsive to actual workload characteristics rather than relying on static configuration.
Data Source
Figure 1A
Figure 1B
Figure 1C
AI summary
The present invention discloses a heartbeat-based data synchronization method that pertains to the field of data synchronization technologies. The method is applied to a distributed storage system, and at least one data block group is stored in the distributed storage system. The distributed storage system includes multiple storage devices, one device in the multiple storage devices is a primary device for storing the data block group, and other devices are secondary devices for storing the data block group. The primary device performs the method. The primary device obtains access status information of the data block group, determines a heartbeat time of the data block group according to the access status information of the data block group, and sends a data synchronization instruction to the secondary device according to the heartbeat time of the data block group, where the data synchronization instruction is used to instruct the secondary device to synchronize data. Therefore, system overheads of the distributed storage system are reduced, and read/write performance of the storage system is improved.