Distributed Buffer Resource Scheduling via Dynamic Load Balancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current distributed buffer systems based on consistent hashing algorithms face challenges in achieving balanced resource distribution, as they lack effective mechanisms for adjusting load imbalances, leading to inefficient data management and potential data loss when buffer nodes are relocated.
Innovation Solution
A method and system that monitor load values across buffer nodes, detect load exceptions, and adjust the layout of buffer nodes by shifting, adding, or removing them to maintain balanced resource distribution, while ensuring data accessibility through notification messages and location information sharing between old and new buffer nodes.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If consistent hashing algorithm is used to distribute buffer nodes on virtual circle, then data distribution is achieved, but load imbalance occurs and cannot be及时调整
Solution Approach 1:
The patent implements dynamic load balancing by allowing buffer nodes to move along the virtual circle based on load conditions. The system continuously monitors load distribution and adjusts node positions to maintain balance, transforming the static consistent hashing into a dynamic system that can adapt to changing conditions.
Solution Approach 2:
The system employs feedback mechanisms where the load management device monitors load values of buffer nodes and sends adjustment instructions back to modify node positions. This closed-loop control ensures that load imbalance is detected and corrected through continuous feedback between monitoring and adjustment operations.
2Ease of operation
If virtual nodes are allocated for each physical server to equalize loads, then load equalization is achieved, but computation burden of buffer client increases
Solution Approach 1:
The patent extracts the complex computation of determining buffer node positions from the buffer client and relocates it to the load management device. The load management device performs the computational intensive tasks of monitoring load values and calculating optimal node positions, while buffer clients only need to execute simple movement instructions.
Solution Approach 2:
The load management device acts as an intermediary between the consistent hashing algorithm and the buffer nodes. It receives hash values from clients, determines optimal buffer node positions based on load conditions, and returns the assigned buffer node information to clients, thereby simplifying the client's computational burden.
3Ease of operation
If buffer node layout is adjusted to correct load imbalance, then load balance is improved, but data accessibility may be affected
Solution Approach 1:
The system performs preliminary actions by maintaining records of old buffer node positions before layout adjustments. When a buffer node moves to a new position, the system proactively notifies relevant parties of the change, ensuring that data accessibility is maintained through advance preparation rather than reactive measures.
4Ease of operation
If automatic scheduling is implemented to maintain balanced resource distribution, then resource balance is achieved, but system complexity increases
Solution Approach 1:
The system implements self-service mechanisms where buffer nodes automatically monitor their own load values and report to the load management device. The load management device automatically generates and sends adjustment instructions without human intervention, enabling the system to self-regulate and maintain balance autonomously.
Data Source
AI summary
A method for scheduling distributed buffer resources is provided, where in the distributed buffer system, each buffer node is distributed on a virtual circle that is based on a consistent hashing algorithm, and the method includes: monitoring a load value of each buffer node in the distributed buffer system; judging whether a load exception exists in the current distributed buffer system according to the load value; and if the load exception exists in the current distributed buffer system, adjusting a layout of the buffer nodes in the distributed buffer system.