Distributed Database Leader Selection by Weighted Workload Delay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for assigning roles in distributed databases, such as user selection and heuristics based on local information, are inefficient and often lead to a large number of role assignment combinations, hindering optimal performance.
Innovation Solution
A system that includes an activity monitor to monitor client interactions and generate workload data, and a task assigning service to select a leader cluster based on lowest latency, followed by assigning other roles based on communication delays and frequencies, reducing the number of combinations and improving efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If user selection or heuristics using only local information are used for role assignment, then the system allows user control or simplicity, but the assignment efficiency is low and the number of role assignment combinations is large
Solution Approach 1:
The system performs preliminary actions by first selecting a leader node before assigning other roles. This preliminary leader selection reduces the search space for subsequent role assignments, thereby improving overall assignment efficiency while maintaining manageable system complexity
Solution Approach 2:
The system uses feedback from monitoring service data and workload characteristics to dynamically adjust role assignments. By incorporating real-time performance feedback, the system optimizes role distribution without requiring complex manual configuration, resolving the contradiction between efficiency and complexity
2Loss of time
If the number of role assignment combinations is reduced by selecting leader first, then the assignment process becomes more efficient, but the system requires a structured assignment methodology
Solution Approach 1:
The role assignment process is segmented into distinct phases: first selecting the leader role, then assigning other roles based on the leader selection. This segmentation breaks down the complex assignment problem into manageable steps, reducing overall assignment time while maintaining clear process structure
Solution Approach 2:
By performing the leader selection as a preliminary action before other role assignments, the system establishes a foundation that simplifies subsequent assignments. This preliminary step reduces the combinatorial complexity of the overall assignment process, decreasing assignment time without overwhelming system complexity
Data Source
AI summary
Replicas are selected in a large distributed network, and the roles for these replicas are identified. In one example, a leader is selected from among candidate computing clusters. To make this selection, an activity monitor predicts or monitors the workload of one or more clients. Different activities of the workload are given corresponding weights. The delay in performing requested activities, modified by these weights is found, and the candidate leader with the lowest weighted delay is selected as the leader.