Domain-Based Raft Leader Selection for Distributed Data Services

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Traditional Raft consensus algorithms for leader selection in distributed data services are not optimal, as follower nodes may be overly active or inactive, leading to suboptimal leader selection based on domain-specific variations in network activity and demand, which affects performance.

Innovation Solution

Implementing a domain-based leader selection method that shards data based on temporal activity and other characteristics, where nodes with higher domain attributes are nominated as leader nodes, and traditional consensus is used if no attributes exceed a threshold, optimizing network performance by aligning leader selection with activity patterns.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional Raft consensus algorithm is used for leader selection, then fault tolerance is maintained, but network performance deteriorates due to suboptimal leader selection based on domain-specific activity patterns

Engineering Contradiction:
Improvefault toleranceVSAvoidnetwork performance
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system dynamically selects leader nodes based on real-time domain attributes and activity patterns rather than using static Raft consensus. Nodes are evaluated against domain-specific parameters (temporal activity, transaction volume, network latency) and the most suitable node becomes leader, allowing the system to adapt to changing conditions while maintaining fault tolerance through the underlying Raft consensus mechanism.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The invention changes the selection parameters from simple node availability (traditional Raft) to multi-dimensional domain attributes including temporal activity patterns, transaction processing capacity, network latency, and resource availability. This parameter transformation enables optimal leader selection that balances reliability requirements with performance optimization for specific domain workloads.

Inventive Principle:
Principle #35Parameter changes

2Stability of the object's composition

If follower nodes are selected based on traditional consensus, then system stability is maintained, but transaction processing efficiency deteriorates due to inactive or overly active nodes

Engineering Contradiction:
Improvesystem stabilityVSAvoidtransaction processing efficiency
Core Design Contradiction:
Stability of the object's compositionVSProductivity

Solution Approach 1:

The system applies local quality by evaluating each node's specific domain attributes and activity patterns to determine its suitability for leader or follower roles. Instead of uniform selection criteria, each node is assessed against domain-specific parameters such as temporal activity patterns, transaction processing capacity, and network characteristics, allowing the most appropriate nodes to serve as leaders for their respective domains while maintaining overall system stability.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system performs preliminary evaluation of node domain attributes and activity patterns before leader selection. By pre-assessing nodes based on temporal activity, transaction volume, and resource availability, the system can proactively designate optimal leaders before workload changes occur, preventing inefficiencies associated with reactive leader selection and maintaining both stability and efficiency.

Inventive Principle:
Principle #10Preliminary action

3Device complexity

If generic Raft consensus operations are used, then algorithm simplicity is maintained, but performance optimization deteriorates due to inability to parameterize for domain variations

Engineering Contradiction:
Improvealgorithm simplicityVSAvoidperformance optimization
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The invention segments the leader selection process into distinct evaluation dimensions (temporal activity patterns, transaction processing capacity, network latency, resource availability) while maintaining the overarching Raft consensus framework. This segmentation allows domain-specific optimization without requiring complete algorithmic redesign, balancing simplicity with performance by applying targeted parameterization to specific selection criteria rather than the entire consensus mechanism.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates a universal leader selection framework that can adapt to multiple domain types and workload characteristics. By defining a set of configurable domain attributes and evaluation parameters, the same basic architecture can optimize performance across diverse scenarios (financial transactions, data processing, network communications) without requiring domain-specific algorithm implementations, thus maintaining simplicity while achieving performance optimization.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS12010171B2Domain-based Raft consensus selection of leader nodes in distributed data services
Publication Date: 2024.06.11 BANK OF AMERICA CORP
  • US12010171B2 patent drawing
  • US12010171B2 patent drawing
  • US12010171B2 patent drawing

AI summary

Domain-based server-selection computer-implemented processes and machines implement an extension of RAFT consensus for leader selection based on patterns of update data proximity. Accounts involved in payment or other transactions are maintained as “sharded” data across data store instances that are split into shards according to their temporal activity. If the domain attributes for a node exceed a threshold and are greater than the other nodes, the node is designated as a leader node and the others are designated as follower nodes. This provides an additional optimization in network performance by introducing insights in normal operations within a domain in a distributed network. If the domain attributes do not exceed the threshold and/or are not greater than the other nodes, a traditional consensus algorithm is used to select leader and follower nodes.