Configurable Cache Cluster Modes for Fault Recovery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed cache systems face issues with service node unavailability and data loss due to cache service node failures, leading to interruptions in service and loss of data, especially under high concurrent request environments.
Innovation Solution
Implementing a method where a cache client tags a failed master cache service node and selects a backup node to redirect requests, with configuration modes for active and standby clusters that enable automatic fault recovery and uninterrupted data access, including dynamic selection of backup nodes and asynchronous processing to maintain data consistency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is distributed to cache service nodes by a predetermined algorithm, then cache performance is improved, but system reliability deteriorates when a cache service node fails
Solution Approach 1:
The patent implements dynamic cluster configuration modes that allow the cache system to adapt its operation mode based on the status of cache service nodes. The system can switch between active cluster mode (multiple nodes serving requests) and standby cluster mode (one master node serving requests, others as backups), enabling flexible response to node failures while maintaining cache performance through appropriate mode selection
Solution Approach 2:
The patent establishes backup cache service nodes in advance that can immediately take over when a master cache service node fails. The backup nodes are pre-configured and ready to assume the master role, eliminating service interruption and data loss risks associated with predetermined distribution algorithms when failures occur
2Stability of the object's composition
If a cache service node behaves abnormally, then data distribution stability is improved, but service availability deteriorates due to interruption
Solution Approach 1:
The patent implements a heartbeat detection mechanism that continuously monitors the status of cache service nodes. When a node behaves abnormally, the system detects the anomaly through missed heartbeats and triggers automatic failure handling procedures, including switching to backup nodes or adjusting cluster configuration modes, thereby maintaining service availability while preserving data distribution stability
Solution Approach 2:
The patent prepares backup cache service nodes and failure handling mechanisms in advance to cushion against the impact of node failures. The standby cluster configuration maintains backup nodes ready to immediately assume service responsibilities, preventing service interruption and data loss before they can occur
3Productivity
If further requests are distributed to a failed cache service node, then load balancing is improved, but data loss increases
Solution Approach 1:
The patent enables the cache system to automatically detect node failures through heartbeat mechanisms and self-correct by redirecting requests away from failed nodes. The system autonomously manages failover to backup nodes and adjusts request distribution without external intervention, preventing data loss while maintaining load balancing across healthy nodes
Solution Approach 2:
The patent introduces a cluster configuration management mechanism that acts as an intermediary between request distribution and cache service nodes. This intermediary monitors node status and dynamically adjusts request routing based on cluster configuration modes, ensuring requests are directed only to healthy nodes while maintaining balanced load distribution
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
Processing cache data includes sending a cache processing request to a master cache service node in a cache cluster that includes a plurality of cache service nodes, the cache cluster being configurable in an active cluster configuration mode wherein the plurality of cache service nodes are all in working state and a master cache service node is selected among the plurality of cache service nodes, or in a standby cluster configuration mode, wherein the master cache service node is the only node among the plurality of cache service nodes that is in working state. It further includes waiting for a response from the master cache service node, determining whether the master cache service node has failed; and in the event that the master cache service node has failed, selecting a backup cache service node.