Auxiliary Storage Snapshot Backup in Flat Microservice Clusters
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
There is a need for reliable snapshot backup management techniques for auxiliary storage services in storage clusters that do not use core storage services and must adhere to the flat cluster principle, where functions are distributed evenly between storage nodes, and state information must be independently protected without relying on core storage services.
Innovation Solution
The method involves generating a snapshot of state information on an auxiliary storage service and distributing it to a set of protector storage nodes within the storage cluster, where the protector nodes are selected based on a hierarchical ranking and configured in a protection ring, allowing for independent snapshot management and protection without relying on core services.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If snapshot backup is distributed to M protector storage nodes selected based on hierarchical ranking in a protection ring, then reliability of state information backup is improved, but device complexity increases due to the need for hierarchical ranking and protection ring configuration
Solution Approach 1:
The storage cluster is segmented into a protection ring structure where storage nodes are organized in a hierarchical ranking. The snapshot backup is segmented and distributed to M specific protector storage nodes selected from this ring, rather than using a single centralized backup location. This segmentation improves reliability by distributing backup across multiple nodes while the ring structure provides an organized method for selection.
Solution Approach 2:
The protection ring and hierarchical ranking of storage nodes are pre-configured before backup operations occur. This preliminary organization allows for efficient selection of protector nodes during backup operations without requiring complex real-time decision-making. The hierarchical ranking is established in advance, enabling quick identification of appropriate protector nodes when snapshots need to be distributed.
2Adaptability or versatility
If auxiliary storage services manage snapshots independently without core storage services, then independence and functionality during core service unavailability is improved, but loss of information increases due to lack of centralized management
Solution Approach 1:
Multiple protector storage nodes are combined to collectively manage and protect snapshot information. Instead of relying on a single centralized service, the snapshot is distributed and protected across M protector nodes in the protection ring. This merging of multiple independent nodes provides both the independence needed for auxiliary services to operate without core services while maintaining information safety through redundancy.
Solution Approach 2:
The system provides beforehand cushioning by creating redundant copies of snapshot data across multiple protector storage nodes before any potential failure occurs. This prior cushioning ensures that if any single node fails or becomes unavailable, the snapshot information is still protected and recoverable from other protector nodes, preventing information loss.
3Productivity
If functions are distributed evenly across all storage nodes in a flat cluster arrangement, then productivity and scalability are improved, but reliability of specific auxiliary services decreases due to lack of dedicated resources
Solution Approach 1:
While maintaining the overall flat cluster structure for scalability, the invention applies local quality by designating specific protector storage nodes with specialized roles in the protection ring. These local designations provide dedicated resources for snapshot protection without requiring a complete restructuring of the distributed architecture. Each node maintains its general distributed function while selected nodes have the additional quality of being protector nodes.
Solution Approach 2:
Storage nodes in the protection ring serve multiple functions: they participate in the distributed flat cluster arrangement for general storage operations while simultaneously serving as protector nodes for snapshot backup. This multi-functionality allows the same nodes to provide both the scalability benefits of distributed architecture and the reliability benefits of dedicated backup resources, eliminating the need for completely separate specialized hardware.
Data Source
AI summary
Methods and apparatus are provided for protection of state information for an auxiliary storage service in a microservice architecture. An exemplary method comprises generating a snapshot of state information of an auxiliary storage service on a given storage node in a storage cluster comprised of a plurality of storage nodes; and providing the snapshot to M protector storage nodes within the plurality of storage nodes in the storage cluster, wherein the M protector storage nodes comprises a snapshot manager node and M−1 additional protector storage nodes, and wherein the M protector storage nodes are selected based on a hierarchical ranking of available storage nodes within the storage cluster arranged in a predefined configuration relative to the given storage node. The predefined configuration of the plurality of storage nodes can be, for example, a protection ring comprising a first M−1 online storage nodes that follow the snapshot manager node in the protection ring in a predefined direction.