Multi-service storage layer for cloud data resilience
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud provider networks face challenges in maintaining high availability of mission-critical data due to correlated failures across geographic regions, despite existing redundancy measures, which can lead to temporary interruptions affecting business operations.
Innovation Solution
A multi-service storage layer is implemented across different storage services and regions, providing a unified API for storing and retrieving data, ensuring data redundancy and resilience through replication across multiple storage services such as object, relational database, and NoSQL database services, and enabling failover mechanisms to maintain data accessibility during outages.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in a single storage service or region, then storage simplicity is maintained, but data availability and reliability are reduced due to correlated failures
Solution Approach 1:
The patent segments data storage across multiple storage services (first storage service, second storage service) and geographic regions. Each storage service maintains separate data copies, so that failure in one service or region does not affect data accessibility through other segments. This segmentation directly resolves the contradiction by improving reliability through distribution while managing complexity through modular architecture.
Solution Approach 2:
The patent introduces additional dimensions to the storage architecture by distributing data across multiple storage services and geographic regions rather than relying on a single storage location. This multi-dimensional distribution strategy improves reliability by ensuring data accessibility from alternative dimensions (different services, different regions) when one dimension fails.
2Reliability
If data is replicated across multiple storage services and regions, then data availability is improved, but system complexity increases
Solution Approach 1:
The patent implements a unified storage interface that provides universal access to data replicated across multiple storage services and regions. This universal interface abstracts the underlying complexity of multi-service replication, allowing applications to access data through a consistent API regardless of which storage service or region actually serves the request. This resolves the contradiction by maintaining simplicity at the application level while enabling complex replication for reliability.
Solution Approach 2:
The patent introduces a multi-service storage layer as an intermediary between applications and the underlying storage services. This intermediary manages the complexity of data replication, failover, and coordination across multiple storage services and regions, while presenting a simplified interface to applications. The intermediary absorbs the complexity of multi-service coordination, resolving the contradiction between reliability improvement and system complexity.
3Reliability
If redundant storage systems are implemented, then failover capability is improved, but operational complexity increases
Solution Approach 1:
The patent implements automatic failover mechanisms where the storage system autonomously detects failures and redirects operations to redundant storage services without manual intervention. The system self-manages the complexity of monitoring, detecting, and executing failover across multiple storage services and regions, improving reliability while maintaining ease of operation by eliminating the need for manual failover management.
Solution Approach 2:
The patent employs feedback mechanisms where the storage system continuously monitors the health and availability of replicated data across multiple storage services and regions. When failures are detected, the feedback loop automatically triggers failover to healthy replicas. This automated feedback-driven approach improves failover effectiveness while reducing operational complexity by eliminating manual monitoring and intervention requirements.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Techniques are described for providing a multi-service storage layer in a cloud provider network for applications and workloads that are highly sensitive to outages affecting "mission critical" data or other resources. A multi-service storage layer is designed to provide additional resiliency against various types of correlated failures among existing geographic regions by enabling the storage of data using a plurality of separate storage services and storage resource types and across a plurality of regions of the cloud-provider network. A multi-service storage layer provides an application programming interface (API) with actions for storing, retrieving, and querying data stored in a highly available storage resource across a selection of underlying storage services. The ability to store critical data and other resources using a multi-service storage layer provides additional resiliency while also providing a single interface that applications can use to interact with the data stored across any number of underlying storage services.