Object Store Mirroring for Redundant Tiered Data Failover
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data storage systems in cloud environments lack adequate redundancy and availability for infrequently accessed data stored in remote object stores, as they often maintain only a single copy within a single location, making them vulnerable to disasters or network issues.
Innovation Solution
Implementing a component that mirrors objects from a primary object store to a mirror object store, ensuring both acknowledge storage before considering the operation complete, allowing failover and migration between different providers, and providing failover capabilities to maintain multiple copies across multiple object stores.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If data is stored in a remote object store with single copy, then storage cost is reduced and scalability is improved, but redundancy and availability deteriorate
Solution Approach 1:
The patent implements mirroring by creating copies of objects from the primary object store and storing them in a mirror object store. This allows the system to maintain multiple copies of data across different locations, thereby improving redundancy and availability while still utilizing cost-effective remote object storage for the primary storage tier.
2Quantity of substance
If multiple copies of objects are stored in the same availability zone, then storage efficiency is improved, but disaster recovery capability deteriorates
Solution Approach 1:
The patent introduces geographic distribution as a new dimension for object storage by maintaining copies in different availability zones or regions. This dimensional expansion ensures that if one location suffers a disaster, copies in other locations remain accessible, thereby improving disaster recovery capability while maintaining storage efficiency.
3Quantity of substance
If data is tiered out to remote object store, then cost effectiveness is improved, but access speed deteriorates
Solution Approach 1:
The patent implements mirroring as a preliminary action where objects are pre-copied to a mirror object store that can provide faster access. When objects are needed, the system can retrieve them from the mirror store rather than the remote tiered store, thereby improving access speed while maintaining the cost benefits of tiering.
4Device complexity
If single copy is maintained in remote object store, then device complexity is reduced, but failover capability deteriorates
Solution Approach 1:
The patent uses copying to create mirror objects in a separate object store, enabling failover capability. The mirroring component automatically manages the replication process, so while copying is implemented, the complexity is abstracted away through automated management of the replication process.
Data Source
AI summary
Techniques are provided for object store mirroring. Data within a storage tier of a node may be determined as being data to tier out to a primary object store based upon a property of the data. A first object is generated to comprise the data. A second object is generated to comprise the data. The first object is transmitted to the primary data store for storage in parallel with the second object being transmitted to a mirror object store for storage. Tiering of the data is designated as successful once acknowledgements are received from both the primary object that the first object was stored and the mirror object store that the second object was stored.