Object File System for Scalable Snapshot Management in Cloud Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Primary storage systems provide robust data storage and management features but are costly and less scalable compared to cloud computing storage, with their functionalities not being compatible with cloud computing storage, leading to loss of features when hybrid systems are used.
Innovation Solution
An object file system is employed to store and manage data in a cloud computing environment, allowing for structured data representation, snapshot management, and version neutrality, with features like deduplication and garbage collection to optimize storage efficiency and accessibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If primary storage systems are used to provide robust data storage and management features, then data management functionality is improved, but cost and scalability deteriorate
Solution Approach 1:
The patent segments storage functionality into two parts: primary storage systems handle robust data management features (snapshots, deduplication, encryption), while cloud object stores handle scalable storage. The snapshot file system acts as an intermediary that enables primary storage features to operate on cloud-stored snapshots, allowing each component to operate in its optimal environment.
Solution Approach 2:
The snapshot file system serves as an intermediary layer between the primary storage system and the cloud object store. It translates snapshot operations into object store-compatible formats, enabling primary storage functionality to be preserved while using cloud storage infrastructure, thus resolving the contradiction between feature robustness and scalability.
2Reliability
If primary storage systems are used to provide robust data storage features, then storage functionality is improved, but cost increases
Solution Approach 1:
The patent creates snapshots as copies of data and stores these snapshots in the cloud object store rather than maintaining full primary storage systems for all data. This allows the system to leverage cheaper cloud storage for snapshot retention while preserving primary storage functionality through the snapshot file system intermediary.
Solution Approach 2:
The system discards the need to maintain expensive primary storage infrastructure for long-term snapshot retention by transferring snapshots to cloud object stores. When snapshots are needed, they are recovered through the snapshot file system which translates access requests into cloud storage operations, thus reducing ongoing storage costs while maintaining functionality.
3Adaptability or versatility
If snapshots are stored in cloud object stores, then scalability is improved, but snapshot management functionality deteriorates
Solution Approach 1:
The snapshot file system acts as an intermediary that restores snapshot management functionality on top of cloud object stores. It provides a file system interface that understands snapshot semantics, enabling users to create, access, and manage snapshots with the same functionality as primary storage systems while leveraging the scalability of cloud object storage underneath.
Solution Approach 2:
The snapshot file system provides universal access to snapshots stored in cloud object stores through a standardized file system interface. This single intermediary layer supports multiple snapshot operations (creation, deletion, restoration, cloning) and works with any underlying object store, making the system both scalable and functionally complete.
4Quantity of substance
If hybrid storage environments are used to achieve cost savings, then storage cost is reduced, but feature compatibility deteriorates
Solution Approach 1:
The snapshot file system serves as a compatibility layer that translates primary storage snapshot operations into cloud object store operations. This intermediary enables feature compatibility between primary storage systems and cloud object stores, allowing hybrid environments to maintain full snapshot functionality while achieving cost savings through cloud storage utilization.
Data Source
AI summary
Techniques are provided for an object file system for an object store. Data, maintained by a computing device, is stored into slots of an object. The data within the slots of the object is represented as a data structure comprising a plurality of nodes comprising cloud block numbers used to identify the object and particular slots of the object. A mapping metafile is maintained to map block numbers used to store the data by the computing device to cloud block numbers of nodes representing portion of the data stored within slots of the object. The object is stored into the object store, and the mapping metafile and the data structure are used to provide access through the object file system to portions of data within the object.