Versioned Backup on Object Addressable Storage
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing key-value object addressable storage systems face inefficiencies in managing versioned snapshots of file systems, leading to unpredictable behavior and high costs in storage space management due to the need for relational searches, which do not scale with the size of the file system.
Innovation Solution
The method creates dedicated deleted item key-value objects for file system items, allowing for efficient storage reclaim by inspecting stored objects directly, without needing relational searches, and generates unique identifiers for snapshots based on file system item paths and versions, enabling linear scalability in removing expired snapshots.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If relational searches are performed to find dependencies in object addressable storage system, then complete file system structure can be maintained, but storage space management becomes inefficient and costs increase
Solution Approach 1:
The patent segments the file system representation into two distinct parts: (1) a metadata structure stored in a database that maintains the hierarchical file system structure and relationships, and (2) actual file data stored as objects in the object addressable storage system. This segmentation allows the metadata to be managed efficiently for structure integrity while object storage handles data scalability, resolving the contradiction between maintaining complete file system structure and efficient storage management.
Solution Approach 2:
The patent introduces a metadata database as an intermediary layer between the object addressable storage system and the file system structure. This metadata database stores information about file relationships, hierarchies, and dependencies without requiring relational searches in the object storage system itself. The metadata acts as a mediator that enables efficient storage space management while maintaining file system structure integrity.
2Device complexity
If snapshots are stored in object addressable storage system without dedicated deleted item objects, then storage structure remains simple, but storage space reclaim becomes unpredictable and inefficient
Solution Approach 1:
The patent implements self-service mechanisms where the metadata database automatically tracks which objects are referenced by which file system items and versions. When snapshots expire, the system automatically identifies and reclaims storage space for deleted items without requiring complex relational searches. This self-service approach maintains storage structure simplicity while enabling efficient and predictable storage space reclamation.
Solution Approach 2:
The patent establishes a feedback mechanism where the metadata database continuously maintains information about object references and dependencies. This feedback enables the system to predictably identify which deleted items can have their storage space reclaimed, transforming the unpredictable storage reclamation process into an efficient, information-driven operation that maintains simplicity while improving productivity.
3Ease of manufacture
If traditional snapshot methods are used without dedicated deleted item key-value objects, then implementation remains simple, but storage space management becomes expensive and unpredictable
Solution Approach 1:
The patent segments storage management into metadata management (handled by the database with simple implementation) and object data management (handled by the object addressable storage system). This segmentation maintains implementation simplicity while enabling efficient storage space reclamation, thereby reducing storage costs without complicating the overall system architecture.
Solution Approach 2:
The metadata database serves as an intermediary that provides the information needed for efficient storage space management without requiring complex implementation in the object storage system itself. This intermediary approach maintains ease of implementation while enabling cost-effective storage space reclamation through automated tracking and identification of reclaimable objects.
Data Source
Figure 1~2
Figure 3~4
Figure 5
AI summary
Example embodiments relate to method for making a versioned snapshot of a file system comprising file system items onto a key-value object addressable storage system further comprising i) creating (201) new key-value objects on the object addressable storage system associated with respective new versions of the file system items; ii) when a file system item was deleted on the file system with respected to a previous snapshot, creating (202) a deleted item key-value object on the object addressable storage system indicative for a deletion of the deleted file system item on the file system; and iii) when the deleted file system item is a directory, creating (203) deleted item key-value objects for the respective files system items in the directory.