Cloud Storage Format for Space Reclamation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Organizations face high costs when deleting data from cloud storage, as current methods often incur additional transactional costs due to the need to retrieve and rewrite entire objects, even when only a portion of the data needs to be deleted.
Innovation Solution
A storage appliance maintains a table of contents for data slabs, allowing for deferred deletion of constituent data units, which reduces the need for full object retrieval and modification, and uses partial read commands to limit data transfer, thereby minimizing costs and overhead.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If current cloud storage deletion methods are used, then data can be deleted from cloud storage, but additional transactional costs are incurred due to the need to retrieve and rewrite entire objects
Solution Approach 1:
The patent segments the data object into two separate components: a table of contents (metadata) and the actual data payload. This segmentation allows independent manipulation of the metadata without requiring retrieval or rewriting of the entire data object, thereby reducing transactional costs while enabling precise control over data deletion and management operations.
2Loss of substance
If entire objects are retrieved and rewritten for deletion, then data can be deleted from cloud storage, but data transfer overhead increases
Solution Approach 1:
The patent extracts the table of contents (metadata) from the data object and stores it separately in the cloud storage system. This extraction enables deletion operations to be performed by modifying only the metadata without retrieving or transferring the actual data payload, significantly reducing data transfer overhead while maintaining operational simplicity through standardized API interactions.
3Quantity of substance
If partial read commands are implemented, then data transfer can be minimized, but storage format complexity increases
Solution Approach 1:
The patent introduces a new dimensional organization to cloud storage by implementing a hierarchical structure where metadata (table of contents) is separated from and independently accessible to the data payload. This dimensional change enables partial read operations on metadata without requiring access to the entire data object, minimizing data transfer volume while the standardized metadata format keeps storage format complexity manageable.
Data Source
AI summary
A method, non-transitory computer readable medium, and device that assists with managing cloud storage includes identifying a portion of data in a data unit identified for deletion in the metadata. The identified portion of the data identified for delete is compare to a threshold amount. Deletion of the data unit from a first storage object is deferred when the determined portion of data identified for deletion is less than the threshold amount. A second storage object with a portion of data unmarked for deletion in the data unit is generated when the determined portion of data marked for deletion is equal to the threshold amount, wherein the second storage object has a same identifier as the first storage object.