Storage Tiering via Deduplicated Segment Transfer
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data systems incur inefficiencies and resource costs when moving files between storage tiers, as they typically require transferring entire files, which loses the benefits of deduplication and compression, and can consume significant network bandwidth and server processing capacity.
Innovation Solution
The method involves segmenting files into deduplicated segments, allowing only missing segments to be transferred between tiers while maintaining metadata updates and verification processes to ensure data integrity and efficiency, thereby preserving the benefits of deduplication and compression during tier transitions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If files are moved between storage tiers by transferring entire files, then data can be relocated between tiers, but network bandwidth and server processing capacity are consumed significantly and deduplication benefits are lost
Solution Approach 1:
The patent segments files into smaller data blocks and transfers only the specific blocks that need to be moved between storage tiers, rather than transferring entire files. This segmentation allows the system to move minimal data while maintaining deduplication benefits, thereby reducing network bandwidth consumption and server processing capacity requirements while preserving storage operation efficiency
Solution Approach 2:
The patent extracts and transfers only the necessary data blocks that differ between source and destination tiers, leaving redundant blocks unchanged. This extraction approach eliminates unnecessary data transfer, reducing network bandwidth and server processing capacity consumption while maintaining high storage operation efficiency through selective block movement
2Quantity of substance
If entire files are transferred between tiers, then data relocation is achieved, but deduplication benefits are lost
Solution Approach 1:
The patent divides files into data blocks and selectively transfers only the segments (blocks) that need to change tiers, rather than moving entire files. This segmentation enables the system to maintain deduplication benefits by keeping redundant blocks in place while only moving necessary segments, thus reducing data transfer volume while preserving adaptability and versatility of the storage system
Solution Approach 2:
The patent extracts only the specific data blocks that require tier migration and leaves redundant blocks unchanged. This extraction method reduces the quantity of data transferred while maintaining deduplication benefits, as the system transfers minimal data while preserving the versatility of the storage architecture through selective block movement
Data Source
AI summary
A method, article of manufacture, and apparatus for transferring data from a source tier to a target tier. In some embodiments, this may include applying a policy to an object in the source tier, determining the target tier based on the policy, and moving the object from the source tier to the target tier based on the policy. In some embodiments, determining the target tier based on the policy may include determining a higher target tier. In some embodiments, determining the target tier based on the policy may include determining a lower target tier.