Data Storage Policy Engine for Automated Migration and Metadata Replacement
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage systems face inefficiencies due to the 80/20 rule, where 80% of data is rarely accessed, leading to costly and wasteful strategies for managing infrequently used data, and existing solutions like archiving and backups are time-consuming and disruptive.
Innovation Solution
A method involving a policy engine that automatically identifies candidate data units and migrates them to secondary storage, replacing them with metadata to free up primary storage space, while maintaining data integrity and accessibility.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is kept in primary storage to maintain accessibility, then data access speed is improved, but storage cost increases
Solution Approach 1:
The patent segments data into frequently accessed and infrequently accessed portions, keeping only the necessary segments in primary storage while moving others to secondary storage. This segmentation allows the system to maintain fast access for critical data while reducing overall storage costs by eliminating the need to keep all data in expensive primary storage.
Solution Approach 2:
The patent applies local quality by providing different storage characteristics to different data portions based on their access patterns. Frequently accessed data receives high-speed primary storage, while infrequently accessed data is placed in lower-cost secondary storage, optimizing both performance and cost for each specific data portion.
2Quantity of substance
If data is archived to tertiary storage to reduce cost, then storage cost is reduced, but data accessibility deteriorates
Solution Approach 1:
The patent introduces a file system layer as an intermediary between applications and storage devices. This file system transparently manages data movement between primary and secondary storage, presenting a unified access interface to applications while optimizing storage cost by keeping infrequently accessed data in secondary storage without significantly impacting accessibility.
3Quantity of substance
If backups are performed to move data to less expensive medium, then storage cost is reduced, but time consumption increases
Solution Approach 1:
The patent performs preliminary actions by proactively identifying and moving infrequently accessed data to secondary storage before it is actually needed. This prevents the need for time-consuming emergency backups, as the data is already in secondary storage and can be quickly retrieved when needed, rather than requiring full backup operations.
4Quantity of substance
If data migration is performed manually to manage storage capacity, then storage capacity is optimized, but operational complexity increases
Solution Approach 1:
The patent implements self-service through automated file system monitoring and data migration capabilities. The system automatically tracks data access patterns, identifies candidates for migration to secondary storage, and performs the migration without manual intervention, thereby optimizing storage capacity while eliminating operational complexity associated with manual data management.
Data Source
AI summary
A method is used in managing data on data storage systems. Rules are defined for candidate data unit selection. The rules are automatically executed on a primary data storage system to examine data units on the primary data storage system. The rules are applied to the data units. A data unit is identified that matches the rules and the identified data unit is migrated. The identified data unit is copied from the primary storage system to a secondary storage system. The identified data unit on the primary storage system is replaced with metadata. the data storage space in the primary storage system corresponding to the identified data unit is freed up.