Dynamic Data Migration Between Storage Tiers Using Access Frequency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In a virtualized storage system with multiple tiers of varying cost and performance, determining the optimal distribution of data across these tiers is challenging due to changing data access patterns and the need to maximize the utilization of costly resources, as data access frequencies and ages are not static.
Innovation Solution
Implementing a data migration mechanism that uses Information Lifecycle Management (ILM) statistics, such as access frequency and age, to dynamically move data between tiers, promoting frequently accessed data to higher performance tiers and demoting less frequently accessed data to lower performance tiers, while maintaining efficient data arrangements even under changing access conditions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is statically distributed across storage tiers, then initial performance requirements are met, but the system cannot adapt to changing data access patterns over time
Solution Approach 1:
The patent implements dynamic data migration between storage tiers based on real-time access frequency monitoring. The system continuously tracks how often data is accessed and automatically moves frequently accessed data to higher performance tiers while relocating infrequently accessed data to lower cost tiers, enabling the storage system to adapt its configuration dynamically rather than relying on static initial distribution
Solution Approach 2:
The system employs feedback mechanisms by monitoring data access patterns and using this information to trigger migration decisions. Access frequency statistics serve as feedback signals that inform the migration controller when and what data to move between tiers, creating a closed-loop control system that continuously optimizes data placement based on actual usage patterns
2Speed
If frequently accessed data is placed on high performance storage tiers, then access speed is improved, but the utilization of costly high performance resources decreases
Solution Approach 1:
The patent applies local quality by placing only the specific data that requires high performance (frequently accessed data) on high performance storage tiers, while other data resides on lower cost tiers. This selective placement ensures that high performance resources are concentrated on the data that actually needs them, optimizing both access speed for critical data and overall resource utilization across the entire storage system
3Manufacturing precision
If data migration is performed frequently to maintain optimal placement, then data placement optimization is improved, but system overhead and migration time increase
Solution Approach 1:
The system implements periodic action by performing data migration at scheduled intervals rather than continuously or on every access event. The migration process is triggered periodically based on monitored access frequency thresholds, allowing the system to maintain optimized data placement while avoiding the overhead of excessive migration operations that would consume unnecessary time and resources
Data Source
AI summary
Technologies are described for implementing a migration mechanism in a storage system containing multiple tiers of storage with each tier having different cost and performance parameters. Access statistics can be collected for each territory, or storage entity, within the storage system. Data that is accessed more frequently can be migrated toward higher performance storage tiers while data that is accessed less frequently can be migrated towards lower performance storage tiers. The placement of data may be governed first by the promotion of territories with higher access frequency to higher tiers. Secondly, data migration may be governed by demoting territories to lower tiers to create room for the promotion of more eligible territories from the next lower tier. In instances where space is not available on the next lower tier, further demotion may take place to an even lower tier in order to make space for the first demotion.