Cold Data Relocation Across Cloud-Based Storage Ranks
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional storage systems are inefficient in managing and relocating cold data, leading to unnecessary storage space usage and inefficiencies due to the inability to dynamically relocate data to cloud-based storage systems, which lack advanced management features like RAID arrays.
Innovation Solution
Implementing a relocation module that monitors data access patterns and moves data not accessed for a predetermined time to cloud-based ranks, creating virtual RAID arrays that appear as local storage, enabling efficient data relocation and management.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If data is stored on local ranks in conventional storage systems, then data access speed is maintained, but storage space efficiency deteriorates due to inability to relocate cold data
Solution Approach 1:
The system dynamically relocates data between local and cloud-based ranks based on access patterns. The relocation module continuously monitors data access and automatically moves cold data to cloud storage while keeping hot data on local storage, making the storage system adaptive rather than static.
Solution Approach 2:
The relocation module acts as an intermediary between local storage and cloud storage, managing data movement transparently. It monitors access patterns and facilitates automatic data relocation between the two storage environments without requiring application-level intervention.
2Quantity of substance
If cloud-based storage is used for cold data, then storage space efficiency is improved, but advanced management features like RAID arrays are lost
Solution Approach 1:
The system provides universal management capabilities across both local and cloud-based ranks. The relocation module implements RAID-like redundancy and management features on cloud-based virtual ranks, enabling the same advanced storage management functions to operate on cloud storage as on local storage.
Solution Approach 2:
The system creates virtual copies of local rank structures in the cloud environment. Cloud-based ranks are presented as virtual local ranks with identical management interfaces, allowing RAID arrays and other management features to be replicated in the cloud storage environment.
3Ease of operation
If manual data relocation is performed, then storage management control is maintained, but productivity deteriorates due to manual intervention requirements
Solution Approach 1:
The storage system performs self-service through automated monitoring and relocation of data. The relocation module automatically identifies cold data based on access patterns and relocates it to cloud storage without requiring administrator intervention, while still providing full management control through the user interface.
Solution Approach 2:
The system implements continuous feedback loops by monitoring data access patterns and using this information to automatically adjust data placement. The relocation module receives feedback from access monitoring and automatically responds by relocating data that becomes cold, creating a closed-loop control system.
Data Source
AI summary
An example method for dynamic data relocation using cloud based ranks comprises monitoring accesses to data stored on a plurality of local ranks of an enterprise storage system; identifying data which has not been accessed for a predetermined amount of time based on the monitored accesses; and moving the data which has not been accessed for the predetermined amount of time to one or more cloud based ranks of the enterprise storage system, wherein each cloud based rank comprises storage space on one or more cloud storage devices, the storage space on the one or more cloud storage devices mapped to corresponding virtual local addresses that are grouped as a virtual local rank.