Automated Data Relocation in Storage Grids
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Data access systems face challenges in maintaining availability and efficient resource utilization due to unpredictable data size growth and differences between protected data and stored data, leading to potential performance degradation and increased storage costs.
Innovation Solution
A method involving a storage grid with source and target chains of nodes, where data is initially stored on a source chain with primary and secondary nodes, and then relocated to a target chain while maintaining continuous access, allowing for efficient use of resources and relocation without interrupting data access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored on vaults at remote sites, then data protection and availability are improved, but storage capacity management becomes complex and performance degradation may occur when vaults fill up
Solution Approach 1:
The system implements automated self-service through the data relocation engine that continuously monitors vault capacity metrics and autonomously triggers data relocation operations when thresholds are exceeded, eliminating the need for manual capacity management intervention
Solution Approach 2:
The system employs feedback mechanisms by monitoring vault capacity metrics and using this information to trigger automated relocation operations, creating a closed-loop control system that maintains optimal storage capacity without manual intervention
2Productivity
If data is relocated from source chain to target chain, then storage resource utilization is optimized, but data access continuity must be maintained
Solution Approach 1:
The system performs preliminary actions by establishing the target chain and pre-positioning data copies before initiating the relocation process, ensuring that data access paths are already prepared and data continuity is maintained throughout the migration
Solution Approach 2:
The system uses an intermediary approach by maintaining active data access through the source chain during the relocation process while simultaneously establishing the target chain, allowing seamless data access without interruption during the transition
3Reliability
If compression and encryption are applied to protected data, then data security is improved, but the difference between protected data size and stored data size increases
Solution Approach 1:
The system implements feedback by continuously monitoring actual vault capacity consumption and using this information to make real-time decisions about data relocation, compensating for the unpredictability introduced by compression and encryption variations
4Productivity
If automated data relocation is implemented, then vault capacity optimization is improved, but system complexity increases
Solution Approach 1:
The system merges multiple functions into the target chain structure, which simultaneously serves as both a data storage destination and a data access pathway, reducing the need for separate management systems and simplifying the overall architecture
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods of providing access to data are presented. The method includes providing a storage grid which includes a source chain of storage nodes and a target chain of storage nodes, the source chain including a primary source node and a secondary source node which operates as a data mirror of the primary source node, and the target chain including a primary target node and a secondary target node which operates as a data mirror of the primary target node. The method also includes initially storing data on the source chain, the primary source node of the source chain maintaining a primary source copy of the data, and the secondary source node of the source chain maintaining a secondary source copy of the data. The method further includes relocating the data from the source chain to the target chain, the primary target node of the target chain maintaining a primary target copy of the data, and the secondary target node of the target chain maintaining a secondary target copy of the data, access to the data being continuously provided from the storage grid to an external device before, during, and after relocation of the data from the source chain to the target chain.