Hybrid Storage Data Retention with Access-Based Cloud Discard
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The high cost of retaining data on both on-premises and cloud storage systems in hybrid cloud environments is exacerbated by cloud storage billing based on capacity and duration, and data transfer costs when access frequencies change, as seen in existing methods like Japanese Patent No. 6317524.
Innovation Solution
A computer system comprising a first storage system on-premises and a second storage system in the cloud, where data is stored in logical and virtual volumes, and access statuses determine data retention or discard, reducing unnecessary cloud storage usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If data is retained on both on-premises and cloud storage systems in hybrid cloud environments, then data availability and access flexibility are improved, but cloud storage costs increase due to billing based on capacity and duration
Solution Approach 1:
The patent implements automatic data discard mechanisms on the cloud storage side based on access frequency analysis. Data that is not frequently accessed by the on-premises storage system is automatically discarded from cloud storage, while maintaining the ability to recover or re-fetch this data when needed. This resolves the contradiction by dynamically managing cloud storage capacity - retaining only necessary data while preserving data access flexibility through on-demand recovery capabilities.
Solution Approach 2:
The system dynamically adjusts cloud storage capacity based on real-time access patterns. The storage system continuously monitors data access frequency and automatically modifies which data is retained or discarded from cloud storage, transforming the static storage allocation into a dynamic, adaptive system that optimizes costs while maintaining necessary data availability.
2Quantity of substance
If data access frequency monitoring is implemented to determine data retention, then cloud storage costs are reduced, but system complexity and processing overhead increase
Solution Approach 1:
The storage system performs self-monitoring of data access patterns without requiring external intervention or complex external management systems. The on-premises storage system automatically tracks its own data access frequency to the cloud, and this information is used to automatically control data retention decisions, eliminating the need for separate complex monitoring infrastructure.
Solution Approach 2:
The system implements a feedback loop where data access frequency information is continuously collected and fed back into the data retention decision-making process. This feedback mechanism enables automatic adjustment of cloud storage capacity based on actual usage patterns, reducing the need for complex manual management systems while achieving optimal cost efficiency.
3Quantity of substance
If data is discarded from on-premises storage and retained on cloud storage, then on-premises storage costs are reduced, but data transfer costs increase when data needs to be retrieved from the cloud
Solution Approach 1:
The patent implements selective data discard on the on-premises side combined with intelligent recovery mechanisms. Data is discarded from on-premises storage only when access frequency analysis indicates it can be efficiently recovered from cloud storage. The system monitors access patterns and retains data locally when access frequency justifies the storage cost, thereby minimizing unnecessary data transfer while still achieving on-premises storage cost reduction.
Data Source
AI summary
A first storage system stores data related to execution of a first server in a logical volume, and transmits the data stored in the logical volume to a second storage system. The second storage system provides a virtual volume to the second server, and stores the data received from the first storage system in the virtual volume. The second storage system executes a process by using data stored in the virtual volume at each execution timing. Then, the second storage system determines whether the data stored in the virtual volume is left in the virtual volume or is discarded based on the presence or absence of an access and the type of access, which are access statuses to the data at each execution timing, and discards the data determined to be discarded from the virtual volume.