Shadow Copy Storage Space Management
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing shadow copy technologies face challenges in preserving shadow copies for extended periods due to insufficient storage space, leading to potential data loss when the diff-area is overwhelmed by increased main data storage needs.
Innovation Solution
Implementing a system that automatically determines and manages shadow copy storage space based on write rates from the production server, throttling write operations to prevent overwriting valid shadow copies, and adjusting storage space to accommodate anticipated growth, ensuring valid data retention according to administrator-defined backup intents.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If copy-on-write method is used to create shadow copies, then shadow copies are created efficiently with point-in-time information, but existing shadow copies are deleted when the diff-area becomes insufficient to store changed blocks
Solution Approach 1:
The system performs preliminary actions by monitoring the diff-area capacity before it becomes insufficient. The replica agent tracks the capacity of the diff-area and proactively manages shadow copy creation to ensure valid shadow copies are preserved, preventing the scenario where shadow copies are deleted due to insufficient space.
Solution Approach 2:
The system implements feedback mechanisms where the replica agent continuously monitors the diff-area capacity and adjusts shadow copy creation accordingly. This feedback loop ensures that shadow copy creation is controlled based on available space, preventing deletion of valid shadow copies while maintaining efficient replication.
2Reliability
If diff-area is increased to store more changed blocks, then shadow copy retention is improved, but storage space requirements and system complexity increase
Solution Approach 1:
The system enables self-service by having the replica agent automatically monitor and manage diff-area capacity. The agent independently tracks capacity levels and controls shadow copy creation without requiring manual intervention or complex administrative configurations, simplifying storage space management while ensuring shadow copy retention.
3Reliability
If write operations are throttled to prevent overwriting valid shadow copies, then data retention is ensured, but replication speed decreases
Solution Approach 1:
The system applies dynamics by making write operation throttling adaptive rather than static. The replica agent dynamically adjusts replication based on real-time monitoring of diff-area capacity and shadow copy validity, allowing full replication speed when space is available and implementing throttling only when necessary to prevent overwriting valid shadow copies.
Data Source
AI summary
Controlling data retention of a collection of data in a data store. An instruction is received to store a shadow collection of data to the data store. The data store has a previous version of the shadow collection of data. An available amount of data storage space on the data store is identified. An amount of data storage space needed is estimated for storing the shadow collection of data to the data store based on the received instruction. It is determined whether the identified available amount of data storage space is sufficient for storing the estimated amount of data storage space. The shadow collection of data is stored to the data store when said determine indicates that the identified available amount of data storage space is sufficient and the previous version is permitted to be deleted or to be overwritten.