Backup Data Expiration Management for Reducing Rewrite Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
As data backup scales increase, existing backup systems face inefficiencies due to repeated deletion and rewriting of data, which affects their performance, especially when data is deleted due to expiration and then quickly rewritten again.
Innovation Solution
A method that involves obtaining historical operation data to determine if target data needs to be rewritten within a specific time period, adjusting the expiration time of such data to prevent premature deletion and reduce the need for repeated writing, thereby optimizing backup system efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If data is deleted from backup storage device when expiration time is reached, then storage space is freed for new data, but data that is frequently rewritten will be deleted and rewritten repeatedly causing efficiency degradation
Solution Approach 1:
The system performs preliminary actions by obtaining historical operation information about target data before making deletion decisions. It analyzes the historical data to predict whether the target data will be rewritten within a prediction time period, and proactively adjusts the expiration time accordingly. This preliminary analysis prevents premature deletion of data that would be needed soon, thereby avoiding repeated deletion and rewriting operations.
Solution Approach 2:
The system implements feedback by continuously monitoring historical operation information of backup data and using this information to dynamically adjust expiration times. The historical operation information serves as feedback about data access patterns, which is processed to make intelligent decisions about data retention. This feedback mechanism allows the system to adapt to actual data usage patterns and optimize storage efficiency accordingly.
2Productivity
If expiration time is extended for target data, then repeated rewriting operations are reduced, but storage space management becomes more complex
Solution Approach 1:
The system changes the parameter of expiration time dynamically based on historical operation information. Instead of using a fixed expiration time, the system adjusts this parameter adaptively by analyzing data access patterns. The expiration time is modified from its initial value to an adjusted value that prevents premature deletion of frequently accessed data, thereby optimizing backup efficiency without requiring complex manual management.
3Reliability
If historical operation information is analyzed for every data item, then accurate prediction of rewriting needs is achieved, but processing overhead increases
Solution Approach 1:
The system applies partial action by selectively analyzing historical operation information based on whether the data is determined to be target data that requires prediction. Not all data items undergo full historical analysis - only those identified as needing prediction of future rewriting operations. This selective approach maintains high prediction accuracy for relevant data while reducing unnecessary processing overhead for data that doesn't require such analysis.
Data Source
AI summary
Embodiments of the present disclosure provide a method, device and computer program product for managing backup data. The method comprising: obtaining historical information of a plurality of historical operations on target data in a backup storage device during a first time period, the historical information indicating at least types and time of occurrences of the plurality of historical operations; determining, based on the historical information, whether the target data is to be rewritten to the backup storage device within a second time period after the first time period; and in response to determining that the target data is to be written to the backup storage device within the second time period, adjusting an expiration time of the target data in the backup storage device. Based on such a manner, efficiency of the backup system can be increased.