Delta Journal Consolidation for Cloud Backup RTO
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data protection systems incur high costs and prolonged recovery times due to unnecessary data storage and processing of unnecessary data during backup and recovery operations, particularly when using cloud-based solutions like Amazon S3, which affects the Recovery Time Objective (RTO) and storage costs.
Innovation Solution
The system optimizes data protection by consolidating delta journals with device data during protection operations, reducing the amount of processing and data transfer needed during recovery, and eliminating the need for full snapshot mechanisms, allowing for efficient data transfer and storage by organizing delta journals into offset delta journals and applying them directly to segments, thereby reducing RTO and storage costs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If data is stored in cloud storage for backup and recovery operations, then data protection capability is improved, but storage costs and processing costs increase due to unnecessary data retention
Solution Approach 1:
The patent applies the discarding and recovering principle by automatically deleting delta journals after their recovery purpose has been fulfilled. The system monitors whether a delta journal is needed for potential recovery operations, and once confirmed unnecessary, deletes it to free up storage space and reduce costs. This ensures data protection capability is maintained when needed while eliminating wasteful storage of obsolete data.
Solution Approach 2:
The patent implements preliminary action by pre-calculating and determining the necessity of retaining each delta journal before actual recovery operations occur. The system proactively assesses whether delta journals are needed for future recovery scenarios and makes deletion decisions in advance, preventing unnecessary storage accumulation and reducing ongoing processing costs.
2Reliability
If all delta journals are retained for potential recovery operations, then recovery reliability is improved, but storage space consumption increases
Solution Approach 1:
The patent applies discarding and recovering by systematically identifying and deleting delta journals that are no longer needed for recovery. The system evaluates each delta journal's necessity based on recovery requirements and deletes those confirmed unnecessary, thereby reducing storage space consumption while preserving recovery reliability through selective retention of essential data.
Solution Approach 2:
The patent extracts and removes unnecessary delta journals from the storage system. By separating needed delta journals from unnecessary ones and deleting the latter, the system reduces storage space consumption while maintaining the integrity and availability of recovery-critical data.
3Reliability
If delta journals are processed and transferred during recovery operations, then data recovery capability is improved, but processing time and data transfer time increase
Solution Approach 1:
The patent extracts and deletes unnecessary delta journals before recovery operations commence. By removing irrelevant data in advance, the system reduces the total volume of data that needs to be processed and transferred during recovery, thereby decreasing processing time and data transfer time while preserving full recovery capability for essential data.
Solution Approach 2:
The patent performs preliminary deletion of unnecessary delta journals before recovery operations are initiated. This advance action reduces the data burden that would otherwise need to be processed during recovery, optimizing processing time and data transfer efficiency without compromising recovery capability.
4Reliability
If cloud storage is used for backup operations, then data protection coverage is improved, but costs associated with CPU, processor cores, and storage increase
Solution Approach 1:
The patent applies discarding and recovering by automatically deleting unnecessary delta journals from cloud storage. This reduces storage costs and minimizes the computational resources (CPU, processor cores) required for managing and processing backup data, while maintaining comprehensive data protection coverage through selective retention of essential backup information.
Solution Approach 2:
The patent changes the parameter of data retention by dynamically adjusting which delta journals are kept and which are deleted. This parameter change optimizes the balance between data protection coverage and resource consumption costs, reducing storage and computational expenses while preserving adequate protection capabilities.
Data Source
AI summary
Disaster recovery operations are disclosed. A copy of data may include segments and delta journals or journals. RTO can be reduced by pre-processing the delta journals after the segments and delta journals are uploaded. The RTO is improved during recovery because the need to process the delta journals is eliminated. Applying the delta journals can be performed to both reduce cost and RTO using graphs.