Micro-Backup Generation for Application Data Integrity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Computing devices face data loss due to storage failures, with existing backup solutions often being unsuitable for immediate recovery of specific applications, leading to inefficiencies in data restoration.
Innovation Solution
A backup management system that monitors application data rate of change and input-output rates to generate unscheduled micro-backups and restoration-ready backups, allowing for quicker recovery of individual applications without restoring the entire host.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional backup solutions are used to store copies of data in locations other than persistent storage, then data loss due to storage failure can be prevented, but the backup cannot be used for immediate recovery of specific applications
Solution Approach 1:
The backup system segments backup operations into two distinct types: micro-backups that capture only changed application data blocks, and restoration-ready backups that pre-assemble complete application restoration packages. This segmentation allows the system to maintain both data loss prevention and immediate application recovery capability by preparing restoration packages in advance while only backing up changed blocks during operation.
Solution Approach 2:
The system performs preliminary actions by generating restoration-ready backups that contain all necessary data and metadata for immediate application restoration. These restoration packages are prepared in advance and stored ready for deployment, enabling the system to recover specific applications immediately when needed without having to reconstruct backups from scattered data blocks.
2Reliability
If unscheduled backups are generated based on monitored thresholds, then data integrity is improved, but backup generation frequency increases
Solution Approach 1:
The system implements feedback mechanisms by continuously monitoring application data change rates and I/O rates, comparing these metrics against predefined thresholds. When thresholds are exceeded, the system triggers micro-backup generation. This feedback-driven approach ensures data integrity by capturing changes when significant modifications occur, while avoiding unnecessary backups during stable periods, thus maintaining backup generation efficiency.
Solution Approach 2:
The backup system dynamically adjusts its operation based on real-time monitoring of application behavior. The monitoring component tracks data change rates and I/O rates, and the system transitions between different backup states (normal operation, threshold exceeded, micro-backup triggered) based on these dynamic conditions. This dynamic approach allows the system to maintain data integrity only when necessary, improving overall backup efficiency.
3Speed
If micro-backups are obtained and combined with previously generated backups to create restoration-ready backups, then application recovery speed is improved, but system complexity increases
Solution Approach 1:
The system introduces an intermediary component (the backup management system) that handles the complexity of combining micro-backups with previously generated backups. This intermediary automatically performs the data assembly, validation, and packaging required to create restoration-ready backups, shielding users from the underlying complexity while enabling fast application recovery through pre-prepared restoration packages.
Data Source
AI summary
A backup management system for providing data integrity services to an application host that hosts an application that uses application data includes storage for storing threshold values for creating an application backup and a processor programmed to monitor: a rate of change associated with the application data, and an input-output rate of the application data; make a determination, based on the threshold values, the rate of change, and the input-output rate, that an unscheduled backup for the application is to be generated; obtain a micro-backup for the application in response to the determination; and obtain a restoration ready backup for the application using the micro-backup and at least one previously generated backup.