File Level Prioritization During Data Backups
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional data backup systems lack a mechanism to prioritize file system data based on criticality, leading to potential data loss during disasters as less critical files may be processed before critical ones, compromising the recovery point objective (RPO) and service-level agreement (SLA) metrics.
Innovation Solution
A method that uses a file-type analyzer and Euclidean distance calculation to prioritize files based on their criticality, ensuring critical files are processed first by assigning weighted values and sorting files in the queue for efficient backup and restore operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If files are processed in first come first serve basis, then processing simplicity is maintained, but critical files may be delayed and data loss risk increases
Solution Approach 1:
The patent introduces a priority parameter (P0, P1, P2, P3) to characterize file criticality based on RPO requirements. This parameter change transforms the processing criterion from simple FIFO ordering to priority-based ordering, ensuring critical files are processed first while maintaining operational simplicity through structured priority levels
Solution Approach 2:
The system performs preliminary classification of files into priority groups before processing. By pre-tagging files with their criticality level and organizing them in priority queues, the system ensures critical files are ready for immediate processing without complex real-time decision-making during the backup operation
2Productivity
If all backup jobs run in parallel within the same window, then backup efficiency is improved, but resource contention and loss of priority control occur
Solution Approach 1:
The patent segments the backup workload into distinct priority groups (P0, P1, P2, P3) with separate queues for each level. This segmentation allows parallel processing within each priority level while maintaining strict priority control across groups, resolving the conflict between efficiency and priority control
Solution Approach 2:
The patent introduces a priority management intermediary layer between the backup jobs and the processing system. This intermediary monitors and manages the priority queues, ensuring that critical files are processed first even when multiple backup jobs run in parallel, thus maintaining priority control while enabling efficient parallel execution
3Use of energy by moving object
If large size files are processed first, then bandwidth utilization is optimized, but critical small files may be delayed causing data loss
Solution Approach 1:
The patent changes the primary sorting parameter from file size to file priority (RPO-based criticality). By making priority the dominant sorting criterion rather than size, the system ensures critical small files are processed first while still achieving good bandwidth utilization through efficient parallel processing of non-critical large files in subsequent priority levels
Data Source
AI summary
Methods and systems for file level prioritization during a data backup operation are described. According to some embodiments, the method includes in response to a request to backup one or more files and for each file, sniffing file information of the file. The method further includes determining a backup critical level of the file based on the file information. The method further includes assigning a weighted value corresponding to the backup critical level of the file. The method further includes using the weighted value to calculate a Euclidean distance of the file to a next consecutive file.