Smart Folder Scan System for Backup Speed Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data backup techniques face challenges with slow backup speeds, high storage costs, and inefficient data scanning, particularly in systems lacking change tracking technologies like USN journal or CBT, which can compromise data integrity and network performance.
Innovation Solution
A smart folder scan system that uses a processor to generate a folder activity table and skip table database to identify modified file folders, allowing for targeted full scans and reducing unnecessary data transfers, thereby enhancing backup efficiency and speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If full system backups are performed regularly, then data integrity is ensured, but network bandwidth is severely limited and backup speed is reduced
Solution Approach 1:
The patent extracts only the modified folders from the complete backup set by comparing folder activity tables between backup cycles. Instead of backing up all folders, the system identifies and extracts only those folders that have been modified since the last backup, thereby reducing network bandwidth consumption while ensuring that all changed data is captured for data integrity.
2Loss of time
If incremental backups are performed by comparing file dates, then storage time and space are saved, but backup speed is still limited without change tracking technologies
Solution Approach 1:
The patent performs preliminary scanning of all folders at the beginning of the backup process to build a complete folder activity table that records modification times of all folders. This preliminary action enables the system to quickly identify modified folders in subsequent incremental backups without needing to scan entire folders, thereby reducing backup time while maintaining backup speed.
3Reliability
If traditional backup techniques are used, then data is backed up, but storage resource usage is high and backup efficiency is low
Solution Approach 1:
The patent applies local quality by treating different folders differently based on their modification status. Modified folders are scanned and backed up with high priority, while unmodified folders are skipped entirely. This selective approach reduces storage resource usage by avoiding redundant backup operations on unchanged data while ensuring that all modified data is properly backed up.
Data Source
AI summary
A smart folder scan system and method is provided. The system includes a memory having computer-readable instructions stored therein and a storage module having a plurality of file folders configured to store data. The system further includes a processor communicatively coupled to the storage module. The processor is configured to access the plurality of file folders stored in the storage module. In addition, the processor is configured to scan and identify one or more modified file folders stored in the storage module. Further, the processor is configured to generate a folder activity table for each of the plurality of file folders based upon the scan. The folder activity table comprises of a listing of the file folders and an associated modification time for each of the file folders. The processor is further configured to generate a skip table database based upon the modification time of each of the file folders. The skip table database includes a listing of one or more file folders to be skipped from a full scan. In addition, the processor is configured to identify one or more file folders for the full scan based upon the folder activity table and the skip table database. Furthermore, the processor is configured to perform a full scan of the identified one or more file folders.