Folder Scan System for Incremental Backup Change Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional backup techniques face challenges with slow data transfer rates and increased backup times due to the lack of efficient methods to identify modified files in large file systems, especially in network-attached storage systems without built-in change tracking technologies.
Innovation Solution
A folder scan system that generates a filetype database and a file modification database to identify modified folders by comparing the latest modification times with a user-defined limit, allowing for targeted incremental backups without a full scan of the entire file system.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the entire file system is scanned to detect changes during incremental backups, then all modified files can be identified, but backup time increases significantly
Solution Approach 1:
The patent divides the file system into multiple directories and scans only selected directories rather than the entire file system. This segmentation allows the system to identify modified files in critical directories while skipping less important ones, thereby reducing overall scan time while maintaining adequate change detection capability.
Solution Approach 2:
The patent implements partial scanning by selecting only a subset of directories for detailed inspection during incremental backups. Instead of scanning every file in the entire file system, the system performs partial scans on prioritized directories, achieving acceptable change detection with significantly reduced time expenditure.
2Reliability
If the file system tree is walked and all directory entries are read to detect changes, then complete backup accuracy is achieved, but storage system resources are heavily taxed
Solution Approach 1:
The patent segments the file system into multiple directories and selectively scans only certain directories based on priority or change frequency. This approach maintains backup reliability for critical data while reducing the computational and I/O resources consumed by the storage system during backup operations.
Solution Approach 2:
The patent applies different scanning strategies to different directories based on their importance or characteristics. High-priority directories receive thorough scanning to ensure backup accuracy, while lower-priority directories receive minimal or no scanning, optimizing resource utilization across the storage system.
3Productivity
If incremental backups are performed by scanning only updated files, then backup speed improves, but there is no built-in technology in NAS systems to selectively determine modified files
Solution Approach 1:
The patent performs preliminary scanning of directories to identify modified files before the actual backup process. By pre-identifying changed files through directory metadata or previous scan results, the system prepares a list of files requiring backup, enabling faster incremental backups without requiring complex real-time change detection mechanisms during the backup itself.
Solution Approach 2:
The patent introduces an intermediary scanning mechanism that sits between the file system and the backup process. This intermediary layer analyzes directory entries and file metadata to identify modified files, acting as a mediator that simplifies the change detection task compared to direct full-file-system scanning or complex real-time tracking systems.
Data Source
AI summary
A folder scan system configured to identify modified folders in a storage module including a plurality of folders during an incremental backup scan is presented. The folder scan system is configured to identify modified folders using a learning-based technique. A related method is also presented.