File System Backup Using Snapshot Differential
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional incremental backup methods for large file systems are inefficient, requiring full scans of the file system tree, which leads to increased processing time and interference with concurrent client access, especially in systems with hundreds of Terabytes and millions of files, making it difficult to complete backups within a short time window.
Innovation Solution
The use of snap differential technology to identify changed blocks at a volume level, allowing for incremental backups without traversing the entire file system hierarchy, thus focusing on the number of changed files rather than the total number of files, enabling faster backup completion.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If full scans of the file system tree are performed for incremental backups, then all changed files can be identified, but processing time increases and concurrent client access is interfered with
Solution Approach 1:
The patent segments the file system backup process by using snapshot technology to divide the file system into stable (unchanged) and dynamic (changed) portions. By comparing file inodes between snapshots, the system identifies only the changed segments that require backup, rather than scanning the entire file system tree. This segmentation enables incremental backups to focus exclusively on modified files, significantly reducing processing time while maintaining backup completeness.
2Reliability
If full scans of the file system tree are performed for incremental backups, then all changed files can be identified, but interference with concurrent client access increases
Solution Approach 1:
The patent segments the file system backup process by using snapshot technology to divide the file system into stable (unchanged) and dynamic (changed) portions. By comparing file inodes between snapshots, the system identifies only the changed segments that require backup, rather than scanning the entire file system tree. This segmentation enables incremental backups to focus exclusively on modified files, significantly reducing processing time while maintaining backup completeness.
3Reliability
If conventional incremental backup methods are used for large file systems, then backups can be performed, but it is difficult to complete backups within a short time window
Solution Approach 1:
The patent applies preliminary action by creating and maintaining snapshot copies of the file system before the backup process begins. These snapshots capture the state of file inodes at specific points in time, allowing the backup system to pre-identify changed files through inode comparison rather than scanning during the actual backup execution. This preliminary snapshot creation enables the backup process to quickly determine which files have changed and proceed directly to backing up only those files, completing backups within short time windows for large file systems.
Data Source
AI summary
A method is used in managing backing up of file systems. A portion of a file system that has changed since a last backup is determined. The file system includes a set of directory hierarchies. Each directory hierarchy includes a set of directories. Each directory of the set of directories includes a set of files. The portion of the file system is determined based on blocks of the file system that have changed since the last backup. The changed blocks are identified based on changes between at least two snapshot copies of the file system. Based on the changed blocks, a set of inodes of the file system that has changed since the last backup is determined. Based on the determination, a list of changed files associated with the set of inodes for performing backup of changed files of the file system is determined.