Snapshot Metadata Copying in Deduplicated Virtual File Systems
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional systems for taking snapshots in deduplicated data systems are slow, performance degrades with increased frequency, and snapshots become dependent on each other, making modifications or deletions impact other snapshots.
Innovation Solution
A method and system for taking snapshots in a deduplicated virtual file system by copying metadata and extent maps, transmitting file references to the deduplicated storage system, and marking data segments to prevent removal, allowing snapshots to be independent and efficient.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If traditional snapshot methods are used in deduplicated data systems, then snapshots can be created, but the operation speed is slow and performance degrades as snapshot frequency increases
Solution Approach 1:
The patent copies only metadata (extent maps and configuration files) to create snapshots, rather than copying actual data blocks. This metadata copying approach dramatically speeds up snapshot creation while preventing performance degradation through frequent operations, as the metadata is much smaller than the actual data.
Solution Approach 2:
The patent extracts and separates metadata (extent maps and configuration files) from the actual data storage. By taking out only the essential metadata information needed to represent a snapshot, the system achieves fast snapshot creation without the overhead of copying large data volumes.
2Adaptability or versatility
If traditional snapshot methods are used in deduplicated data systems, then snapshots can be created, but snapshots become dependent on each other such that modifying or deleting one snapshot impacts another snapshot
Solution Approach 1:
The patent segments snapshot representation into separate metadata components (extent maps and configuration files) that can be independently copied and managed. Each snapshot has its own dedicated metadata copies, making snapshots independent of each other while maintaining data integrity through the deduplication system's reference tracking.
Solution Approach 2:
The patent introduces metadata (extent maps and configuration files) as an intermediary layer between the actual data blocks and the snapshot representations. This intermediary allows snapshots to be independent by referencing data blocks through metadata without direct data copying, while the deduplication system maintains reliability by tracking all references to each data block.
3Productivity
If metadata and extent maps are copied to snapshot location, then snapshot speed improves and snapshots become independent, but storage space requirements increase
Solution Approach 1:
The patent copies only essential metadata (extent maps and configuration files) rather than full data blocks. This selective copying of minimal necessary information improves snapshot operation efficiency while keeping storage space consumption low, as metadata is orders of magnitude smaller than actual data.
Solution Approach 2:
The patent changes the representation parameters of snapshots from full data block copies to compact metadata references. By changing how snapshots are represented (from data-centric to metadata-centric), the system achieves both fast operations and efficient storage utilization.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A computer-implemented method for taking snapshots in a deduplicated virtual file system may include (1) maintaining a deduplicated virtual file system that stores, at an original location within a non-virtual file system, at least one configuration file storing metadata for a target file and an extent map for the target file, the extent map defining how to construct the target file from deduplicated data segments in a deduplicated storage system, (2) receiving a request to take a snapshot of the target file corresponding to the configuration file, (3) copying the configuration file storing metadata for the target file and the extent map for the target file into a snapshot location within the non-virtual file system, and (4) transmitting a file reference request to the deduplicated storage system to add a file reference within the deduplicated storage system. Various other methods, systems, and computer-readable media are also disclosed.