File Archiving System Using Journal-Based Change Logging
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for archiving files distributed across multiple object storage devices often require stopping access to the files, preventing changes during the archiving process, which limits the ability to create a consistent archive while allowing file usage.
Innovation Solution
A method that saves file parts on archive devices while allowing changes, using a journal file to log changes made during archiving, and applies these changes to the original storage devices after archiving, ensuring a consistent archive without interrupting file access.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If access to the file is prevented during archiving operations, then consistency of the archive is improved, but productivity deteriorates due to stopped running applications
Solution Approach 1:
The system creates a snapshot of the file system state before archiving begins, recording the state of all file parts and their locations. This preliminary action allows the archiving process to reference this fixed snapshot while applications continue to run, ensuring archive consistency without stopping productivity
Solution Approach 2:
The system introduces an intermediary archiving layer that intercepts file access requests during archiving operations. This intermediary mechanism redirects read requests to the original file system while write requests are handled separately, allowing applications to continue running while the archive is being created from a consistent snapshot
2Measurement precision
If the file is archived as it existed at a specific point in time, then measurement precision of the archive state is improved, but loss of time increases due to stopping changes during archiving
Solution Approach 1:
The system performs preliminary actions by recording the file system state at the archiving start time and creating a snapshot of all file metadata. This allows the system to capture the precise state at a specific point in time while allowing changes to continue, reducing the time loss by not requiring the system to wait for all changes to complete
Solution Approach 2:
The system creates a copy of the file system state at the desired point in time through snapshotting mechanisms. This copy captures the precise state for archiving purposes while the original file system continues to accept changes, achieving measurement precision without requiring the system to stop time
Data Source
AI summary
A method for archiving a file that has multiple file parts stored on multiple object storage devices of a computer system includes the steps of saving the file parts on one or more archive devices, allowing one or more changes to be made to the file during the saving step, and applying at least one of the changes made during the saving step to one of the file parts stored on a respective object storage device. Furthermore, the method is performed such that the file parts saved on the one or more archive devices do not include the one or more changes made to the file during the saving step.