Multipart Inode File Movement and Attribute Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In distributed file systems, the initial placement of files may become sub-optimal over time due to changes in file size and load, leading to inefficient storage and access.
Innovation Solution
The implementation of a non-disruptive file movement mechanism using multipart inodes, which allows files to be retroactively moved between volumes without disrupting client access, and a background process to handle attribute setting to reduce latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If files are moved between volumes to optimize storage distribution, then storage efficiency is improved, but client access may be disrupted
Solution Approach 1:
The patent segments the file movement process into multiple phases: creating a new file handle, copying data in background, and updating metadata. This allows the file to be moved without interrupting client access, as the original file handle remains valid throughout the process.
Solution Approach 2:
The patent performs preliminary actions by creating a new file handle and setting up the destination file before actually moving the data. This preliminary setup ensures that when the move completes, client access is seamlessly redirected without disruption.
2Manufacturing precision
If file attributes are set on all child inodes during file movement, then data consistency is improved, but processing time increases
Solution Approach 1:
The patent performs preliminary attribute setting on the destination file handle before the actual data transfer completes. This preliminary action ensures that when the file movement finishes, all attributes are already in place, avoiding the need for time-consuming post-movement attribute updates on all child inodes.
Solution Approach 2:
The patent copies attribute information from the source file to the destination file handle during the movement process. This copying mechanism ensures data consistency is maintained while reducing the time required for attribute setting, as attributes are transferred along with the file data rather than being individually set on each inode.
Data Source
AI summary
Approaches for setting file attributes in a distributed file system using a multipart file structure are described. A request to set attributes for one or more parts of a multipart file is received. In response to the request, a rectify indicator is set to indicate the attributes for the multipart file that are to be set. In response to the request, an entry corresponding to the request is created in a rectify database. The attributes for the one or more parts of the multipart files are set using at least the entry in the rectify database.