Multipart Inode File Relocation for Non-Disruptive Rebalancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Distributed file systems face challenges in maintaining optimal file placement and balancing constituents due to changes in file size and load over time, leading to uneven utilization and disruption in file access when files are moved between volumes.
Innovation Solution
A non-disruptive file movement mechanism using a multipart inode structure and redirection layer to manage file handles, allowing seamless file relocation between constituents within a distributed file system, ensuring continuous access without changing client file handles.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If files are moved between volumes to rebalance constituents, then optimal file placement and constituent utilization are improved, but file access disruption and system stability deteriorate
Solution Approach 1:
The patent segments file movement into two independent phases: (1) copying file data to the destination volume while maintaining source volume accessibility, and (2) updating metadata pointers after verification. This segmentation allows rebalancing operations to proceed without disrupting ongoing file access operations, resolving the contradiction between improving constituent utilization and maintaining access reliability.
Solution Approach 2:
The patent performs preliminary actions by creating a copy of the file at the destination volume before completing the move operation. The source file remains accessible during copying, and only after successful verification does the system update metadata to point to the new location. This preliminary copying ensures continuous availability during the rebalancing process.
2Ease of manufacture
If traditional file move operations are used, then file relocation is simple, but network attached storage protocols and administrative operations are disrupted
Solution Approach 1:
The patent introduces an intermediary redirection mechanism that redirects client requests through a temporary redirector object during the file move process. This redirector handles all client access operations during the transition period, shielding clients from the underlying complexity of the move operation and preventing protocol disruptions. The redirector acts as a mediator between clients and the moving file, ensuring smooth transitions without interrupting storage protocols.
Solution Approach 2:
The patent ensures continuity of useful action by maintaining source volume accessibility throughout the entire move process. Client operations continue uninterrupted as the file is copied in the background. Only after successful copying and verification does the system switch clients to the new location, ensuring continuous productive action without disruption to storage protocols or administrative operations.
Data Source
AI summary
Approaches for providing a non-disruptive file move are disclosed. A request to move a target file from the first constituent to the second constituent is received. The file has an associated file handle. The target file in the first constituent is converted to a multipart file in the first constituent with a file location for the new file in the first constituent. A new file is created in the second constituent. Contents of the target file are moved to a new file on the second constituent while maintaining access via the associated file handle via access to the multipart file. The target file is deleted from the first constituent.