Multipart Inode File Movement for Non-Disruptive Rebalancing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing distributed file systems face challenges in maintaining optimal file placement and distribution over time due to changes in file size and load, leading to uneven utilization of constituents within a group, which can result in inefficient resource allocation and disruption during file movement.
Innovation Solution
A non-disruptive file movement mechanism using multipart inodes and redirection layers to maintain file handles intact during the relocation process, allowing seamless access and rebalancing of files between constituents without disrupting network attached storage protocols or operations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional file movement mechanisms are used in distributed file systems, then file relocation between constituents can be performed, but it causes disruption to network attached storage protocols and operations
Solution Approach 1:
The patent segments the file into two independent parts: the inode (metadata) and the data blocks. This allows the inode to be moved between constituents while the data blocks remain stationary or are moved separately, enabling non-disruptive file movement. The inode contains references to data blocks, so moving only the inode maintains access continuity while enabling rebalancing.
Solution Approach 2:
The patent introduces a redirection layer as an intermediary between the file system and storage constituents. This redirection layer maintains mapping information that translates old constituent references to new constituent references during file movement, ensuring continuous access without disruption to network attached storage protocols.
2Adaptability or versatility
If files are moved to optimize distribution, then resource allocation improves, but the movement process causes disruption to ongoing operations
Solution Approach 1:
The patent performs preliminary actions by creating a redirection layer mapping before the actual file movement occurs. This mapping table is established in advance to translate old constituent references to new ones, ensuring that ongoing operations continue uninterrupted during the rebalancing process.
Solution Approach 2:
The patent implements dynamic updates to the redirection layer during file movement. As files are relocated between constituents, the redirection mapping is dynamically updated to reflect new relationships, allowing the system to adapt to changing distribution conditions without disrupting ongoing operations.
3Productivity
If conventional file movement is used, then file relocation is achieved, but file handles become invalid and access must be disrupted
Solution Approach 1:
The patent creates a copy of the file handle through the redirection layer mechanism. The redirection layer maintains the original file handle validity while adding a mapping to the new location. This allows concurrent access paths: the original handle continues working while the new handle points to the relocated file, eliminating access interruption.
Data Source
AI summary
Approaches for providing a non-disruptive file move are disclosed. A request to move a target file from the first constituent to the second constituent is received. The file has an associated file handle. The target file in the first constituent is converted to a multipart file in the first constituent with a file location for the new file in the first constituent. A new file is created in the second constituent. Contents of the target file are moved to a new file on the second constituent while maintaining access via the associated file handle via access to the multipart file. The target file is deleted from the first constituent.