Granular Filesystem Metadata Repair via Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional file systems face downtime and performance issues due to metadata inconsistencies, which are often manually initiated and resource-intensive, making them unsuitable for modern server systems with low tolerance for outages and complex environments like SDS and cloud storage.
Innovation Solution
A method that slices the file system metadata into segments, validates each segment during operations, and triggers an automatic repair process to maintain operation continuity, using detection points and a repair handler to correct inconsistencies without introducing additional overhead, allowing for on-demand, automatic, and lightweight metadata recovery.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If conventional offline file system checkers are used to restore consistencies, then file system consistency is improved, but system availability deteriorates due to complete downtime
Solution Approach 1:
The patent divides the file system metadata into multiple segments or zones, allowing the consistency checker to process only specific segments rather than the entire file system. This segmentation enables partial checking and recovery operations that can proceed while other segments remain accessible, thereby maintaining system availability while restoring consistency in the affected segments.
Solution Approach 2:
The patent implements preliminary consistency validation checks that detect metadata inconsistencies before they cause system failures. By performing these checks proactively and triggering automatic recovery processes in advance, the system can correct issues before they necessitate complete shutdowns, thus maintaining both consistency and availability.
2Loss of time
If online file system checkers are used to provide continuous access, then system availability is improved, but performance deteriorates due to resource intensiveness
Solution Approach 1:
The patent applies local quality by making the consistency checking process adaptive to the specific state and needs of different file system segments. Rather than uniformly checking the entire file system, the system performs targeted checks only where inconsistencies are detected or where changes have occurred, reducing overall resource consumption while maintaining effectiveness.
Solution Approach 2:
The patent implements partial action by performing consistency checks on only the necessary portions of the file system metadata rather than the entire structure. This selective approach reduces the computational overhead and resource intensiveness while still ensuring consistency where it matters most, thereby maintaining better system performance during online operations.
3Reliability
If manual consistency checking is performed, then file system consistency is improved, but operational complexity deteriorates due to administrative burden
Solution Approach 1:
The patent implements self-service by enabling the file system to automatically detect, validate, and recover from its own metadata inconsistencies without requiring external administrative intervention. The system includes built-in consistency checkers and recovery mechanisms that autonomously identify issues, trigger appropriate recovery processes, and restore consistency, thereby eliminating the need for manual consistency checking while maintaining high reliability.
Data Source
AI summary
Presented herein are methods, non-transitory computer readable media, and devices triggering a metadata recovery process within a network storage system, which include: dividing metadata into metadata segments, wherein each of the metadata segments is tasked to perform a specific file system operation function, validating each of the metadata segments during the specific file system operation function; upon failure to validate at least one of the metadata segments, triggering an automatic repair process while maintaining the operation function tasked to the metadata segment, and upon finalizing the automatic repair process, resuming the specific file system operation function tasked to the metadata segment.