Metadata Verification Architecture for File System Integrity

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Metadata corruption in file systems can occur due to end user errors, malicious operations, or bugs, leading to inaccessible user data, and existing recovery methods like fsck are time-consuming and unreliable, highlighting the need for preventing corruption rather than detection and recovery.

Innovation Solution

A verification architecture is implemented to validate changes made to metadata by reserving specific areas for metadata structures and using verified area legends to check write requests, ensuring they do not overlap with reserved metadata areas, thereby preventing corruption.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If metadata verification architecture is implemented to prevent corruption, then reliability of file system is improved, but device complexity increases

Engineering Contradiction:
Improvefile system reliabilityVSAvoidverification architecture complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements preliminary action by reserving specific areas for metadata structures and creating verified area legends before any write operations occur. The verification architecture pre-defines the layout and boundaries of metadata regions, enabling proactive validation of write requests against these predetermined specifications. This prevents metadata corruption before it can occur, rather than detecting it after the fact.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The verified area legend acts as an intermediary between the write request and the metadata structures. The legend contains the expected layout and boundaries of metadata regions, serving as a reference standard that mediates the validation process. Write requests are compared against this intermediate legend structure to determine validity, rather than directly checking against the complex metadata structures themselves.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If write requests are validated against verified area legends, then metadata corruption is prevented, but processing time increases

Engineering Contradiction:
Improvemetadata integrityVSAvoidwrite request validation time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The verified area legend is created and stored in advance during file system initialization. This preliminary action captures the expected metadata layout before any write operations occur, allowing rapid validation of subsequent write requests against this pre-computed reference without requiring complex real-time analysis of metadata structures.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The verified area legend is a simplified copy or representation of the metadata structure layout, containing only the essential boundary and organization information needed for validation. This copied representation is much simpler and faster to process than the full metadata structures themselves, enabling rapid validation of write requests while maintaining accuracy.

Inventive Principle:
Principle #26Copying

3Reliability

If reserved metadata areas are protected using verification architecture, then data accessibility is improved, but ease of operation deteriorates

Engineering Contradiction:
Improvedata accessibilityVSAvoidwrite request operation simplicity
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The verification architecture performs self-service validation by automatically comparing write requests against the verified area legend without requiring manual intervention. The system autonomously determines whether a write request is valid or would corrupt metadata, eliminating the need for users to understand complex metadata structures or perform manual validation checks.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The verification architecture provides immediate feedback on write request validity by comparing the requested write area against the verified area legend. This feedback mechanism automatically accepts valid requests and rejects potentially corrupting requests, simplifying user operation while maintaining data accessibility through consistent enforcement of metadata protection rules.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11544223B2Write operation verification method and apparatus
Publication Date: 2023.01.03 WESTERN DIGITAL TECHNOLOGIES INC
  • US11544223B2 patent drawing
  • US11544223B2 patent drawing
  • US11544223B2 patent drawing

AI summary

A verification architecture described according to embodiments of the present invention validates changes made to metadata and may comprise one or more subsystems and phases. According to some embodiments, the “mkfs” volume creation utility works in cooperation with the device driver to create a file system volume by means of reservation and initialization space for metadata structures inside the device's partition that is reserved for the specific file system volume. The storage device uses a verified area legend when checking write requests after the file system volume has been created. The verified area legends may be stored in a dedicated partition or inside the master boot record (MBR) or Globally Unique Identifier (GUID) partition table (GPT) or special memory chip (NAND flash, for example). Write requests that overlap with any extent of reserved metadata area must be verified to prevent metadata corruption.