In-line Compression Header Repair for Metadata Corruption

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Data storage systems employing in-line compression face issues with file system metadata corruption, leading to inaccessible compressed data due to hardware faults or software errors, where existing repair utilities fail to address specific errors related to in-line compressed data.

Innovation Solution

Storing compression headers in association with respective extents of in-line compressed data, and using a repair utility to read and apply contents from these headers to repair damaged metadata structures, thereby restoring access to compressed data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of substance

If in-line compression is implemented in the file system, then storage efficiency is improved and disk traffic is reduced, but metadata structures become vulnerable to corruption causing data loss

Engineering Contradiction:
Improvestorage spaceVSAvoidmetadata integrity
Core Design Contradiction:
Loss of substanceVSReliability

Solution Approach 1:

The patent applies preliminary action by storing compression headers containing metadata information at the time of compression, before any potential corruption occurs. These headers are embedded within the compressed data blocks themselves, preparing recovery information in advance so that if metadata corruption happens later, the system can restore access using the pre-stored header information without needing to reconstruct metadata from damaged structures.

Inventive Principle:
Principle #10Preliminary action

2Ease of repair

If traditional repair utilities are used, then common file system errors can be addressed, but errors specific to in-line compressed data cannot be repaired

Engineering Contradiction:
Improvefile system repair capabilityVSAvoidrepair utility compatibility
Core Design Contradiction:
Ease of repairVSAdaptability or versatility

Solution Approach 1:

The patent implements universality by designing compression headers that contain essential metadata information (compression algorithm identifiers, block size parameters, data offsets) that can be used both during normal file system operations and during repair operations. This multi-functional header structure allows the same stored information to serve routine access needs and recovery needs, making the repair utility versatile enough to handle both common file system errors and compression-specific errors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Device complexity

If compression metadata is stored centrally in file system structures, then access control is simplified, but corruption of critical structures causes extensive data loss

Engineering Contradiction:
Improvemetadata managementVSAvoidcompressed data accessibility
Core Design Contradiction:
Device complexityVSLoss of information

Solution Approach 1:

The patent applies segmentation by distributing compression metadata information across multiple locations rather than storing it centrally. Specifically, compression headers containing critical metadata are embedded within individual compressed data blocks, while additional metadata remains in the file system structures. This segmentation ensures that corruption of central metadata structures does not result in loss of all compression information, as each data block carries its own header information independently.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10467222B1Recovering compressed data to reduce data loss
Publication Date: 2019.11.05 EMC IP HLDG CO LLC
  • US10467222B1 patent drawing
  • US10467222B1 patent drawing
  • US10467222B1 patent drawing

AI summary

A technique for repairing damage to a file system stores compression headers in association with respective extents of in-line compressed data. A repair utility reads contents from the compression headers and applies the contents to repair damaged metadata structures that the file system uses to access the associated extents. In this fashion, the repair utility restores access to compressed data, which would otherwise be lost.