Compression Management Component for File System Storage Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing file systems face challenges in efficiently compressing and managing data within protection groups in memory, leading to suboptimal storage efficiency and random access performance.

Innovation Solution

A compression management component (CMC) is introduced to implement and manage data compression through inline and post-process compression, determining the appropriate compression algorithm and method for each data set, generating metadata for compressed data, and storing it in protection groups within the memory, allowing flexible application of compression algorithms to different data chunks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If data is compressed in protection groups, then storage efficiency is improved, but random access performance deteriorates

Engineering Contradiction:
Improvestorage efficiencyVSAvoidrandom access performance
Core Design Contradiction:
Quantity of substanceVSSpeed

Solution Approach 1:

The patent divides data into compression units that can be independently compressed and stored within protection groups. Each compression unit is a discrete segment that can be accessed individually, allowing random access to specific compressed data portions without requiring decompression of entire protection groups. This segmentation enables both efficient storage through compression and acceptable random access performance by limiting the scope of decompression operations.

Inventive Principle:
Principle #1Segmentation

2Quantity of substance

If compression algorithms are applied to all data, then storage efficiency is improved, but processing overhead increases

Engineering Contradiction:
Improvestorage efficiencyVSAvoidprocessing overhead
Core Design Contradiction:
Quantity of substanceVSDevice complexity

Solution Approach 1:

The patent applies compression selectively based on data characteristics and protection group requirements. Different compression algorithms or compression levels can be applied to different compression units within protection groups depending on the data type, access patterns, and storage priorities. This local quality approach ensures that compression is applied where most beneficial while avoiding unnecessary processing overhead for data that doesn't benefit from compression or requires frequent random access.

Inventive Principle:
Principle #3Local quality

3Reliability

If protection groups are used for data storage, then data reliability is improved, but storage overhead increases

Engineering Contradiction:
Improvedata reliabilityVSAvoidstorage overhead
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent merges multiple compression units into protection groups, where multiple units share a single protection group structure and its associated reliability mechanisms. By combining multiple compression units that would otherwise each require separate protection group overhead, the patent reduces total storage overhead while maintaining data reliability through shared protection and error correction capabilities at the protection group level.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS11200004B2Compression of data for a file system
Publication Date: 2021.12.14 EMC IP HLDG CO LLC
  • US11200004B2 patent drawing
  • US11200004B2 patent drawing
  • US11200004B2 patent drawing

AI summary

Compression of data for a file system utilizing protection groups can be implemented and managed. A compression management component (CMC) can control compression of data via inline or post-process compression for storage in protection groups in memory, including determining whether to compress data, determining a compression algorithm to utilize to compress data, and/or determining whether to perform inline and/or post-process compression of data. CMC can generate protection group (PG) metadata for a PG in which compressed data is stored. PG metadata can comprise a logical extent map that describes which logical blocks contain compressed data, a list of cyclic redundancy check values for logical blocks, and a list of compression chunks that store individual metadata regarding individual compressed streams, wherein, for an individual compressed stream, the individual metadata comprises a compression format, compressed size, uncompressed size, and/or starting offset in physical space within the PG.