CRC-Aware Data Compression for Reliable Portable Storage Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data compression methods in storage systems face challenges with low compression ratios and reliability issues due to the presence of error detection codes, and they complicate data portability when these codes are separated from the data.

Innovation Solution

A data compression apparatus that calculates second error detection codes for cleartext data, generates headered compressed-text data by adding these codes, and further adds third error detection codes to enhance compression ratio, reliability, and portability by replacing CRC codes with more efficient ones.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If error detection codes are included in data before compression, then data reliability is maintained, but compression ratio deteriorates

Engineering Contradiction:
Improvedata reliabilityVSAvoidcompression ratio
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent segments the data structure by separating error detection codes from the main data body. The compression unit processes only the data portion while excluding error detection codes, achieving high compression ratios. The error detection codes are preserved separately and regenerated after decompression, maintaining data reliability without compromising compression efficiency.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts error detection codes from the data before compression. The compression unit is configured to compress only the data portion, leaving error detection codes outside the compression process. This extraction approach eliminates the negative impact of error detection codes on compression ratio while preserving their reliability function.

Inventive Principle:
Principle #2Taking out (Extraction)

2Productivity

If error detection codes are separated from data for compression, then compression ratio improves, but data portability deteriorates

Engineering Contradiction:
Improvecompression ratioVSAvoiddata portability
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The patent merges the error detection codes back into the decompressed data through the header addition unit. After decompression, new error detection codes are calculated and added to the decompressed data, creating a complete data structure with integrated error detection capability. This merging process ensures that decompressed data is self-contained and portable without requiring external error detection code storage.

Inventive Principle:
Principle #5Merging (Combining)

3Productivity

If error detection codes are stored in different storage area, then compression efficiency improves, but system complexity increases

Engineering Contradiction:
Improvecompression efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a universal data structure where the header unit serves multiple functions: it stores error detection codes during compression, guides the decompression process, and enables regeneration of error detection codes after decompression. This multi-functional header design eliminates the need for separate error detection code storage areas, reducing system complexity while maintaining compression efficiency.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS11349494B2Data compression apparatus and data compression method
Publication Date: 2022.05.31 HITACHI VANTARA LTD
  • US11349494B2 patent drawing
  • US11349494B2 patent drawing
  • US11349494B2 patent drawing

AI summary

A compression engine calculates replacement CRC codes, in predetermined data lengths, for DIF-in cleartext data including cleartext data and multiple CRC codes based on the cleartext data. The compression engine generates headered compressed-text data in which a header including the replacement CRC codes is added to compressed-text data in which the cleartext data is compressed, and generates code-in compressed-text data by calculating multiple CRC codes based on the headered compressed-text data to add the calculated CRC codes to the headered compressed-text data.