Data Compression with Separate Protection Information Encoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data compression methods do not effectively compress protection information (PI) along with data blocks, leading to increased data volume and inefficiencies in storage and transmission, particularly due to silent data corruption issues where errors go undetected.
Innovation Solution
Separate compression of data blocks and PI, allowing for the identification and deletion of redundant data blocks, and compressing PI based on specific rules to reduce its length and improve compression efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If protection information (PI) is not compressed along with data blocks, then data integrity checking is maintained, but data volume increases and compression efficiency deteriorates
Solution Approach 1:
The patent segments the compression process into two independent parts: compressing data blocks and compressing protection information (PI) separately. This allows each component to be optimized independently - data blocks use general compression algorithms while PI uses specialized compression methods that exploit its structured nature, thereby reducing overall data volume without compromising integrity checking capability
Solution Approach 2:
The patent changes the compression parameters and algorithms based on the specific characteristics of different data types. For PI, which has fixed structure and predictable patterns, specialized compression parameters are applied that differ from those used for general data blocks, enabling more efficient compression of the protection information portion
2Productivity
If PI is compressed together with data blocks, then compression efficiency improves, but PI cannot be independently verified and data reliability deteriorates
Solution Approach 1:
By segmenting the compressed data into separate compressed data blocks and compressed PI, the patent enables independent verification of PI against the original data blocks during decompression. This segmentation maintains reliability by allowing the checkpoint to verify data integrity without requiring the combined structure, while still achieving improved compression efficiency through specialized PI compression
Solution Approach 2:
The patent introduces an intermediary structure where compressed PI acts as a separate verification component that mediates between the compressed data blocks and the integrity checking process. This intermediary allows verification to occur independently while the compression process benefits from optimized handling of the PI portion
3Quantity of substance
If redundant data blocks are not identified and deleted, then data completeness is maintained, but storage space increases and compression rates deteriorate
Solution Approach 1:
The patent implements a mechanism to identify and discard redundant data blocks before compression, while maintaining the ability to recover them if needed through the preserved PI. By removing duplicates and redundant information upfront, the patent reduces the data volume requiring compression and storage, thereby improving compression rates without permanently losing data completeness
Data Source
AI summary
A data compression method includes obtaining N to-be-compressed data blocks and N pieces of protection information (PI), where the N to-be-compressed data blocks are in a one-to-one correspondence with the N pieces of PI, and N is a positive integer greater than or equal to 2, compressing the N to-be-compressed data blocks to obtain a compressed data block, and compressing the N pieces of PI to obtain compressed PI.