Data Compression with Separate Protection Information Handling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data compression methods do not effectively compress protection information (PI) along with data blocks, leading to increased data volume and inefficiencies in storage and transmission, particularly due to silent data corruption issues where errors go undetected.
Innovation Solution
Separate data blocks from protection information, delete redundant data blocks, and compress both separately to improve compression efficiency, allowing for direct use of compressed protection information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If protection information (PI) is not compressed during data compression, then data integrity verification is maintained, but data volume remains relatively large
Solution Approach 1:
The patent segments the data structure by separating protection information (PI) from data blocks, allowing independent processing of each segment. This enables selective compression of data blocks while maintaining PI integrity for verification purposes, resolving the contradiction between maintaining reliability and reducing data volume.
Solution Approach 2:
The patent changes the parameter state of protection information by introducing a compression indication field that can take different values (0 or 1). When the value is 0, PI remains uncompressed to ensure verification reliability; when the value is 1, PI can be compressed to reduce data volume. This parameter-based approach allows flexible resolution of the contradiction based on specific requirements.
2Quantity of substance
If protection information is compressed along with data blocks, then data volume is reduced, but compression effectiveness deteriorates due to the nature of PI
Solution Approach 1:
By segmenting PI and data blocks into separate processable units with independent compression control, the patent allows data blocks to be compressed efficiently while PI can be handled separately. This segmentation prevents PI from negatively impacting the overall compression effectiveness of the data blocks.
Solution Approach 2:
The patent applies partial compression action by allowing only the necessary portions (data blocks) to be compressed while leaving PI uncompressed or separately processed. This partial approach maintains high compression effectiveness for the compressible data portions without being constrained by the incompressible nature of PI.
3Reliability
If PI is not compressed, then verification reliability is maintained, but storage and transmission efficiency decrease
Solution Approach 1:
The patent introduces a compression indication parameter that controls the state of PI. By changing this parameter value, the system can switch between maintaining full verification reliability (parameter=0, no compression) and improving storage/transmission efficiency (parameter=1, allow compression), thus resolving the contradiction through parameter-based flexibility.
Solution Approach 2:
The patent makes the compression state of PI dynamic rather than static. The compression indication field allows the system to adaptively adjust whether PI should be compressed based on specific requirements, enabling the system to optimize between verification reliability and efficiency dynamically rather than being fixed in one state.
Data Source
Figure 1~4
Figure 5~7
Figure 8~10
AI summary
This application provides a data compression method, a data decompression method, and a related apparatus. The method includes: obtaining N to-be-compressed data blocks and N pieces of protection information PI, where the N to-be-compressed data blocks are in a one-to-one correspondence with the N pieces of PI, and N is a positive integer greater than or equal to 2; compressing the N to-be-compressed data blocks to obtain a compressed data block; and compressing the N pieces of PI to obtain compressed PI. The foregoing technical solution can improve a compression effect of the to-be-compressed data block.