Data Processing Signatures for Lossy Compression Error Detection
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing compression and decompression arrangements in data processing systems, such as graphics processing systems, lack effective error detection mechanisms, particularly in lossy compression scenarios, which are crucial for safety-critical applications like automotive systems.
Innovation Solution
Implementing a data processing system with an encoder and communication system that compresses and decompresses data, generating signatures (checksums) from decompressed data to compare for error detection, allowing lossy compression and ensuring data integrity in safety-critical applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If lossy compression is used to reduce data size, then data transmission efficiency is improved, but data integrity is worsened
Solution Approach 1:
The patent applies preliminary action by generating a signature (checksum) from the original decompressed data before compression and transmission. This signature serves as a reference that enables later verification of data integrity after decompression, allowing lossy compression to be used while still providing a mechanism to detect errors.
Solution Approach 2:
The patent implements feedback by comparing the signature generated from original data with a signature generated from decompressed data after transmission. This comparison provides feedback on whether errors occurred during compression, transmission, or decompression, enabling error detection despite using lossy compression.
2Reliability
If error detection mechanisms are added to compression systems, then data reliability is improved, but system complexity is worsened
Solution Approach 1:
The patent uses copying by creating a signature (checksum) that is a simplified representation or copy of the original data's characteristics. This signature is much smaller and simpler than the full data, yet contains enough information to verify data integrity, thus providing error detection without adding significant complexity to the system.
3Quantity of substance
If compression is applied to reduce memory usage, then storage efficiency is improved, but processing overhead is worsened
Solution Approach 1:
The patent extracts only the essential verification information (signature/checksum) from the full data set. This extracted signature is stored alongside the compressed data, enabling error detection without requiring storage or processing of the entire original data set, thus balancing compression efficiency with verification capability.
Data Source
AI summary
A data processing system that comprises an encoder, and a communication system is disclosed. Compressed data produced by the encoder is decompressed to produce first decompressed data, and a first signature representative of the first decompressed data is generated. Compressed data that has been transferred by the communication system is decompressed to produce second decompressed data, and a second signature representative of the second decompressed data is generated. The first signature and the second signature are compared, and the comparison is used to determine whether an error has occurred.