Delta-Encoded Codebooks for More Compact Entropy Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The rapid growth of data storage demand exceeds the capacity of physical storage solutions, and existing data compression methods, such as lossless and lossy compression, are inefficient for multimedia data and pose security risks as quantum computing becomes imminent.
Innovation Solution
Applying delta encoding to entropy encoding methods to reduce the number of sourceblocks in a codebook to commonly encountered data patterns, using delta encoding of bit differences with existing sourceblocks, and incorporating mismatch probability estimation to improve data compaction efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional data compression methods (lossless or lossy) are used, then storage capacity is doubled at most, but security risks increase as quantum computing becomes imminent
Solution Approach 1:
The patent replaces traditional encryption algorithms with a fundamentally different approach based on data compaction and reference coding. Instead of using cryptographic mechanisms vulnerable to quantum computing, the system uses delta encoding and sourceblock referencing to create inherent security through obfuscation and redundancy, making the data unreadable without the reference structure.
2Productivity
If entropy encoding methods are used with limited sourceblock bit length, then encoding efficiency is reduced, but implementing delta encoding increases complexity
Solution Approach 1:
The patent segments the encoding process into two distinct phases: first, delta encoding that computes differences between consecutive sourceblocks to generate compact representations, and second, entropy encoding that applies standard compression algorithms to these deltas. This segmentation allows each phase to be optimized independently, managing complexity while improving overall efficiency.
Solution Approach 2:
The patent performs preliminary delta encoding before entropy encoding, transforming the data into a form with smaller average bit length. This preliminary action reduces the workload for subsequent entropy encoding operations, improving overall encoding efficiency while keeping individual step complexities manageable.
3Productivity
If delta encoding is applied to reduce sourceblock bit length, then encoding efficiency improves, but storage space requirements change
Solution Approach 1:
The patent uses reference coding where instead of storing complete sourceblocks, the system stores references to previously encoded sourceblocks. When a sourceblock matches a previous one, only a reference is stored; when it differs, only the delta (difference) is stored. This copying approach dramatically reduces storage space requirements while maintaining encoding efficiency.
Solution Approach 2:
The patent discards redundant information by storing only deltas rather than complete sourceblocks. The original data can be recovered by applying the deltas sequentially to the reference sourceblocks during decoding, enabling significant storage space reduction without loss of information.
Data Source
AI summary
Data compaction using codebooks, that applies delta encoding methods to entropy encoding methods to improve data compaction of entropy encoding methods under certain conditions and when compacting data having certain characteristics. Delta encoding may be applied to entropy encoding methods to further compact data sets by reducing the number of sourceblocks included in a codebook to those most commonly encountered in data to be encoded and, where mismatches occur during encoding, using delta encoding of bit differences with existing sourceblocks in the codebook rather than adding new sourceblocks to the codebook.