Delta-Encoded Entropy Coding for Higher Data Compaction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data storage technologies face challenges in efficiently storing and transmitting large volumes of data due to limited storage capacity and bandwidth constraints, especially with the rise of multimedia data and the need for enhanced security as quantum computing approaches, where existing encryption methods and compression techniques are inadequate.
Innovation Solution
The implementation of a system and method that applies delta encoding to entropy encoding methods to reduce the number of sourceblocks in a codebook and use delta encoding of bit differences, improving data compaction by storing data in reference codes rather than full-sized blocks, thereby reducing storage and transmission requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional data compression methods are used, then storage capacity is doubled, but this is insufficient for zettabyte-level storage demand growth
Solution Approach 1:
The patent changes the fundamental parameter of data representation from storing complete data blocks to storing only differential changes (delta values). This transforms the storage approach from capturing entire states to capturing only transitions, enabling compression ratios that can reach 10:1 or higher for certain data types, thus keeping pace with zettabyte-level storage demand growth
Solution Approach 2:
The patent extracts only the essential information needed to represent data changes - the delta values - while discarding redundant information. By storing only the differences between consecutive data blocks rather than the blocks themselves, the system achieves dramatic storage capacity improvements that address the gap between current compression methods and future storage demands
2Quantity of substance
If full-sized data blocks are stored, then data integrity is maintained, but storage space and bandwidth requirements are excessive
Solution Approach 1:
The patent introduces a reference block as an intermediary element that enables efficient storage while maintaining data integrity. The reference block serves as a baseline from which delta values are calculated, allowing the system to store compact differential representations that can be accurately reconstructed by applying deltas to the reference, thus balancing storage efficiency with data reliability
Solution Approach 2:
The patent performs preliminary actions by selecting and storing reference blocks in advance before the actual data compression process. These pre-selected reference blocks serve as foundations for subsequent delta encoding operations, enabling the system to maintain high reconstruction accuracy while achieving significant storage space reductions through differential encoding
3Quantity of substance
If entropy encoding methods are used, then data compaction is achieved, but practicality decreases when bit length of source blocks is limited or when dealing with noisy signal data
Solution Approach 1:
The patent segments the data encoding process into distinct stages: reference block selection, delta calculation, and compact representation. This segmentation allows the system to handle limited bit length constraints more effectively by processing data in manageable units and applying appropriate encoding strategies to each segment, thereby maintaining both compaction ratio and operational practicality
Solution Approach 2:
The patent introduces dynamic adaptation by allowing the system to adjust its encoding strategy based on data characteristics. When dealing with noisy signal data or limited bit lengths, the system can dynamically modify reference block selection criteria and delta encoding parameters, making the entropy encoding method more practical while preserving data compaction benefits
4Reliability
If traditional encryption algorithms are used, then data security is provided, but storage and transmission overhead increases
Solution Approach 1:
The patent merges data compression and encryption functions into a unified approach. The delta encoding process itself provides a form of obfuscation by transforming data into differential representations that are inherently less meaningful without the reference blocks, thereby providing both compression and security benefits simultaneously while reducing overall storage overhead compared to applying traditional encryption algorithms separately
Data Source
AI summary
The inventor has conceived, and reduced to practice, a system and method for data compaction using that applies delta encoding methods to entropy encoding methods to improve data compaction of entropy encoding methods under certain conditions and when compacting data having certain characteristics. Delta encoding may be applied to entropy encoding methods to further compact data sets by reducing the number of sourceblocks included in a codebook to those most commonly encountered in data to be encoded and, where mismatches occur during encoding, using delta encoding of bit differences with existing sourceblocks in the codebook rather than adding new sourceblocks to the codebook.