Hybrid Data Encoding with File-Size Adaptive Compression
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current data compression techniques, especially for lossless data, achieve lower compression ratios compared to lossy methods, limiting storage capacity and increasing transmission time for binary data types like documents and database files.
Innovation Solution
A hybrid encoding and decoding system that uses either a variable length codeword (VLC) encoder or a hash table algorithm based on file size, combining both to achieve higher compression ratios by adaptively assigning codewords to binary data segments, thereby improving redundancy removal.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If traditional data compression techniques are used for binary data, then storage capacity is limited and transmission time increases, but using lossy methods achieves higher compression ratios
Solution Approach 1:
The patent segments binary data into fixed-size blocks (e.g., 512 bytes) and processes each block independently through the compression pipeline. This segmentation allows the system to apply compression algorithms to manageable units while maintaining data integrity across the entire file, resolving the contradiction by enabling efficient processing without data loss.
Solution Approach 2:
The patent changes the parameter of codeword length from fixed to variable based on data characteristics. By using variable-length codewords that adapt to the frequency and patterns of data blocks, the system achieves higher compression ratios for binary data while maintaining lossless compression, thus improving storage capacity without sacrificing data integrity.
2Productivity
If variable length codeword encoder is used for small files, then compression ratio is optimized, but for large files the compression efficiency decreases
Solution Approach 1:
The patent implements a dynamic compression system that adapts its strategy based on file size. For small files, it uses variable-length codeword encoding optimized for pattern recognition. For large files, it transitions to hash table-based compression that efficiently handles repetitive sequences. This dynamic adaptation resolves the contradiction by optimizing compression efficiency for different file size ranges.
Solution Approach 2:
The system changes the compression parameter based on file size threshold. When file size exceeds a predetermined threshold, the system switches from VLC-based compression to hash table-based compression, maintaining optimal compression efficiency across different file sizes by adapting the compression strategy to the data volume.
3Quantity of substance
If hash table algorithm is used for large files, then compression ratio improves, but for small files the overhead reduces efficiency
Solution Approach 1:
The patent uses file size as a parameter to determine which compression algorithm to apply. For files below a predetermined size threshold, it uses VLC encoder with lower overhead. For files above the threshold, it switches to hash table algorithm that provides better compression ratios. This parameter-based selection resolves the contradiction by matching algorithm complexity to file size requirements.
Data Source
AI summary
A data encoding system includes a non-transitory memory, a processor, a digital-to-analog converter (DAC) and a transmitter. The non-transitory memory stores a predetermined file size threshold. The processor is in operable communication with the memory, and is configured to receive data. The processor detects a file size associated with the data. When the file size is below the predetermined file size threshold, the processor compresses the data using a variable length codeword (VLC) encoder. When the file size is not below the predetermined file size threshold, the processor compresses the data, using a hash table algorithm. The DAC is configured to receive a digital representation of the compressed data from the processor and convert the digital representation of the compressed data into an analog representation of the compressed data. The transmitter is coupled to the DAC and configured to transmit the analog representation of the compressed data.