Chunked Entropy Stream Concatenation Without Padding Overhead
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data stream concatenation methods face inefficiencies when dealing with streams of varying lengths, particularly in entropy-based encoding, leading to increased data size and computational complexity due to the need for padding and misaligned chunk boundaries.
Innovation Solution
A method for concatenating data streams by inserting or swapping portions of chunks to align boundaries, eliminating padding, and shifting or swapping trailing portions to maintain fixed intervals, allowing efficient decoding without explicit length signaling.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If data streams of varying lengths are concatenated using traditional methods, then the concatenation process is simple, but padding data must be added to align chunk boundaries, increasing data size
Solution Approach 1:
The patent extracts and removes padding data from the data streams before concatenation. By taking out the unnecessary padding portions that would otherwise need to be added to align chunk boundaries, the method reduces the total data size while maintaining proper chunk alignment in the concatenated stream
Solution Approach 2:
The patent performs preliminary processing of the data streams by removing padding data before the concatenation operation. This preliminary action prepares the streams in advance, allowing them to be concatenated without requiring additional padding, thus reducing overall data size while maintaining simplicity
2Manufacturing precision
If padding data is added to align chunk boundaries, then chunk boundary alignment is achieved, but computational complexity increases due to padding management
Solution Approach 1:
The patent converts the harmful effect of padding data (which increases complexity) into a benefit by removing it entirely. By eliminating padding, the method achieves chunk boundary alignment through a simpler process that reduces computational complexity while maintaining the necessary precision for proper decoding
3Loss of information
If explicit length signaling is added to data streams, then stream lengths can be identified, but data size and processing overhead increase
Solution Approach 1:
The patent enables the concatenated data stream to be self-describing through the structure created by removing padding. The absence of padding and the fixed interval arrangement allow the stream to inherently encode length information, eliminating the need for separate explicit length signaling while maintaining data size efficiency
4Manufacturing precision
If chunks are inserted or swapped to align boundaries, then fixed intervals are maintained, but processing complexity increases
Solution Approach 1:
The patent performs preliminary removal of padding data before concatenation, which pre-aligns the chunks to maintain fixed intervals. This preliminary action simplifies the subsequent processing by eliminating the need for complex insert or swap operations during the concatenation phase
Solution Approach 2:
Instead of adding padding or performing complex insert/swap operations to achieve alignment, the patent inverts the approach by removing padding data. This inverse operation achieves the same alignment goal with simpler processing, reducing complexity while maintaining fixed interval precision
Data Source
AI summary
In an example method, a first data stream and a second data stream are obtained. Each of the first data stream and the second data stream includes one or more chunks. Further, a third data stream is generated. The third data stream includes the first data stream and the second data stream. Generating the third data stream includes inserting, in the third data stream, at least a portion of a first chunk of the second data stream between a beginning and an end of a second chunk of the first data stream. Further, the third data stream is provided for transmission or storage.