Symmetric Substream Pairing for Parallel Video Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding techniques face challenges in parallel decoding of substreams due to excessive bitrate overhead from signaling and delayed start of parallel processing, as they require complete receipt of substreams before decoding can commence.
Innovation Solution
A method that groups substreams into pairs, reverses the order of the second substream to make them symmetric, and encapsulates them with global size information, allowing for immediate parallel decoding once the symmetric pairs are received, and optionally fragments the substreams into fixed-size pieces for faster decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If substreams are concatenated with size information for parallel decoding, then parallel processing capability is improved, but bitrate overhead increases proportionally to the number of substreams
Solution Approach 1:
The patent merges the size information of multiple substreams into a single global size field in the NAL unit header. Instead of signaling the size of each individual substream separately (which would require N fields for N substreams), the invention uses one global size parameter that represents the total size of all concatenated substreams. This merging approach reduces the signaling overhead from O(N) to O(1), directly resolving the contradiction between parallel decoding capability and bitrate overhead.
2Reliability
If complete substreams are received before decoding begins, then decoding accuracy is maintained, but processing delay increases
Solution Approach 1:
The patent applies preliminary action by performing entropy decoding on substreams as soon as they are received, without waiting for complete reception of all substreams. The global size information in the NAL unit header enables the decoder to determine when each substream is complete and can be independently decoded. This allows early decoding of available substreams while maintaining accuracy, reducing the waiting time compared to traditional approaches that require all substreams to be fully received before any decoding begins.
3Device complexity
If substreams are processed sequentially, then implementation complexity is reduced, but processing speed decreases
Solution Approach 1:
The patent segments the video data into multiple independent substreams that can be processed in parallel. Each substream is encapsulated within a NAL unit with global size information, allowing the decoder to identify and process each substream independently. This segmentation enables parallel processing architecture where multiple decoding operations can occur simultaneously, increasing processing speed while maintaining manageable complexity through the standardized NAL unit structure.
Data Source
AI summary
A method and apparatus are provided for encapsulating a plurality of data substreams encoded in a bit stream, wherein the encoded data substream is obtained by entropy encoding of a symbol subsequence representing an image or a series of images. The method includes grouping data substreams into substream pairs according to an iterative traversal order predetermined from the plurality of substreams, and on the basis of a pair of the substreams, obtaining a symmetrical pair by reversing a data order making up the second substream of the pair. The obtained pairs are then concatenated within a sequence. The binary stream is created by encapsulating the sequence and information related to a number of substreams and related to the sizes of pairs of symmetrical substreams.