Syntax Structures for Coded Region Completion in Video Bitstreams
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video codec standards introduce latency and complexity in decoding processes due to the need to wait for complete encoded data or fully parse incoming data, which is problematic in real-time video communication scenarios.
Innovation Solution
Incorporating syntax structures in the elementary bitstream that indicate the completion of coded regions, such as special NAL units or SEI messages, to allow decoders to quickly detect picture boundaries and start decoding without waiting for complete data, reducing the need for buffering and parsing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the decoder waits for complete encoded data or fully parses incoming data before starting decoding, then decoding accuracy is improved, but latency and processing time increase
Solution Approach 1:
The patent applies preliminary action by inserting completion indication syntax structures into the bitstream in advance, before the decoder needs to determine if all data has been received. This allows the decoder to proactively identify picture boundaries and start decoding without waiting for complete data reception or full parsing, thus reducing latency while maintaining decoding accuracy through the pre-placed completion markers.
2Reliability
If the decoder waits for complete encoded data or fully parses incoming data, then decoding completeness is ensured, but device complexity and processing overhead increase
Solution Approach 1:
The patent extracts the complexity of determining data completeness from the decoder by introducing separate completion indication syntax structures in the bitstream. Instead of requiring the decoder to perform complex parsing and analysis to determine if all data has been received, the completion status is explicitly indicated by these syntax structures, thereby reducing decoder complexity while ensuring decoding completeness.
3Adaptability or versatility
If traditional syntax structures are used without completion indications, then bitstream compatibility is maintained, but error detection and robustness to packet loss deteriorate
Solution Approach 1:
The patent applies segmentation by dividing the bitstream into clearly demarcated picture regions using completion indication syntax structures. These syntax structures create explicit boundaries between pictures and coded regions, allowing the decoder to easily identify picture ends and detect errors or packet losses without compromising compatibility with traditional bitstream formats. The segmented structure enhances reliability by enabling precise error detection while maintaining adaptability to existing decoding frameworks.
Data Source
AI summary
Syntax structures that indicate the completion of coded regions of pictures are described. For example, a syntax structure in an elementary bitstream indicates the completion of a coded region of a picture. The syntax structure can be a type of network abstraction layer unit, a type of supplemental enhancement information message or another syntax structure. For example, a media processing tool such as an encoder can detect completion of a coded region of a picture, then output, in a predefined order in an elementary bitstream, syntax structure(s) that contain the coded region as well as a different syntax structure that indicates the completion of the coded region. Another media processing tool such as a decoder can receive, in a predefined order in an elementary bitstream, syntax structure(s) that contain a coded region of a picture as well as a different syntax structure that indicates the completion of the coded region.