Video Bitstream Merging Using Compatibility Merge Identifiers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding/decoding systems face challenges in efficiently merging multiple video streams due to complex syntax dependencies and computational overhead, particularly in devices with limited resources, which complicates applications like picture-in-picture compositing and tile-based streaming.
Innovation Solution
A video codec system that includes merge identifiers to indicate compatibility and complexity of merging procedures, allowing for efficient merging of video streams by adjusting parameter sets, slice headers, and slice payloads without full pixel decoding.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If full pixel decoding and pixel-domain compositing is performed, then compositing quality is improved, but computational complexity increases significantly
Solution Approach 1:
The patent extracts only the necessary syntax elements and parameter sets from the bitstream required for compositing operations, avoiding full pixel decoding. This selective extraction approach maintains compositing quality while significantly reducing computational complexity by processing only essential data at the bitstream level.
Solution Approach 2:
The patent replaces the mechanical pixel-domain compositing process with a bitstream-level operation that manipulates syntax elements, parameter sets, and NAL units directly. This substitution eliminates the need for full decoding and re-encoding cycles, reducing computational overhead while preserving compositing functionality.
2Adaptability or versatility
If transcoding-based compositing is used, then compositing functionality is achieved, but rate distortion performance deteriorates
Solution Approach 1:
The patent performs partial compositing operations at the bitstream level by selectively modifying only the necessary syntax elements and parameter sets rather than performing complete transcoding. This partial action approach achieves the required compositing functionality while minimizing degradation of rate distortion performance by avoiding unnecessary re-encoding of the entire stream.
3Adaptability or versatility
If multiple video streams are merged without merge identifiers, then merging flexibility is maintained, but merging complexity increases
Solution Approach 1:
The patent introduces merge identifiers that are pre-calculated and embedded in the bitstream before merging operations. These identifiers contain pre-analyzed compatibility information about syntax elements and parameter sets, allowing the merging process to quickly determine compatibility without performing complex real-time analysis, thus reducing merging complexity while maintaining flexibility.
Solution Approach 2:
The patent uses merge identifiers as intermediary elements that mediate between multiple video streams during merging. These identifiers serve as a compatibility checklist that simplifies the merging decision process by providing pre-evaluated information about which syntax elements and parameter sets can be safely merged, reducing the computational burden of compatibility checking.
Data Source
AI summary
A video encoder for providing an encoded video representation. The video encoder provides a level information that indicates a compatibility of a video stream with a video decoder having a capability level out of a plurality of predetermined capability levels as well as a fractional level information that indicates a fraction of one of the plurality of predetermined capability levels. A video decoder for decoding a provided video representation receives level information and fractional level information.