Video Bitstream Usability Information for Scalability Layer Composition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding systems face challenges in efficiently managing and displaying multiple scalability layers, particularly in 3D video content, where the intended display behavior of base and enhancement layers is not adequately indicated, leading to suboptimal rendering and compression efficiency.
Innovation Solution
Embedding usability information in the video bitstream to specify the intended display behavior of scalability layers, allowing for the combination, overlay, or modification of base and enhancement layer pictures, enabling precise control over the rendering process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If multiple scalability layers are used in video coding, then compression efficiency is improved, but the complexity of managing and displaying these layers increases
Solution Approach 1:
The video signal is divided into multiple scalability layers (base layer and enhancement layers) that can be independently encoded and decoded. This segmentation allows the system to achieve compression efficiency by transmitting only essential information in the base layer while optional details are provided in enhancement layers, resolving the contradiction between compression efficiency and management complexity.
Solution Approach 2:
The system dynamically adapts the number and type of scalability layers based on transmission conditions and display capabilities. The encoder can flexibly configure layer structures and the decoder can adaptively select which layers to process, reducing management complexity while maintaining compression efficiency under varying conditions.
2Device complexity
If the intended display behavior of scalability layers is not indicated, then the bitstream structure remains simple, but rendering quality deteriorates
Solution Approach 1:
The encoder embeds usability information into the bitstream beforehand, specifying the intended display behavior of scalability layers. This preliminary indication allows the decoder to correctly interpret and render the layers without requiring complex runtime analysis, thereby maintaining bitstream simplicity while ensuring high rendering quality through proper layer composition guidance.
3Adaptability or versatility
If base and enhancement layer pictures are combined during display, then rendering flexibility is improved, but display hardware requirements increase
Solution Approach 1:
The system introduces an intermediary layer composition mechanism that mediates between the scalability layers and the display device. By embedding usability information that describes how layers should be composed (overlaying, side-by-side, or other combinations), the system enables rendering flexibility without requiring the display hardware to inherently understand and process multiple layer formats, thus reducing hardware complexity requirements.
Data Source
AI summary
Various methods, apparatuses and computer program products for video encoding and decoding are provided. In some embodiments, to indicate a composition of pictures of different time instants, some usability information may be embedded to the video bitstream indicating the intended display behavior when more than one layer is used and associated display behavior using this information. More specifically, the embedded information may indicate how the layers need to be composed in the video bitstream. The information may indicate if the intended display behavior is to combine (overlay) base layer and enhancement layer decoded pictures. The information may indicate that the base and enhancement layer decoded pictures are allowed to be overlaid. In addition or alternatively, the information may indicate that the enhancement layer picture should not be combined with base layer picture during display.