Multilayer Video Coding Syntax for Arbitrary Decoder Layer Output
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in improving coding efficiency, enhancing image quality, reducing processing amounts, and circuit scales, as well as appropriately selecting elements or operations such as filters, blocks, motion vectors, and reference pictures.
Innovation Solution
The introduction of a configuration and method that allows decoders to arbitrarily specify layers in a multi-layer video bitstream, enabling flexible decoding by setting a syntax element to a value indicating that any layer can be output, thereby improving coding efficiency and reducing processing complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a fixed layer output mode is used in multi-layer video coding, then decoding complexity is reduced, but decoding flexibility and adaptability deteriorate
Solution Approach 1:
The patent applies dynamics by making the layer output configuration flexible rather than fixed. The encoder can dynamically select and signal different output layer modes (all layers, highest layer only, or specific layers) based on the decoder's capabilities and transmission conditions, allowing the system to adapt between complexity and flexibility requirements.
Solution Approach 2:
The patent changes the parameter of layer output configuration from a fixed state to a variable state. By introducing syntax elements that can take different values (indicating different output layer modes), the system can adjust the decoding behavior to match different application scenarios, resolving the contradiction between fixed complexity and flexible adaptability.
2Adaptability or versatility
If all layers are output in multi-layer video coding, then adaptability is improved, but processing amount increases
Solution Approach 1:
The patent applies local quality by allowing different output layer configurations for different scenarios. Instead of always outputting all layers, the system can selectively output only the necessary layers (e.g., highest layer only, or specific layers) based on the decoder's capabilities and transmission conditions, reducing processing amount while maintaining adaptability where needed.
Solution Approach 2:
The patent implements partial action by outputting only the necessary layers rather than all layers. The encoder can signal to output a subset of layers (e.g., highest layer only or specific layers) when full layer output is not required, reducing processing amount while maintaining sufficient adaptability for the given application.
3Adaptability or versatility
If layer output is arbitrarily specified by decoder, then decoding flexibility is improved, but device complexity increases
Solution Approach 1:
The patent applies preliminary action by having the encoder pre-configure and signal the layer output mode in the bitstream. The decoder receives these pre-configured instructions (vps_output_layer_mode and OutputLayerFlag) and follows them, which maintains decoding flexibility while reducing decoder complexity by eliminating the need for complex decision-making logic.
Solution Approach 2:
The patent introduces syntax elements (vps_output_layer_mode and OutputLayerFlag) as intermediaries that carry layer output configuration information from encoder to decoder. These intermediaries enable flexible layer output specification while simplifying the decoder's task by providing clear instructions, thus resolving the contradiction between flexibility and complexity.
4Manufacturing precision
If coding efficiency is improved through multiple layer output modes, then image quality is enhanced, but circuit scale increases
Solution Approach 1:
The patent applies universality by designing a multi-functional syntax element structure that can handle multiple layer output modes (all layers, highest layer only, specific layers) using the same basic mechanism. This universal approach enables improved coding efficiency and image quality through flexible layer selection without proportionally increasing circuit scale, as the same framework serves multiple functions.
Data Source
Figure 1
Figure 2(a)~2(f)
Figure 3~4
AI summary
An encoder (100) includes: circuitry and memory coupled to the circuitry. In the encoder (100), in operation, the circuitry: upon generating an encoded bitstream that includes a multi-layer structure, when it is allowed to arbitrarily specify by a decoder a layer to be output by the decoder, sets a syntax element for specifying a layer that is allowed to be output by the decoder, to a value indicating that it is allowed to arbitrarily specify the layer to be output; and generates the encoded bitstream that includes the multi-layer structure.