Coded Video Layer Alignment With Adaptive Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies struggle to efficiently handle multiple semantically independent source pictures with different adaptive resolution settings, requiring separate resampling and alignment across layers, which leads to inefficiencies in encoding, decoding, and display, particularly in applications like 360 coding and surveillance.
Innovation Solution
Implementing adaptive resolution change (ARC) signaling mechanisms that allow for flexible resolution changes within coded video sequences by resampling reference pictures, using options such as signaling ARC parameters in sub-picture headers or parameter sets, enabling efficient alignment and display of multiple layers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If separate resampling and alignment across layers is performed for multiple semantically independent source pictures with different adaptive resolution settings, then resolution adaptability is improved, but encoding and decoding complexity increases
Solution Approach 1:
The video picture is divided into multiple layers, with each layer representing a different resolution setting. The base layer contains the lowest resolution picture, while enhancement layers contain progressively higher resolution data. This segmentation allows the decoder to reconstruct pictures at different resolutions by selectively decoding relevant layers, achieving resolution adaptability without requiring separate resampling operations for each resolution setting.
Solution Approach 2:
Multiple resolution pictures are nested within a single coded video sequence through layered structure. Each enhancement layer is nested within the context of the base layer, with higher resolution pictures containing the lower resolution information plus additional detail. This nesting eliminates the need for separate resampling and alignment operations, as all resolution settings are inherently integrated in the layered structure.
2Adaptability or versatility
If adaptive resolution change signaling mechanisms are implemented with separate resampling for each layer, then encoding flexibility is improved, but processing time increases
Solution Approach 1:
All resolution variations are pre-encoded into the layered structure during the encoding phase. The base layer and enhancement layers are prepared in advance with all necessary resolution information embedded. During decoding, the receiver can rapidly switch between different resolution settings by simply selecting which layers to decode, eliminating the need for time-consuming resampling and alignment operations during real-time processing.
Data Source
AI summary
A method, computer program, and computer system is provided for aligning across layers in a coded video stream. A video bitstream having multiple layers is decoded. One or more subpicture regions are identified from among the multiple layers of the decoded video bitstream, the subpicture regions including a background region and one or more foreground subpicture regions. An enhanced subpicture is decoded and displayed based on a determination that a foreground subpicture region is selected. The background region is decoded and displayed based on a determination that a foreground subpicture region was not selected.