Layered Video Alignment With Adaptive Subpicture Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies struggle to efficiently handle multiple semantically independent source pictures with different adaptive resolution settings, requiring separate resampling and signaling for each picture, which can lead to inefficient encoding, decoding, and display of video layers.
Innovation Solution
The method involves identifying subpicture regions in a decoded video bitstream, decoding and displaying foreground subpictures based on selection, and background subpictures based on non-selection, using adaptive resolution change (ARC) parameters to align and adjust resolution across layers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If separate resampling and signaling is performed for each picture with different adaptive resolution settings, then each picture can have independent resolution optimization, but the encoding, decoding, and display complexity increases significantly
Solution Approach 1:
The patent merges multiple semantically independent source pictures into a single layered video structure. By combining multiple pictures into one coded video sequence with layered organization, the system maintains adaptive resolution capabilities while reducing the overhead of separate encoding and signaling for each picture, thus resolving the contradiction between adaptability and complexity.
Solution Approach 2:
The layered video structure serves multiple functions simultaneously: it enables adaptive resolution changes, supports multiple semantically independent source pictures, and provides a unified encoding/decoding framework. This multi-functionality allows the system to achieve resolution optimization without the complexity of separate processing for each picture.
2Adaptability or versatility
If multiple semantically independent source pictures are handled separately with different adaptive resolution settings, then each picture can be optimized independently, but the processing time and computational resources increase
Solution Approach 1:
By merging multiple source pictures into a single layered video sequence, the system processes them together through one encoding and decoding pipeline rather than handling each separately. This maintains the ability to apply different adaptive resolution settings while improving processing efficiency and reducing computational overhead.
3Adaptability or versatility
If reference pictures are resampled to different resolutions within a coded video sequence, then resolution flexibility is improved, but only parts of the picture canvas are used in case of downsampling or upsampling
Solution Approach 1:
The patent segments the video content into layered structures where different regions (foreground and background) can have different resolution settings. This segmentation allows full utilization of the picture canvas by assigning appropriate resolution levels to different semantic regions, avoiding the waste of canvas space that occurs with uniform resampling approaches.
Data Source
AI summary
A method, computer program, and computer system is provided for aligning across layers in a coded video stream. A video bitstream having multiple layers is decoded. One or more subpicture regions are identified from among the multiple layers of the decoded video bitstream, the subpicture regions including a background region and one or more foreground subpicture regions. An enhanced subpicture is decoded and displayed based on a determination that a foreground subpicture region is selected. The background region is decoded and displayed based on a determination that a foreground subpicture region was not selected.