Adaptive Picture Resolution Decoding for Scalable Video
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding technologies face challenges in efficiently signaling and managing adaptive resolution changes across multiple semantically independent pictures within a video sequence, particularly in applications like 360-degree video and surveillance, where different parts of a scene require separate resolution settings, leading to increased complexity and data overhead.
Innovation Solution
The method involves decoding video data with different picture order counts within the same access unit, allowing for independent resolution settings and resampling of reference pictures, which are signaled through novel options for Adaptive Resolution Change (ARC) parameters, such as up/downsample factors, filter parameters, and spatial scalability, enabling flexible resolution changes within a coded video sequence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If adaptive resolution changes are implemented across multiple pictures within an access unit, then spatial scalability and flexibility are improved, but device complexity and signaling overhead increase
Solution Approach 1:
The patent divides the video sequence into multiple semantically independent pictures within an access unit, each capable of having different resolution settings. This segmentation allows independent resolution control for different pictures while maintaining a unified decoding framework through the use of picture order count (POC) values to identify and manage individual pictures.
Solution Approach 2:
The patent implements adaptive resolution change by modifying the resolution parameters of reference pictures based on POC values. The encoder signals resolution change parameters (such as scaling factors or target resolutions) that the decoder applies selectively to different reference pictures, enabling flexible resolution adaptation without requiring complete re-encoding of all pictures.
2Productivity
If different resolution settings are applied to various parts of a video scene, then compression efficiency is improved, but data overhead for signaling resolution parameters increases
Solution Approach 1:
The patent uses picture order count (POC) values as identifiers to reference and manage multiple pictures with different resolutions. Instead of encoding complete resolution information for each picture, the system copies the POC-based reference mechanism from temporal scalability and applies it to spatial scalability, reducing signaling overhead by referencing existing picture identifiers rather than transmitting new resolution parameters for each picture.
3Adaptability or versatility
If reference pictures are resampled for different resolutions within a coded video sequence, then adaptability is improved, but manufacturing precision and reconstruction accuracy may deteriorate
Solution Approach 1:
The patent performs resampling of reference pictures in advance during the encoding process, creating pre-resampled reference pictures at different resolutions. This preliminary action ensures that when these reference pictures are used for prediction, the resolution mismatch has already been addressed, improving reconstruction accuracy compared to performing resampling during decoding.
Data Source
AI summary
A method and apparatus for decoding multiple semantically independent picture parts into a single video picture includes decoding unique picture order count values for each coded picture, coded slice, or coded tile in a coded video sequence, with multiple decoded pictures, cycles, and tiles belonging to a same access unit representing a frame of the video. A value representing the amount of pictures, cycles, or tiles, is then assigned to each access unit for assigning sequential access unit count values to the access units. As a result, each access unit, which represents multiple pictures, slices, or tiles to be combined into a single frame, is decoded for display processing.