Reference Picture Resampling for Adaptive Video Resolution Decoding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies struggle with efficiently managing changes in picture size and resolution within a coded video sequence, particularly in scenarios requiring adaptive resolution changes and spatial scalability, leading to inefficiencies in bandwidth and storage requirements.
Innovation Solution
Implementing a method for decoding video bitstreams that utilizes flags to determine if reference picture resampling is enabled, allowing for adaptive resolution change (ARC) or spatial scalability without ARC based on picture resolution changes, using flags to control the decoding process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If reference picture resampling is performed for adaptive resolution change, then picture resolution flexibility is improved, but decoding complexity increases
Solution Approach 1:
The patent implements dynamic resolution adjustment by enabling the picture resolution to change adaptively within a coded video sequence based on scene activity and other factors. The decoder can dynamically select between different resolution modes (original resolution, downsampled resolution, or upsampled resolution) using flags in the bitstream, allowing the system to adapt to varying content requirements without fixed resolution constraints.
Solution Approach 2:
The patent changes the resolution parameter of reference pictures during decoding by applying resampling operations. The decoder modifies the resolution parameter dynamically based on the adaptive resolution change flag and other control parameters, enabling the same reference picture to be used at different resolutions without requiring separate reference pictures for each resolution level.
2Adaptability or versatility
If reference picture resampling is performed for spatial scalability, then compatibility across different resolutions is improved, but processing time increases
Solution Approach 1:
The patent performs reference picture resampling in advance during the decoding of reference pictures, so that when these reference pictures are needed for prediction of subsequent pictures, they are already available at the required resolution. This preliminary resampling action avoids the need for real-time resampling during picture reconstruction, reducing processing time delays.
3Quantity of substance
If picture resolution is changed within a coded video sequence, then bandwidth efficiency is improved, but decoding complexity increases
Solution Approach 1:
The patent segments the coded video sequence into different resolution sections using control flags. The bitstream is divided into portions that indicate whether adaptive resolution change should be applied, allowing the decoder to process only the necessary resolution transformations for each segment rather than applying complex resampling to the entire sequence, thus reducing overall decoding complexity while maintaining bandwidth efficiency.
Data Source
AI summary
In a method of decoding, a first flag of a sequence parameter set (SPS) that is referred to by a current picture is obtained. The current picture is decoded based on whether the first flag indicates the reference picture resampling is enabled. The first flag equal to a first value indicates that the reference picture resampling is enabled and the current picture is allowed to include slices that refer to a reference picture with at least one of a different spatial resolution or a different scaling window in an active entry of a reference pictures list. The first flag equal to a second value indicates that the reference picture resampling is disabled and no slice of the current picture refers to the reference picture with the at least one of the different spatial resolution or the different scaling window in the active entry of the reference picture list.