Reference Picture Resampling for Adaptive Video Resolution Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards lack the ability to adaptively change resolution without introducing intra random access points, which can lead to increased decoding complexity, resource usage, and poor user experience in applications like video conferencing and streaming.
Innovation Solution
Implement methods for video processing that include adaptive resolution change (ARC) and reference picture resampling (RPR), allowing for seamless resolution adjustments by applying interpolation filters, deblocking filters, and enabling/disabling coding tools based on resolution and size differences, and defining conformance windows for video blocks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If intra random access points are introduced to change resolution, then resolution adaptability is improved, but decoding complexity and resource usage increase
Solution Approach 1:
The patent implements dynamic resolution adjustment by enabling the video coding system to adaptively change resolution during video sequences without requiring intra random access points. This is achieved through reference picture resampling and adaptive application of video coding tools based on resolution differences, allowing smooth transitions between resolutions while maintaining continuous decoding without resetting to key frames.
Solution Approach 2:
The patent changes the resolution parameter dynamically by applying reference picture resampling techniques. When resolution changes are detected, the system resamples reference pictures to match the new resolution and selectively applies or disables video coding tools based on the resolution difference, enabling resolution adaptation without introducing intra random access points.
2Adaptability or versatility
If reference picture resampling is applied to handle resolution differences, then resolution adaptability is improved, but processing complexity increases
Solution Approach 1:
The patent applies reference picture resampling selectively based on local resolution differences. The system determines whether resampling is needed by comparing resolutions of current and reference pictures, and only applies resampling operations when resolution differences are detected, avoiding unnecessary processing in cases where resolutions match.
Solution Approach 2:
The patent implements partial resampling by applying video coding tools selectively based on resolution differences. When resolution differences exceed certain thresholds, the system disables certain tools to reduce processing complexity while maintaining adequate video quality, rather than applying all tools uniformly in all resolution scenarios.
3Productivity
If video coding tools are selectively enabled or disabled based on resolution differences, then coding efficiency is improved, but control complexity increases
Solution Approach 1:
The patent performs preliminary resolution comparison before applying video coding tools. By detecting resolution differences between current and reference pictures in advance, the system can pre-determine which tools to enable or disable, avoiding the need for complex real-time decisions during the coding process.
Solution Approach 2:
The patent dynamically adjusts the configuration of video coding tools based on detected resolution differences. The system enables or disables specific tools adaptively according to the magnitude of resolution changes, optimizing coding efficiency for each resolution scenario while using straightforward enable/disable control mechanisms.
Data Source
AI summary
An example method of video processing includes determining, for a conversion between a current block of a current picture of a video and a bitstream of the video, whether to disable a coding tool for the current block; and performing the conversion based on the determining, wherein the coding tool is disabled when a dimension of a reference picture of one or more reference pictures of the current block is different from a dimension of the current picture, or a dimension of a scaling window in a reference picture of one or more reference pictures of the current block is different from a dimension of a scaling window in the current picture.