Adaptive Resolution Conversion Flag in Video Picture Headers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding standards lack the ability to adaptively change resolution without introducing an IDR or IRAP picture, which can lead to issues such as increased decoding complexity, latency, and poor user experience, especially in applications like video conferencing and streaming where network conditions and active speaker changes are frequent.
Innovation Solution
The implementation of adaptive resolution conversion (ARC) technology, which allows for dynamic resolution changes by resampling reference pictures and signaling this change in the picture header, enabling efficient prediction structures and seamless switching between different spatial resolutions in video coding systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of time
If adaptive resolution conversion is implemented without IDR or IRAP pictures, then decoding complexity and latency are reduced, but video coding standards lack the ability to adaptively change resolution
Solution Approach 1:
The patent implements dynamic resolution conversion by introducing an adaptive resolution conversion flag and reference picture resampling mechanism that allows the decoder to dynamically adjust resolution without requiring IDR or IRAP pictures. The decoder can selectively resample reference pictures based on the flag value, enabling flexible adaptation to different resolution requirements while maintaining continuous decoding operations.
Solution Approach 2:
The patent changes the resolution parameter dynamically by introducing a resampling mechanism controlled by an adaptive resolution conversion flag. When the flag is set, the decoder resamples reference pictures to the target resolution, allowing resolution adaptation without resetting the decoding process through IDR pictures, thus reducing latency while maintaining adaptability.
2Adaptability or versatility
If resolution changes are made frequently to adapt to network conditions, then adaptability is improved, but decoding complexity increases
Solution Approach 1:
The patent applies partial action by implementing selective resampling based on the adaptive resolution conversion flag. Instead of always resampling reference pictures (which would maximize complexity), the system performs resampling only when the flag indicates it is needed, thus reducing average decoding complexity while maintaining the ability to adapt to network conditions when necessary.
Solution Approach 2:
The decoder performs self-service by autonomously determining when resolution adaptation is needed based on the adaptive resolution conversion flag and network conditions, without requiring external intervention or complex control mechanisms. This simplifies the overall system complexity while maintaining adaptability.
3Reliability
If adaptive resolution conversion is implemented, then user experience is enhanced by avoiding quality pumping, but requires resampling reference pictures
Solution Approach 1:
The patent performs preliminary resampling of reference pictures before they are used for prediction. By resampling reference pictures in advance when the adaptive resolution conversion flag is set, the system ensures that high-quality reference pictures are available for subsequent decoding operations, preventing quality degradation and pumping effects while maintaining manageable processing complexity through staged operations.
Data Source
AI summary
A method of video processing are described. The method includes determining, for a conversion between a video region of a picture of a video and a coded representation of the video, enablement status of a coding tool used to represent the video region in the coded representation; and performing the conversion according to the determination; wherein a first flag is included in a picture header to indicate the enablement status of the coding tool for the picture.