Multi-Resolution Reference Pictures for Adaptive Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards face inefficiencies in managing decoded pictures with varying spatial resolutions, particularly when adapting to changing bandwidth conditions, leading to increased complexity and visual quality degradation during resolution changes.
Innovation Solution
A method and apparatus for video coding that allows storing and utilizing decoded pictures with different spatial resolutions in a decoded picture buffer, enabling flexible resolution changes without upscaling or super-resolving, and employing global motion vectors to handle zooming effects between pictures with varying resolutions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If decoded pictures with varying spatial resolutions are stored in the decoded picture buffer, then adaptability to changing bandwidth conditions is improved, but device complexity increases
Solution Approach 1:
The decoded picture buffer is segmented into multiple resolution-specific storage areas, allowing pictures at different spatial resolutions to be stored and managed separately. This segmentation enables the system to adapt to varying bandwidth conditions by selecting appropriate resolution pictures without increasing overall system complexity
Solution Approach 2:
The reference picture list is made dynamic by allowing it to include pictures with varying spatial resolutions based on current bandwidth conditions and coding requirements. The system can dynamically adjust which resolution pictures are stored and used as references, improving adaptability while managing complexity through controlled flexibility
2Manufacturing precision
If pictures are stored in the decoded picture buffer based on their corresponding picture resolutions, then visual quality is maintained during resolution changes, but processing time increases
Solution Approach 1:
Pictures are pre-processed and stored in the decoded picture buffer at their original spatial resolutions before being needed for coding. By maintaining pictures at their native resolutions in advance, the system avoids time-consuming upscaling or super-resolving operations when resolution changes are required, thus preserving visual quality while reducing processing time
Solution Approach 2:
The system changes the resolution parameter of stored pictures by keeping multiple resolution versions in the decoded picture buffer. Instead of transforming pictures in real-time, the system selects the appropriate resolution version from pre-stored options, maintaining visual quality while minimizing processing time
3Device complexity
If global motion vectors are used to handle zooming effects between pictures with varying resolutions, then computational complexity is reduced, but measurement precision decreases
Solution Approach 1:
Global motion vectors serve as an intermediary mechanism to handle zooming effects between pictures of varying resolutions. Instead of performing complex per-block motion estimation for resolution changes, the system uses global motion vectors to model the overall zooming transformation, reducing computational complexity while maintaining acceptable motion estimation precision
Data Source
AI summary
Video coding methods and apparatuses are provided. A set of two or more pictures is coded. The set includes at least a first picture coded with a first spatial resolution, and a second picture coded with a second spatial resolution different from the first spatial resolution. The set of two or more pictures is stored in a decoded picture buffer based on corresponding spatial resolutions. The set of two or more pictures stored in the decoded picture buffer is used as a set of reference pictures for coding one or more successive pictures subsequent to the set of two or more pictures. The set of two or more pictures is incorporated into a reference picture list that contains pictures with at least two different spatial resolutions.