Multi-Resolution Reference Pictures for Flexible Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding standards face inefficiencies when adapting to varying bandwidths by requiring spatial resolution changes at specific random access points, leading to increased complexity and potential quality degradation.
Innovation Solution
Allowing pictures to be coded and stored in a decoded picture buffer with different spatial resolutions, enabling flexible resolution changes at any picture location without upscaling or super-resolving processes, and using global motion vectors to handle resolution differences.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If video coding standards require spatial resolution changes at specific random access points, then bandwidth adaptation is achieved, but device complexity and quality degradation increase
Solution Approach 1:
The patent applies dynamics by enabling spatial resolution changes at any picture location rather than being constrained to specific random access points. This dynamic approach allows the video coding system to adapt resolution flexibly throughout the video sequence based on bandwidth conditions, eliminating the need for fixed resolution change points and reducing the complexity associated with managing discrete resolution transitions.
Solution Approach 2:
The patent utilizes parameter changes by modifying the spatial resolution parameter of pictures stored in the decoded picture buffer. By allowing resolution parameters to vary freely across different pictures without requiring upscaling or super-resolving processes, the system achieves efficient bandwidth adaptation while maintaining coding simplicity and picture quality.
2Stability of the object's composition
If upscaling or super-resolving processes are used to handle resolution differences, then resolution consistency is maintained, but computational complexity increases
Solution Approach 1:
The patent extracts and eliminates the complex upscaling and super-resolving processes from the video coding system. By removing these computationally intensive operations and allowing pictures to be stored and processed at their native resolutions in the decoded picture buffer, the system maintains resolution consistency through natural variation rather than forced uniformity, significantly reducing computational complexity.
3Adaptability or versatility
If resolution changes are made at any picture location, then bandwidth adaptation flexibility is improved, but reference picture management complexity increases
Solution Approach 1:
The patent applies universality by creating a decoded picture buffer that can universally store pictures with different spatial resolutions without requiring separate processing paths or special management mechanisms. This multi-functional buffer handles variable resolution pictures uniformly, allowing the same reference picture management procedures to work regardless of resolution differences, thereby maintaining flexibility while controlling complexity.
Data Source
AI summary
Video coding methods, apparatuses, and non-transitory computer readable mediums are provided. The method includes: obtaining a list of reference pictures comprising a plurality of pictures stored in a buffer, where the plurality of pictures comprise at least a first picture with a first spatial resolution, and a second picture with a second spatial resolution different from the first spatial resolution; obtaining a reference picture from the list of reference pictures; predicting a current picture by using the reference picture with its original spatial resolution without ensuring the reference picture to have a same spatial resolution as the current picture; and generating a bitstream based on a predicted current picture.