Video Encoder Resolution Control at Random-Access Pictures
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Frequent resolution changes in video coding increase computational and memory resource consumption, load, and make testing difficult, especially when the resolution of a reference picture differs from that of an inter-predicted picture.
Innovation Solution
An encoder and decoder that control resolution changes only at random access pictures, resample reference images when necessary, and constrain changes based on bitstream monitoring and fixed ratios, limiting frequent resolution alterations.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If resolution changes are allowed frequently in video coding, then adaptability to different picture resolutions is improved, but computational resource consumption and memory resource consumption increase
Solution Approach 1:
The patent segments the video stream into random access pictures and non-random-access pictures, applying resolution change constraints selectively. By dividing the picture sequence based on access patterns, the patent enables resolution flexibility where needed (at random access points) while maintaining stability and reducing computational load in other regions.
Solution Approach 2:
The patent implements periodic resolution changes only at random access pictures, which occur at fixed intervals in the video stream. This periodic constraint allows resolution to change at predictable, spaced intervals rather than continuously, reducing the overall computational burden while maintaining necessary adaptability.
2Adaptability or versatility
If resolution changes are allowed frequently in video coding, then adaptability to different picture resolutions is improved, but processing speed of encoding/decoding decreases
Solution Approach 1:
By segmenting the video coding process into random access and non-random-access picture groups, the patent applies resolution change operations only at specific segments (random access pictures). This segmentation prevents continuous resolution changes that would slow down processing, while still allowing necessary adaptability at key points.
Solution Approach 2:
The patent enforces periodic resolution changes at random access pictures occurring at fixed intervals, rather than allowing continuous changes. This periodic approach maintains processing speed by limiting the frequency of computationally intensive resolution change operations while preserving adaptability at regular intervals.
3Adaptability or versatility
If resolution changes are allowed frequently in video coding, then adaptability to different picture resolutions is improved, but device complexity increases
Solution Approach 1:
The patent divides the picture sequence into random access and non-random-access segments, applying resolution change logic only at random access picture boundaries. This segmentation simplifies the overall device architecture by concentrating complexity at specific points rather than requiring continuous resolution change capability throughout the entire coding process.
Solution Approach 2:
By limiting resolution changes to periodic random access pictures rather than allowing continuous changes, the patent reduces the complexity of resolution management circuits. The periodic constraint allows for simpler control logic that activates only at predetermined intervals rather than requiring complex continuous monitoring and adjustment mechanisms.
4Adaptability or versatility
If resolution changes are allowed frequently in video coding, then adaptability to different picture resolutions is improved, but testing difficulty increases
Solution Approach 1:
The patent segments resolution changes to occur only at random access picture boundaries, creating distinct, identifiable test points. This segmentation makes testing easier by providing clear, discrete locations where resolution changes should occur, rather than requiring verification of continuous resolution transitions throughout the video stream.
Solution Approach 2:
By enforcing periodic resolution changes at random access pictures that occur at fixed intervals, the patent creates a predictable, rhythmic pattern that simplifies testing. Testers can expect resolution changes at regular, known intervals rather than dealing with irregular, unpredictable changes, making it easier to detect and measure compliance.
Data Source
AI summary
An encoder includes: circuitry; and memory coupled to the circuitry. In operation, the circuitry: controls whether to change a resolution of a picture from a resolution of a previous picture preceding the picture in one of display order and encoding order, according to a constraint that allows the changing only when the picture is a random access picture among one or more random access pictures; and when a resolution of a reference picture to be used in encoding of an inter-predicted picture is different from a resolution of the inter-predicted picture, resamples a reference image in the reference picture according to a difference between the resolution of the reference picture and the resolution of the inter-predicted picture, and encodes an image in the inter-predicted picture using the reference image resampled.