Reference Picture Resampling with VUI Output Size Signaling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies, such as VVC, require display devices to perform post-processing to rescale output pictures to a constant size, limiting pre-processing control and preventing content providers from indicating the best display resolution according to director's intent.
Innovation Solution
Signal a constant output picture size in video usage information (VUI) metadata, allowing display devices to maintain or adjust picture dimensions based on preset values, enabling user freedom and director's suggestions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If reference picture resampling (RPR) is used to enable change of decoded picture spatial resolutions, then picture resolution adaptability is improved, but display device complexity increases due to required post-processing rescaling capability
Solution Approach 1:
The patent applies preliminary action by signaling the constant output picture size in VUI metadata during the encoding stage, rather than requiring post-processing rescaling at the display device. This pre-defines the output picture dimensions, eliminating the need for complex resampling operations at the display end while maintaining resolution adaptability through the coded video sequence.
2Stability of the object's composition
If post-processing rescaling is required at display device, then picture size consistency is improved, but pre-processing control capability is worsened
Solution Approach 1:
The patent introduces an intermediary solution by embedding constant output picture size information in VUI metadata that serves as a communication bridge between content provider and display device. This metadata enables the content provider to indicate the best display resolution according to director's intent, while the display device can freely choose to follow or ignore this suggestion, thus maintaining both control capability and size consistency.
3Extent of automation
If constant output picture size is signaled in VUI metadata, then director's intent control is improved, but metadata complexity increases
Solution Approach 1:
The patent applies local quality by selectively signaling the constant output picture size flag and associated width/height values only when director's intent control is required, rather than making it a mandatory universal feature. This allows the metadata structure to remain simple for content that doesn't require such control, while providing enhanced functionality where needed, thus improving director's intent control without universally increasing metadata complexity.
Data Source
AI summary
There is included a method and apparatus comprising computer code configured to cause a processor or processors to perform acquiring an input bitstream comprising metadata and video data, decoding the video data, determining whether the metadata comprises at least one flag signaling at least one component of a picture size of at least one picture of the video data, and signaling, in a case where it is determined that the metadata comprises the at least one flag, a display device to display the at least one picture from the video data according to the at least one flag.