Video Decoding OOB Masking for Wrap-Around and RPR
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding schemes face inefficiencies due to the lack of Out-Of-Boundary (OOB) determination processing for wrap-around and Reference Picture Resampling (RPR) processing, which can reduce coding efficiency and hinder simultaneous application of these techniques, particularly in handling 360-degree panoramic images and varying transmission rate scenarios.
Innovation Solution
A video decoding apparatus with an OOB determination unit and OOB mask derivation unit to determine OOB processing by comparing reference block coordinates with picture coordinates, accounting for wrap-around and reference picture resampling, thereby reducing calculation requirements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If wrap-around processing is applied to enable continuous motion compensation in 360-degree panoramic images, then coding efficiency is enhanced, but out-of-boundary determination becomes complex and calculation requirements increase
Solution Approach 1:
The patent changes the parameter representation by introducing a flag `refPicIsScaled` to indicate whether reference picture resampling is applied, and uses scaled coordinates `refxSbL`, `refySbL` instead of direct pixel coordinates. This allows the system to handle wrap-around processing by checking coordinate boundaries after scaling, thereby maintaining coding efficiency while managing complexity through parameter transformation.
Solution Approach 2:
The patent segments the OOB determination process into multiple steps: first determining whether wrap-around processing is applied, then checking scaled coordinates against picture boundaries. This segmentation allows the system to handle complex wrap-around scenarios by breaking down the determination process into manageable checks, reducing overall computational complexity.
2Manufacturing precision
If reference picture resampling processing is applied to handle varying transmission rates, then image quality is enhanced, but coordinate system alignment becomes complex and correct OOB determination cannot be performed
Solution Approach 1:
The patent introduces the flag `refPicIsScaled` to track whether reference picture resampling has been applied, and maintains scaled coordinate representations (`refxSbL`, `refySbL`) that account for the resampling transformation. This allows the system to correctly determine OOB status by comparing scaled coordinates against the target picture's scaled boundaries, thereby maintaining image quality while managing coordinate system complexity through explicit parameter tracking.
3Productivity
If OOB processing is applied to substitute out-of-boundary reference blocks, then coding efficiency improves, but calculation requirements increase when combined with wrap-around and RPR processing
Solution Approach 1:
The patent uses scaled coordinates and the `refPicIsScaled` flag to efficiently determine OOB status without performing complex coordinate transformations for each pixel. By pre-calculating scaled boundary positions and using the flag to guide the determination process, the system reduces per-pixel calculation requirements while maintaining the benefits of OOB processing for coding efficiency.
Data Source
AI summary
Video coding and decoding apparatuses that can enhance coding efficiency are provided. A video decoding apparatus includes an OOB determination unit configured to determine whether a reference block is targeted for OOB processing by comparing coordinates of the reference block with coordinates of a picture, and an OOB mask derivation unit configured to derive mask data representing availability of each pixel by comparing coordinates of a pixel included in the reference block with coordinates of the picture. The OOB determination unit determines whether the reference block is the target of the OOB processing by detecting whether wrap-around processing is applied to a reference picture including the reference block. The OOB determination unit determines whether the reference block is targeted for the OOB processing by detecting whether reference picture resampling processing is applied to the reference picture including the reference block.