Sub-Picture Reference Coding for 3D Video Prediction Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing video coding technologies face challenges in efficiently handling 3D video content, particularly in multiview applications, where optimal projection surfaces and motion over boundaries are not adequately managed, leading to suboptimal compression and rendering issues.
Innovation Solution
An enhanced encoding and decoding method that involves obtaining and manipulating sub-pictures as reference frames for subsequent sub-pictures, allowing independent decoding and encoding processes to improve compression efficiency and reduce prediction leaks.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If projection surfaces are optimized for a single time instance, then rendering quality is improved, but inter prediction efficiency deteriorates
Solution Approach 1:
The projection surface is divided into multiple tiles, allowing independent optimization of each tile while maintaining overall efficiency. Each tile can be processed separately for rendering quality while enabling parallel inter prediction operations across different tiles.
Solution Approach 2:
Different regions of the projection surface (tiles) can have different optimization levels. Tiles with high visual importance can receive more intensive optimization for rendering quality, while less critical tiles can use simpler processing to maintain overall inter prediction efficiency.
2Productivity
If projection surfaces are kept constant for a time period, then inter prediction efficiency is improved, but rendering quality deteriorates
Solution Approach 1:
The projection surface configuration is made dynamic, allowing it to change over time based on content characteristics. Tiles can be reconfigured or re-optimized for different time periods, enabling the system to adapt between maintaining constant surfaces for efficiency and optimizing surfaces for quality when needed.
3Measurement precision
If motion over projection surface boundary is allowed, then motion representation accuracy is improved, but prediction leaks occur
Solution Approach 1:
Boundary tiles act as intermediaries between different projection surface regions. These tiles are specially processed to handle motion vectors that cross boundaries, allowing accurate motion representation while preventing prediction leaks through controlled information flow across tile boundaries.
Solution Approach 2:
Boundary tiles receive special local processing different from interior tiles. The processing at boundaries is optimized to handle motion accurately while maintaining isolation properties that prevent prediction leaks, creating different quality characteristics for different regions of the projection surface.
Data Source
AI summary
There is disclosed a method, an apparatus and a computer program product for video encoding and decoding. In accordance with an embodiment the method comprises obtaining coded data of a sub-picture, the sub-picture belonging to a picture, and the sub-picture belonging to a sub-picture sequence and determining whether to use the sub-picture as a source for a manipulated reference sub-picture. If the determining reveals that the sub-picture is to be used as the source for the manipulated reference sub-picture, the manipulated reference sub-picture is generated from the sub-picture to be used as a reference for a subsequent sub-picture of the sub-picture sequence.