View Synthesis Prediction Flag in 3D Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional 3D video coding techniques, such as those in the 3DV extension of HEVC and MVC extension of ITU-T H.264/AVC, often unnecessarily generate view synthesis pictures, leading to wasted processing cycles and battery consumption, as there is no indication whether view synthesis prediction is needed, and even when enabled, not all view components use it.
Innovation Solution
The proposed solution involves coding a flag in parameter sets like the sequence parameter set (SPS) or slice header to indicate whether view synthesis prediction is enabled, allowing devices to skip unnecessary computations by only generating view synthesis pictures when necessary, and using depth information to render additional views through depth image-based rendering (DIBR).
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If view synthesis prediction is always enabled in 3D video coding, then coding efficiency is improved, but processing resources and battery power are wasted when it is not needed
Solution Approach 1:
The patent applies dynamics by making the view synthesis prediction functionality configurable and adaptive. A flag in the parameter set enables or disables view synthesis prediction based on whether the decoding device supports it, allowing the system to dynamically adjust its operation mode rather than always being enabled or disabled. This resolves the contradiction by enabling VSP only when needed for coding efficiency while avoiding unnecessary power consumption when not supported.
Solution Approach 2:
The patent changes the parameter state of view synthesis prediction from a fixed always-enabled state to a configurable state indicated by a flag in the parameter set. This parameter change allows the system to switch between enabled and disabled modes based on device capabilities, thereby improving coding efficiency when VSP is supported while conserving battery power when it is not needed.
2Manufacturing precision
If view synthesis pictures are generated for all view components, then coding accuracy is improved, but processing cycles are wasted when not all components need it
Solution Approach 1:
The patent applies partial action by generating view synthesis pictures only for specific view components that require it, rather than for all components. The flag in the parameter set indicates which view components should have view synthesis prediction applied, allowing the system to perform partial processing only where needed. This improves coding accuracy for components that benefit from VSP while avoiding unnecessary processing cycles for components that do not.
Data Source
AI summary
In one example, a video coder is configured to code information indicative of whether view synthesis prediction is enabled for video data. When the information indicates that view synthesis prediction is enabled for the video data, the video coder may generate a view synthesis picture using the video data and code at least a portion of a current picture relative to the view synthesis picture. The at least portion of the current picture may comprise, for example, a block (e.g., a PU, a CU, a macroblock, or a partition of a macroblock), a slice, a tile, a wavefront, or the entirety of the current picture. On the other hand, when the information indicates that view synthesis prediction is not enabled for the video data, the video coder may code the current picture using at least one of intra-prediction, temporal inter-prediction, and inter-view prediction without reference to any view synthesis pictures.