View Synthesis Prediction Syntax Element for 3D Video Bitstream Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding technologies face inefficiencies in encoding and decoding 3D video data, particularly in signaling motion information for video units predicted from view synthesis prediction (VSP) pictures, leading to unnecessary bit usage and increased complexity.
Innovation Solution
A method where a video encoder signals a syntax element indicating whether a current video unit is predicted from a VSP picture, omitting motion information when applicable, and a video decoder reconstructs sample blocks using the VSP picture when predicted, thereby reducing bitstream size and complexity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If motion information is signaled for all video units in 3D video coding, then prediction accuracy is improved, but bitstream size increases and coding complexity increases
Solution Approach 1:
The patent extracts and removes unnecessary motion information from the bitstream by identifying video units that are predicted from VSP pictures. For these specific video units, the encoder omits signaling of motion vectors and reference picture indices, as the VSP picture index alone suffices for reconstruction. This selective extraction eliminates redundant data while preserving essential prediction information.
Solution Approach 2:
Instead of applying a uniform coding approach to all video units, the patent implements partial action by differentiating between video units predicted from VSP pictures and those requiring traditional inter-picture prediction. The encoder applies simplified signaling only where applicable (partial action), reducing overall bitstream size without compromising prediction accuracy for units that need detailed motion information.
2Measurement precision
If motion information is signaled for all video units, then decoding accuracy is improved, but decoding complexity increases
Solution Approach 1:
The decoder applies the same principle of extraction by identifying video units predicted from VSP pictures and omitting extraction of motion information from the bitstream for these units. This reduces the amount of data that needs to be processed and stored in motion compensation buffers, thereby lowering decoding complexity while maintaining reconstruction accuracy through the VSP picture index.
3Adaptability or versatility
If traditional inter-picture prediction is used for all video units, then prediction flexibility is improved, but coding efficiency deteriorates
Solution Approach 1:
The patent implements multi-functionality by creating a unified prediction framework that accommodates both traditional inter-picture prediction and VSP-based prediction through a single syntax element (vsp_pic_index). This universal approach allows the encoder to select the most efficient prediction method for each video unit based on content characteristics, achieving both flexibility and coding efficiency. The VSP picture itself serves multiple purposes as a reference for both texture and depth view prediction.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A video encoder signals, in a bitstream, a syntax element that indicates whether a current video unit is predicted from a VSP picture. The current video unit is a macroblock or a macroblock partition. The video encoder determines, based at least in part on whether the current video unit is predicted from the VSP picture, whether to signal, in the bitstream, motion information for the current video unit. A video decoder decodes the syntax element from the bitstream and determines, based at least in part on the syntax element, whether the bitstream includes the motion information.