Virtual Depth Information for 3D Video Coding Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D video coding techniques face inefficiencies in storage and transmission due to the large amount of data required for multi-view video, as they do not effectively exploit the correlation between texture and depth data, and the coding order of these data types is not optimized for compression.
Innovation Solution
A method is developed to derive virtual depth information for 3D video encoding and decoding, using estimated disparity vectors to locate corresponding texture blocks and collocated depth blocks, allowing for flexible coding order and improved prediction accuracy, which can be used in view synthesis prediction, motion vector prediction, and inter-view motion compensation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If conventional video coding techniques are applied to each single-view video sequence independently, then the coding process is simple, but the coding efficiency is very low and storage/transmission requirements are high
Solution Approach 1:
The patent merges the coding of multiple views by exploiting inter-view redundancy. It combines reference picture lists from different views and uses inter-view motion compensation to predict current view blocks from reference views, thereby improving coding efficiency while maintaining reasonable complexity through unified reference picture management across views.
2Adaptability or versatility
If more cameras are used to generate multi-view video with a large number of video sequences, then more views are provided, but the required storage space and transmission bandwidth increase significantly
Solution Approach 1:
The patent uses inter-view motion compensation to copy and reuse reference blocks from previously decoded views. Instead of storing and transmitting redundant data for each view, the system references and reuses motion-compensated blocks from other views, significantly reducing storage space and transmission bandwidth requirements while maintaining multiple view capabilities.
3Ease of manufacture
If the coding order of texture data and depth data is fixed, then the coding process is straightforward, but the coding efficiency cannot be optimized for different scenarios
Solution Approach 1:
The patent implements dynamic reference picture list management where reference picture lists are constructed and updated based on the actual coding scenario and inter-view dependencies. The system dynamically selects and organizes reference pictures from different views according to motion characteristics and view relationships, allowing flexible adaptation to different coding scenarios rather than following a fixed coding order.
Data Source
AI summary
A method and apparatus for three-dimensional video coding using the virtual depth information are disclosed. For a current texture block in the dependent view, the method incorporating the present invention first derives an estimated disparity vector to locate a corresponding texture block in a coded view. A collocated depth block in the coded view collocated with the corresponding texture block in the coded view is identified and used to derive the virtual depth information. One aspect of the present invention addresses derivation process for the estimated disparity vector. Another aspect of the present invention addresses the usage of the derived virtual depth information.