Depth-Based Texture Prediction for Scalable Video Coding
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video coding systems face challenges in efficiently handling reference picture handling, particularly in scalable and multiview video coding, where accurate prediction and decoding of texture and depth views are crucial for maintaining video quality and bitrate efficiency.
Innovation Solution
The implementation of advanced prediction techniques, such as depth-based motion vector prediction and inter-component prediction, within the encoder and decoder architectures, enables improved handling of reference pictures, especially in HEVC and H.264/AVC standards, allowing for more efficient coding and decoding of texture and depth views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional video coding systems are used for scalable and multiview video coding, then the basic video compression function is achieved, but the prediction accuracy and bitrate efficiency are insufficient
Solution Approach 1:
The patent segments the prediction process into multiple independent components: depth map prediction, motion vector prediction, and texture prediction. Each component is processed separately using dedicated algorithms, allowing optimized prediction for each aspect without compromising overall accuracy or efficiency
Solution Approach 2:
The patent introduces depth maps as an intermediary element that mediates between the base layer and enhancement layers. The depth information serves as a bridge to generate motion vectors and predict texture, improving prediction accuracy while maintaining bitrate efficiency through the use of this intermediate depth representation
2Productivity
If advanced prediction techniques are implemented, then video coding efficiency and prediction accuracy are improved, but the computational complexity and processing requirements increase
Solution Approach 1:
The patent performs preliminary depth map prediction and motion vector derivation before the actual texture coding process. By pre-computing these prediction elements, the main encoding process benefits from accurate predictions without bearing the full computational burden, thus improving coding efficiency while managing complexity
Solution Approach 2:
The depth maps and motion vectors derived from the base layer are used to self-generate predictions for enhancement layers without requiring additional complex processing. The system serves itself by reusing previously decoded information, reducing computational complexity while maintaining high coding efficiency
Data Source
Figure 1~2
Figure 3
Figure 4a
AI summary
There are disclosed various methods, apparatuses and computer program products for video encoding. In some embodiments the method for encoding comprises examining availability of a depth block co-located with a texture block, determining a prediction method for a texture block on the basis of availability of a co-located depth block; and deriving a first prediction block for the texture block on the basis of the availability of the co-located depth block. The method further comprises deriving a first prediction block for the texture block on the basis of the co-located depth block, if the co-located depth block is available,and otherwise deriving a second prediction block for the texture block without using the co-located depth block. There are also disclosed corresponding method for various methods, apparatuses and computer program products for video decoding.