Multi-View Residual Coding via Block-Granular Disparity Prediction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing multi-view video coding technologies inefficiently exploit interdependencies between views, leading to high bit rates due to the coding of multiple views, and lack effective integration of motion-compensated prediction with inter-view prediction techniques.
Innovation Solution
Implement block-granular disparity-compensated prediction to predict the residual signal of a dependent view from a reference view's residual signal, using block-specific disparity vectors to enhance coding efficiency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If multiple views are coded to provide high-quality stereo viewing impression, then viewing quality is improved, but bit rate increases drastically
Solution Approach 1:
The patent uses depth map copying and view synthesis techniques where intermediate views are generated by copying and warping reference views based on depth information, reducing the need to transmit multiple full-resolution views
Solution Approach 2:
The patent introduces depth maps as intermediary data structures that enable efficient view synthesis, allowing the system to generate intermediate views without transmitting all view data explicitly
2Productivity
If motion-compensated prediction is used for inter-view prediction, then coding efficiency is improved, but effectiveness is limited without integration with inter-view techniques
Solution Approach 1:
The patent merges motion-compensated prediction with inter-view disparity compensation by combining temporal motion vectors with spatial disparity vectors to create enhanced prediction modes that exploit both temporal and inter-view redundancies
Data Source
AI summary
A gain in multi-view coding is achieved as follows: the residual signal involved with coding a dependent view of the multi-view signal is predicted from a reference residual signal of the current picture of the reference view using block-granular disparity-compensated prediction, i.e. using disparity compensated prediction with a disparity defined at, and varying with, block granularity so that each block of the current picture of the dependent view has its own disparity displacement such as its own disparity vector, associated therewith. In other words, a remaining similarity between the residual signal involved with predictively coding the reference view is used in order to predict the residual signal involved with predictively coding the dependent view.