Sub-PU Inter-View Motion Prediction for 3D Video Coding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing three-dimensional video coding systems inefficiently utilize motion information from reference views, only utilizing the middle position's motion information for prediction units in dependent views, leading to suboptimal coding efficiency.

Innovation Solution

Implementing sub-PU level inter-view motion prediction by dividing prediction units into smaller sub-PUs, using disparity vectors to locate reference sub-blocks in the reference view, and sharing or scaling motion parameters between sub-PUs to enhance prediction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If only the middle position's motion information is used for prediction units in dependent views, then the coding method is simple, but the coding efficiency is suboptimal

Engineering Contradiction:
Improvecoding efficiencyVSAvoidprediction method complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The prediction unit (PU) is divided into multiple sub-PUs, and motion information is derived for each sub-PU separately rather than using a single middle position value for the entire PU. This segmentation allows more comprehensive utilization of motion information from the reference view, improving coding efficiency while managing complexity through systematic processing of smaller units

Inventive Principle:
Principle #1Segmentation

2Productivity

If sub-PU level inter-view motion prediction is implemented by dividing prediction units into smaller sub-PUs, then motion information usage is refined and coding efficiency improves, but decoding time increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoiddecoding time
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

Dividing the PU into sub-PUs enables more precise motion estimation by utilizing motion information from multiple locations in the reference view, improving coding efficiency through better prediction accuracy

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different sub-PUs can utilize motion information from their respective local regions in the reference view, allowing each sub-PU to have optimized prediction parameters suited to its specific content characteristics, thereby improving overall prediction accuracy

Inventive Principle:
Principle #3Local quality

3Loss of substance

If sub-PU level inter-view motion prediction is implemented, then bitrate is reduced significantly, but decoding time increases

Engineering Contradiction:
ImprovebitrateVSAvoiddecoding time
Core Design Contradiction:
Loss of substanceVSLoss of time

Solution Approach 1:

By segmenting the PU into sub-PUs and deriving motion information for each, the patent achieves more accurate prediction that reduces the residual information needing to be encoded, thereby reducing bitrate while the increased processing is managed through efficient algorithms

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10587859B2Method of sub-predication unit inter-view motion prediction in 3D video coding
Publication Date: 2020.03.10 HFI INNOVATION INC
  • US10587859B2 patent drawing
  • US10587859B2 patent drawing

AI summary

A method for a three-dimensional encoding or decoding system incorporating sub-block based inter-view motion prediction is disclosed. The system utilizes motion or disparity parameters associated with reference sub-blocks in a reference picture of a reference view corresponding to the texture sub-PCU split from a current texture PU (prediction unit) to predict the motion or disparity parameters of the current texture PU. Candidate motion or disparity parameters for the current texture PU may comprise candidate motion or disparity parameters derived for all texture sub-PUs from splitting the current texture PU. The candidate motion or disparity parameters for the current texture PU can be used as a sub-block-based inter-view Merge candidate for the current texture PU in Merge mode. The sub-block-based inter-view Merge candidate can be inserted into a first position of a candidate list.