Sub-PU Syntax Signaling for 3D Video Coding

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D-HEVC video coding systems face inefficiencies in sub-PU syntax signaling, illumination compensation complexity, and illegal partition mode issues, particularly in inter-view motion prediction, motion parameter inheritance, and texture-dependent depth partitioning.

Innovation Solution

The proposed solution involves optimized sub-PU syntax element signaling for texture and depth data, simplified illumination compensation using non-linear least squares methods, and restricted partition mode coding to prevent illegal modes, allowing for efficient encoding and decoding processes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If separate syntax elements are transmitted for texture and depth sub-PU sizes, then coding precision is improved, but device complexity increases

Engineering Contradiction:
Improvecoding precisionVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent applies different syntax element signaling strategies to different data types (texture vs. depth). For texture data, a first syntax element is transmitted to indicate sub-PU size, while for depth data, a second syntax element is transmitted. This local differentiation optimizes coding precision for each data type without applying uniform complexity across the entire system.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent segments the syntax signaling process into separate pathways for texture and depth data. By dividing the sub-PU size indication into distinct syntax elements for different data types, the system achieves precise control over each segment while managing overall complexity through structured organization.

Inventive Principle:
Principle #1Segmentation

2Productivity

If sub-PU level inter-view motion prediction and motion parameter inheritance are used, then productivity is improved, but device complexity increases

Engineering Contradiction:
Improvecoding efficiencyVSAvoiddevice complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent employs preliminary action by using inter-view motion prediction to pre-determine motion information for dependent views based on reference views. Motion parameters are inherited and prepared in advance through sub-PU level processing, reducing the need for complex real-time computations during decoding while improving coding efficiency.

Inventive Principle:
Principle #10Preliminary action

3Manufacturing precision

If illumination compensation is applied, then manufacturing precision is improved, but use of energy increases

Engineering Contradiction:
Improvecoding precisionVSAvoidcomputational energy
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent applies illumination compensation by changing parameters (multiplicative term and offset term) to adjust the reference block's illumination characteristics. These parameter modifications enable precise compensation for illumination differences between views, improving coding precision while managing computational energy through targeted parameter adjustment rather than exhaustive processing.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10218957B2Method of sub-PU syntax signaling and illumination compensation for 3D and multi-view video coding
Publication Date: 2019.02.26 HFI INNOVATION INC
  • US10218957B2 patent drawing
  • US10218957B2 patent drawing
  • US10218957B2 patent drawing

AI summary

A method of sub-PU (prediction unit) syntax element signaling for a three-dimensional or multi-view video coding system is disclosed. A first syntax element associated with a texture sub-PU size is transmitted only for texture video data and a second syntax element associated with a depth sub-PU size is transmitted only for depth video data. The first syntax element associated with the texture sub-PU size is used to derive an IVMP (inter-view motion prediction) prediction candidate used for a texture block. The second syntax element associated with the depth sub-PU size is used to a MPI (motion parameter inheritance) prediction candidate for a depth block.