Multiview Video Merge Candidate List Illumination Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current video compression techniques face challenges in efficiently encoding and decoding high-resolution, high-quality multiview video signals, particularly in deriving disparity vectors and configuring merge candidate lists for inter-view prediction, especially when considering illumination compensation.

Innovation Solution

A method and apparatus for generating a merge candidate list that includes spatial, temporal, and inter-view motion candidates, where the inter-view motion candidate is prioritized based on illumination compensation, and disparity vectors are derived from depth data to enhance encoding and decoding performance.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If inter-view prediction is performed using disparity vectors derived from depth data, then prediction accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent derives disparity vectors from depth data in advance and stores them in the merge candidate list for later use during prediction. This preliminary preparation of disparity vectors eliminates the need for real-time complex calculations during the prediction process, thereby improving prediction accuracy while managing computational complexity through pre-computation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent uses depth data to generate disparity vectors that are then copied into the merge candidate list. Instead of performing complex inter-view prediction calculations for each candidate, the system creates copies of disparity information from depth maps, significantly reducing computational complexity while maintaining prediction accuracy.

Inventive Principle:
Principle #26Copying

2Productivity

If multiple merge candidates including inter-view motion candidates are configured in the merge candidate list, then encoding efficiency is improved, but list configuration complexity increases

Engineering Contradiction:
Improveencoding efficiencyVSAvoidlist configuration complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the merge candidate list into different types of candidates: spatial neighbors, temporal neighbors, and inter-view motion candidates. Each segment serves a specific prediction purpose, allowing the encoder to efficiently select appropriate candidates without overwhelming complexity in managing a unified, heterogeneous list.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The merge candidate list is designed to universally accommodate multiple types of prediction candidates (spatial, temporal, and inter-view) within a single structured framework. This multi-functional list configuration improves encoding efficiency by providing diverse prediction options while maintaining a standardized management approach that prevents excessive complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If illumination compensation is applied to inter-view prediction, then prediction accuracy under varying illumination is improved, but processing time increases

Engineering Contradiction:
Improveprediction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies illumination compensation selectively and locally to inter-view prediction blocks where illumination differences are detected. Instead of uniformly applying compensation to all blocks, the system identifies specific regions requiring illumination adjustment, thereby improving prediction accuracy in affected areas while minimizing the overall processing time increase.

Inventive Principle:
Principle #3Local quality

4Manufacturing precision

If high-resolution multiview video signals are encoded using traditional compression techniques, then video quality is maintained, but transmission and storage costs increase

Engineering Contradiction:
Improvevideo qualityVSAvoidtransmission and storage cost
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The patent merges multiple prediction strategies (spatial prediction, temporal prediction, and inter-view prediction using disparity vectors) into a unified encoding framework. By combining these approaches and selecting the most effective candidate from a structured merge candidate list, the system achieves high compression efficiency for high-resolution multiview video, reducing transmission and storage costs while maintaining video quality.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS10257531B2Method and apparatus for processing multiview video signals based on illumination compensation and inter-view motion candidate
Publication Date: 2019.04.09 KT CORP
  • US10257531B2 patent drawing
  • US10257531B2 patent drawing
  • US10257531B2 patent drawing

AI summary

A method for processing multiview video signals, according to the present invention, comprises: generating a merge candidate list with respect to a current block; inducing a motion vector of the current block on the basis of a merge index of the current block, which has been obtained from a bitstream; obtaining a prediction value of the current block using the motion vector; and reconstructing the current block by adding the prediction value and a residual value of the current block.