Video Coding Apparatus Motion Vector Prediction Composite Reference

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing video coding technologies, such as MPEG-4 AVC, face challenges in maintaining prediction accuracy and reducing information transmission due to degradation in reference image quality, especially under high compression and non-uniform motion conditions, leading to increased computation and coding costs.

Innovation Solution

A video coding apparatus that detects motion vectors between a coding target block and a reference image, composites this with other reference images to create a prediction image, and codes the prediction difference block, thereby reducing prediction residuals and improving image quality without increasing motion vector information transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If motion compensated prediction is used with high compression coding, then compression ratio is improved, but prediction accuracy deteriorates due to degradation component mixed in the reference image

Engineering Contradiction:
Improvecompression ratioVSAvoidprediction accuracy
Core Design Contradiction:
Quantity of substanceVSMeasurement precision

Solution Approach 1:

The patent extracts the degradation component from the reference image by comparing multiple reference images and identifying pixels that differ significantly. This extracted degradation information is then used to correct the prediction image, effectively removing the harmful compression artifacts while maintaining high compression ratios.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent composites multiple reference images to create a corrected prediction image. By combining information from multiple reference images and selectively applying degradation correction based on pixel differences, the system creates a composite prediction that maintains accuracy while achieving high compression.

Inventive Principle:
Principle #40Composite materials

2Loss of information

If motion vector prediction is used assuming temporal continuity, then amount of information transmission is reduced, but prediction accuracy deteriorates when motion is not temporally continuous

Engineering Contradiction:
Improveamount of information transmissionVSAvoidmotion vector prediction accuracy
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The patent introduces a feedback mechanism where the system detects actual motion by comparing multiple reference images and uses this detected motion information to correct prediction errors. This feedback loop allows the system to adapt to non-uniform motion patterns while maintaining efficient information transmission through selective transmission of correction data.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If two reference images are used for motion compensated prediction, then prediction image quality is improved by smoothing degradation, but amount of coding increases due to additional motion vectors

Engineering Contradiction:
Improveprediction image qualityVSAvoidamount of coding
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts only the essential degradation correction information from multiple reference images rather than transmitting complete motion vectors for each. By taking out only the necessary correction data and applying it selectively, the system improves prediction quality while avoiding the coding overhead of multiple full motion vectors.

Inventive Principle:
Principle #2Taking out (Extraction)

4Measurement precision

If motion compensated prediction is used with small blocks, then prediction accuracy is improved by capturing object boundary motion, but amount of coding increases due to more motion vectors

Engineering Contradiction:
Improveprediction accuracyVSAvoidamount of coding
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the benefits of small-block prediction accuracy with the efficiency of larger block coding by applying degradation correction at the pixel level across the entire prediction image. This allows the system to capture fine motion details at object boundaries without requiring separate motion vectors for each small block, thus maintaining accuracy while reducing coding complexity.

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9237354B2Video coding apparatus, video coding method and video coding program, and video decoding apparatus, video decoding method and video decoding program
Publication Date: 2016.01.12 COMCAST CABLE COMM LLC
  • US9237354B2 patent drawing
  • US9237354B2 patent drawing
  • US9237354B2 patent drawing

AI summary

A motion vector detector detects a motion vector from a first reference image for a coding target block. A multiple reference image composition unit creates a composite reference block that a first reference block extracted from the first reference image using the motion vector has been composited with a predetermined region of at least one of other reference images. Setting the composite reference block as a prediction block, an entropy encoder encodes a prediction difference block that the prediction block has been subtracted from the coding target block.