Color Difference Block Motion Vector Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The existing image processing technologies face challenges in improving encoding efficiency for color difference signals and reducing memory access address calculations, particularly due to the mismatch between motion compensation block sizes and orthogonal transform block sizes in the H.264/AVC format, leading to inefficiencies in encoding and decoding processes.

Innovation Solution

An image processing device and method that classify color difference blocks based on orthogonal transform block sizes and generate motion vectors for color difference blocks by correlating them with multiple luminance blocks, allowing for efficient motion prediction and encoding, even when the color difference block size is smaller than the orthogonal transform block size.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If motion compensation block size is smaller than orthogonal transform block size, then encoding precision for color difference signals is improved, but device complexity and memory access calculations increase

Engineering Contradiction:
Improveencoding precisionVSAvoiddevice complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent merges multiple luminance blocks (e.g., four 4×4 luminance blocks) into a single color difference block (e.g., one 4×4 color difference block). This merging allows the color difference block to match the orthogonal transform block size, eliminating the need for complex sub-block processing and reducing device complexity while maintaining encoding precision.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent makes the color difference block size adaptable to match the orthogonal transform block size, allowing the same block structure to serve both motion compensation and transform functions. This multi-functionality eliminates the need for separate processing paths for different block sizes, reducing device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Manufacturing precision

If motion compensation block size is smaller than orthogonal transform block size, then encoding precision for color difference signals is improved, but memory access address calculations increase

Engineering Contradiction:
Improveencoding precisionVSAvoidmemory access efficiency
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

By merging multiple luminance blocks into a single color difference block that matches the orthogonal transform block size, the patent eliminates the need for multiple memory access operations. This reduces the number of address calculations required and improves memory access efficiency.

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If color difference block is divided into multiple sub-blocks, then motion prediction accuracy is improved, but encoding complexity increases

Engineering Contradiction:
Improvemotion prediction accuracyVSAvoidencoding complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Instead of dividing the color difference block into multiple sub-blocks to improve motion prediction accuracy, the patent inverts the approach by merging multiple luminance blocks into a single color difference block. This eliminates the need for sub-block division while maintaining accuracy through the larger block size.

Inventive Principle:
Principle #13The other way round (Inversion)

Data Source

PatentUS10911772B2Image processing device and method
Publication Date: 2021.02.02 SONY GROUP CORP
  • US10911772B2 patent drawing
  • US10911772B2 patent drawing
  • US10911772B2 patent drawing

AI summary

The present invention relates to an image processing device and method, which realize improvement in encoding efficiency for color difference signals and reduction in address calculations for memory access. In a case where a block size of orthogonal transform is 4×4, and a macroblock of luminance signals is configured of four 4×4 pixel blocks appended with 0 through 1, the four luminance signal blocks are corresponded with one color difference signal 4×4 block appended with C. At this time, there exist four motion vector information of mv0, mv1, mv2, and mv3, as to the four luminance signal blocks. The motion vector information mvc of the one color difference signal 4×4 block is calculated by averaging processing using these four motion vector information. The present invention can be applied to an image encoding device which performed encoding based on the H.264/AVC format, for example.