Motion Compensation Shared Storage Unit Bandwidth Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies for motion interpolation require high frame memory bandwidth, leading to increased discontinuity and blur in images, and higher storage space requirements.

Innovation Solution

An image processing apparatus with a motion estimation and motion compensation system that includes a shared storage unit, motion vector estimation unit, halo detection unit, and motion compensation unit, which performs motion vector estimation and compensation using a slice of an image frame as a unit, reducing the need for large storage capacity and system bus bandwidth by capturing and processing down-sampled data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If motion interpolation technology is used to increase frame rate and reduce discontinuity, then image smoothness and clarity are improved, but memory bandwidth requirement increases

Engineering Contradiction:
Improveimage smoothnessVSAvoidmemory bandwidth
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent divides the image frame into multiple slices and processes them independently through parallel processing units. This segmentation allows the system to process smaller data units simultaneously, reducing the peak memory bandwidth requirement while maintaining the overall frame rate and smoothness through parallel execution of motion compensation operations on different slice segments.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a temporal dimension by using multiple reference frames (current frame and previous frame) and performing motion compensation across time. By utilizing historical frame data stored in memory and applying motion vectors to predict intermediate frames, the system achieves smooth interpolation without requiring proportionally higher bandwidth, as temporal redundancy is exploited to reduce data access requirements.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Manufacturing precision

If high frame memory bandwidth is used for motion interpolation, then interpolated frame quality is improved, but storage space requirement increases

Engineering Contradiction:
Improveinterpolated frame qualityVSAvoidstorage space
Core Design Contradiction:
Manufacturing precisionVSVolume of stationary object

Solution Approach 1:

The patent dynamically adjusts the motion search range and compensation parameters based on the complexity of the current scene and motion characteristics. By adapting parameters such as search window size and reference frame selection based on detected motion intensity and direction, the system maintains high interpolated frame quality while reducing the amount of data that needs to be stored and accessed, thereby reducing storage space requirements.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent applies motion compensation selectively to regions of the image that exhibit significant motion, rather than processing the entire frame uniformly. By identifying and prioritizing motion-prone areas (such as moving objects or regions with high motion vectors) and applying full compensation only where necessary, the system achieves high interpolated quality in critical areas while reducing overall storage and processing requirements for static or low-motion regions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10015513B2Image processing apparatus and image processing method thereof
Publication Date: 2018.07.03 HIMAX TECH LTD
  • US10015513B2 patent drawing
  • US10015513B2 patent drawing
  • US10015513B2 patent drawing

AI summary

An image processing apparatus and an image processing method thereof are provided. A shared storage unit of a motion estimation and motion compensation apparatus captures frame data of a storage unit through a bus. A motion vector estimation unit and a motion compensation unit capture image data for executing a motion vector estimation operation and a motion compensation operation from the sharing storage unit.