Image Processing Apparatus Screen Edge Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in generating smooth and precise interpolation frames at screen edges, particularly when objects move in or out of the screen, leading to interpolation errors and a feeling of strangeness due to the lack of usable original pixels.

Innovation Solution

The image processing apparatus and method control motion vectors to point towards screen-edge pixels or pixels inside the screen edge, ensuring that these pixels are used as interpolation sources when they point outside the screen edge, thereby reducing interpolation errors and maintaining smooth transitions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If outside-screen pixels are used as interpolation source at screen edge, then interpolation can be performed, but interpolation error occurs and feeling of strangeness is generated

Engineering Contradiction:
Improveinterpolation frame generationVSAvoidinterpolation precision
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent converts the harmful effect of motion vectors pointing outside the screen into a beneficial solution by detecting when this occurs and switching to use screen-edge pixels as interpolation sources. This transforms the problem of missing pixel data into a controlled selection process that maintains image quality at screen edges.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Solution Approach 2:

The patent changes the parameter of interpolation source selection based on the position and motion vector direction. When motion vectors point outside the screen, the system switches from using outside-screen pixels to using screen-edge pixels, dynamically adjusting the interpolation source parameter to maintain precision.

Inventive Principle:
Principle #35Parameter changes

2Reliability

If only one frame is used as interpolation source at screen edge to avoid outside-screen pixels, then interpolation error is reduced, but sharp change occurs at boundary and feeling of strangeness is enhanced

Engineering Contradiction:
Improveinterpolation precisionVSAvoidimage smoothness
Core Design Contradiction:
ReliabilityVSStability of the object's composition

Solution Approach 1:

The patent applies different interpolation strategies to different regions: inside-screen pixels are used in the central region while screen-edge pixels are used at the screen edge when motion vectors point outside. This local differentiation maintains both precision and smoothness by adapting the interpolation source to the specific spatial context.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent dynamically selects the interpolation source based on motion vector direction and screen position. The system transitions from using inside-screen pixels to screen-edge pixels when motion vectors indicate objects moving out of the screen, creating a dynamic adaptation that maintains image smoothness while preserving precision.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If motion vector detection is performed accurately, then interpolation precision is improved, but detection precision requirement increases complexity

Engineering Contradiction:
Improvemotion vector detection precisionVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent performs motion vector detection with sufficient precision to determine whether vectors point outside the screen, but does not require excessively high precision for all aspects of motion detection. The system applies partial action by focusing detection precision only where needed (at screen edges) while using simpler methods in other regions.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentEP2530934B1Image processing apparatus and interpolation frame generating method
Publication Date: 2020.02.05 JVC KENWOOD CORP
  • EP2530934B1 patent drawingFigure 1
  • EP2530934B1 patent drawingFigure 2~3
  • EP2530934B1 patent drawingFigure 4~5

AI summary

An image processing apparatus includes a frame memory (102), a motion vector detector (103), a screen edge detector (104) and an interpolation frame generator (106). The frame memory (102) frame-delays an input signal and outputs the input signal as a delayed input signal. The motion vector detector (103) detects a motion vector between frames based on the input signal and the delayed input signal. The screen edge detector (104) detects a pixel corresponding to a screen edge in the input signal. The interpolation frame generator (106) generates an interpolation frame from the input signal and delayed input signal based on the motion vector and the pixel corresponding to the screen edge. The interpolation frame generator (106) generates the interpolation frame using the pixel corresponding to the screen edge or the pixel inside relative to the pixel corresponding to the screen edge when the motion vector points a pixel outside relative to the pixel corresponding to the screen edge.