Dynamic Subject Clipping in Moving Images via Linear Interpolation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing technologies face challenges in accurately tracking and clipping a subject within a moving image, particularly in handling changes in position and size over time, which can result in unnatural composition and inefficient clipping.

Innovation Solution

An image processing apparatus and method that includes a detecting unit to identify subjects in a moving image, a clipping unit to clip regions corresponding to the detected subjects, and a setting unit that adjusts the clipping region based on the position and size of previously clipped regions using linear interpolation, ensuring smooth tracking and natural composition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a subject is tracked and clipped from a moving image using conventional methods, then the subject can be identified and extracted, but the clipping region may become unnatural or inaccurate when the subject undergoes drastic changes in position or size

Engineering Contradiction:
Improveclipping region accuracyVSAvoidhandling drastic changes
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent applies dynamics by making the clipping region adaptive and changeable over time. The system dynamically adjusts the clipping region based on detected subject position and size in each frame, allowing it to respond to drastic changes in subject appearance, position, or scale while maintaining accurate tracking throughout the motion sequence

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements feedback by using the detected subject information from each frame to continuously refine and adjust the clipping region. The system feeds back the subject's position and size measurements to modify the clipping parameters, ensuring the region remains accurately aligned with the subject even during drastic changes

Inventive Principle:
Principle #23Feedback

2Adaptability or versatility

If the clipping region is adjusted to accommodate drastic changes in subject position or size, then adaptability improves, but the composition may become unnatural or the tracking less accurate

Engineering Contradiction:
Improvehandling drastic changesVSAvoidclipping region accuracy
Core Design Contradiction:
Adaptability or versatilityVSMeasurement precision

Solution Approach 1:

The system dynamically balances adaptability and precision by adjusting the clipping region parameters based on the magnitude and nature of subject changes. It responds to drastic changes while maintaining composition quality through frame-by-frame optimization of the clipping parameters

Inventive Principle:
Principle #15Dynamics

3Device complexity

If conventional clipping methods are used without considering temporal changes, then the processing is simpler, but the tracking becomes unnatural and inefficient

Engineering Contradiction:
Improveprocessing simplicityVSAvoidtracking efficiency
Core Design Contradiction:
Device complexityVSProductivity

Solution Approach 1:

The patent applies continuity of useful action by performing subject detection and clipping region adjustment in every frame of the moving image sequence. This continuous processing ensures smooth and natural tracking throughout the video, maintaining consistent subject following without interruption or discontinuity

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentUS10095919B2Image processing apparatus, image processing method and storage medium to suitably clip a subject region from a moving image
Publication Date: 2018.10.09 CASIO COMPUTER CO LTD
  • US10095919B2 patent drawing
  • US10095919B2 patent drawing
  • US10095919B2 patent drawing

AI summary

An image processing apparatus, an image processing method, and a storage medium are shown. According to one implementation, the image processing apparatus includes the following. A detecting unit detects a subject in a moving image. A clipping unit clips a region corresponding to the subject detected by the detecting unit from each frame image composing the moving image. A setting unit sets a planned clipping region to be newly clipped by the clipping unit based on at least one of a position and a size of a region corresponding to the subject already clipped by the clipping unit.