Image Stabilization Cut-Out Position Adjustment for Object Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In video cameras with electronic image-stabilization, the center position of the display image does not correspond to the center position of the image output from the image pickup element, leading to delays in detecting the position of moving objects like humans or animals, as the detection is often performed on images that have undergone electronic image-stabilization, causing shifts in the indication of the object's position on the displayed image.

Innovation Solution

An image processing apparatus that performs cut-out processing to generate a display image, detects an area containing an object without subjecting it to electronic image-stabilization, and adjusts the detected position information based on the cut-out position to correctly superimpose the object's indication on the display image, reducing detection time and aligning it with the stabilized image.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If detection is performed on the stabilized image, then the indication position corresponds to the displayed image, but the detection time increases causing lag for moving objects

Engineering Contradiction:
Improveposition detection accuracyVSAvoiddetection time lag
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs object detection on the original image before electronic image stabilization is applied. This preliminary detection allows the system to identify object positions in the unstabilized image, then use the relationship between original and stabilized images to calculate corresponding positions in the stabilized image, avoiding the time lag that would occur if detection were performed after stabilization.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces an intermediary calculation process that uses the cut-out position information (which represents the relationship between original and stabilized images) as a mediator to transfer object positions from the original image coordinate system to the stabilized image coordinate system, enabling accurate position correspondence without detecting on the stabilized image itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If detection is performed on the original image without electronic image-stabilization, then the detection time is reduced, but the detected position does not correspond to the position in the displayed stabilized image

Engineering Contradiction:
Improvedetection speedVSAvoidposition correspondence accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent uses the cut-out position information as an intermediary to bridge the coordinate systems between the original image and the stabilized image. By adding the cut-out position values to the detected object coordinates, the system accurately maps positions from the original image to the stabilized image, ensuring correspondence accuracy while maintaining fast detection speeds.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the mechanical approach of performing detection on the stabilized image with a computational approach: detecting on the original image and then applying coordinate transformation through arithmetic operations (adding cut-out position values). This substitution maintains detection speed while achieving position correspondence through mathematical transformation rather than physical re-detection.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS8723967B2Image processing apparatus, image pickup apparatus, and image processing method for performing cut-out processing for an image for electronic image-stabilization
Publication Date: 2014.05.13 CANON KK
  • US8723967B2 patent drawing
  • US8723967B2 patent drawing
  • US8723967B2 patent drawing

AI summary

An image pickup apparatus having a function of performing cut-out processing for an image for electronic image-stabilization and detecting a particular object of the image is provided. The image pickup apparatus detects a particular object from an image that has not been subjected to cut-out processing for electronic image-stabilization, adjusts position information of the detected object in accordance with a cut-out position of the image for electronic image-stabilization, and combining an indication indicating the position of the particular object with a display image based on positional information after the adjustment is performed.