Camera Shake Correction via Object Motion Vector Exclusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional imaging devices face challenges in precisely estimating camera shake when object motion is present, as the motion vector calculation includes both camera shake and object motion, making it difficult to accurately correct camera shake.

Innovation Solution

A motion detecting device and method that includes an image inputter, a first motion detector for detecting image picker motion based on picked-up images, a second motion detector for detecting motion based on acceleration or angular velocity, a determiner to assess the motion detection, and a controller to adjust detection based on the second motion detector's results, excluding object motion vectors to isolate camera shake vectors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If motion vector calculation is used to estimate camera shake, then camera shake correction can be performed, but when object motion is present the motion vector includes both camera shake and object motion making precise estimation difficult

Engineering Contradiction:
Improvecamera shake estimation precisionVSAvoidrobustness to object motion
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent segments the motion detection task into two independent components: image-based motion detection (first motion detector) and sensor-based motion detection (second motion detector). Each detector handles a specific aspect of motion, and their results are combined to achieve accurate camera shake estimation even when objects are moving in the scene.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a determiner as an intermediary component that evaluates the reliability of the first motion detector's results and decides whether to use them or switch to the second motion detector. This intermediary layer enables adaptive selection of the most reliable detection method based on current imaging conditions.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If multiple detection methods are used to improve accuracy, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improvemotion detection precisionVSAvoiddetection system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent designs a multi-functional motion detection system where the same device structure supports both image-based detection and sensor-based detection. The controller integrates multiple detection methods within a unified architecture, reducing the need for separate dedicated systems and thereby limiting the increase in device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent implements dynamic switching between different detection methods based on real-time evaluation of detection reliability. The system adapts its detection strategy by selecting the most appropriate method (first or second motion detector) according to current conditions, optimizing performance without requiring all components to operate simultaneously at full complexity.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves the precision of camera shake correction by distinguishing between intended object motion and unintended camera shake, ensuring accurate alignment and image stabilization.

Implementation Method 1

a second motion detector that detects a motion of the image picker during the imaging operation, based on an acceleration or an angular velocity applied to the image picker during the imaging operation

Methodology Applied
Scientific EffectAcceleration detection: Accelerometer

Data Source

PatentUS10027890B2Motion detecting device, motion detecting method, and non-transitory recording medium
Publication Date: 2018.07.17 CASIO COMPUTER CO LTD
  • US10027890B2 patent drawing
  • US10027890B2 patent drawing
  • US10027890B2 patent drawing

AI summary

A motion detector calculates a camera shake matrix H(t) applied for a coordinate conversion for a camera shake correction. At this time, the motion detector calculates a motion vector (MV) for each block obtained by dividing a frame, and excludes an object motion vector (MV-B) from the MV. In addition, when a camera shake matrix H_mv that represents a camera shake between the frames is not calculable based on the MV, the motion detector calculates and adjusts a camera shake matrix H_sensor that represents a camera shake in accordance with a motion of an image picker, and settles this matrix as the camera shake matrix H(t).