Image Blur Correction Using Gyro and Motion Vector Fusion

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing panorama photography techniques face challenges in accurately correcting background blur due to low-frequency noise in gyro sensor outputs and mechanical shutter operations, leading to potential mis-detection of blur amounts and residual background blur in composite images.

Innovation Solution

An image pickup apparatus equipped with a processor and memory for detecting shake and image movement, calculating background blur amounts, and controlling image blur correction using a combination of angular velocity sensors and motion vector detection, enabling accurate background blur correction during continuous imaging.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If background blur is detected using a gyro sensor, then blur detection is achieved, but accurate blur amount cannot be obtained due to low-frequency noise component

Engineering Contradiction:
Improveblur detection accuracyVSAvoidblur amount accuracy
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces an intermediary calculation process that combines gyro sensor output with image processing results. Instead of directly using gyro sensor data for blur correction, the system calculates a correction value by integrating multiple detection methods, thereby mediating the inaccurate gyro data through additional verification from image-based detection.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback by continuously monitoring the actual image blur state and comparing it with the gyro sensor predictions. The blur correction amount is adjusted based on the detected discrepancy between expected and actual blur, creating a closed-loop control system that compensates for gyro sensor inaccuracies.

Inventive Principle:
Principle #23Feedback

2Productivity

If a driving mechanism (movable mirror or mechanical shutter) operates, then imaging function is achieved, but shake is detected causing mis-detection of blur amount

Engineering Contradiction:
Improveimaging capabilityVSAvoidblur amount detection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by detecting the operational state of driving mechanisms in advance and preemptively adjusting the blur detection process. When a mechanical shutter or movable mirror operation is detected, the system prepares correction measures beforehand to prevent mis-detection of blur amount during these transient periods.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system cushions against potential detection errors by introducing a buffer mechanism that identifies when driving mechanisms are operating. During these periods, the system applies compensatory algorithms or temporarily suspends blur detection to avoid capturing false shake signals, thereby protecting the overall measurement accuracy.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

3Extent of automation

If incorrect background angular velocity detection values are used for image blur correction control, then correction process is executed, but background blur remnant is generated

Engineering Contradiction:
Improvecorrection control automationVSAvoidbackground blur correction quality
Core Design Contradiction:
Extent of automationVSManufacturing precision

Solution Approach 1:

The system uses feedback to continuously monitor the effectiveness of blur correction by analyzing the residual blur in corrected images. When incorrect angular velocity values produce inadequate correction results, the system adjusts the correction parameters based on actual measured blur, creating a self-correcting automated process that maintains high correction quality.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent implements self-service by enabling the system to automatically detect and correct its own detection errors. The blur correction system monitors its own performance and autonomously adjusts correction parameters when it detects that background blur remnant persists, without requiring external intervention to maintain correction quality.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves image quality by accurately detecting and correcting background blur in panorama photography, reducing the occurrence of residual blur and enhancing the compositing process of multiple images.

Implementation Method 1

a first detection unit configured to detect shake of the image pickup apparatus

Methodology Applied
Scientific EffectAngular velocity detection: Gyroscope

Implementation Method 2

a second detection unit configured to detect a moving amount of a captured image captured by an imaging unit

Methodology Applied
Scientific EffectMotion detection: Photoelectric Effect

Data Source

PatentUS10873701B2Image pickup apparatus and control method thereof
Publication Date: 2020.12.22 CANON KK
  • US10873701B2 patent drawing
  • US10873701B2 patent drawing
  • US10873701B2 patent drawing

AI summary

An image pickup apparatus capable of compositing a plurality of continuously captured images is provided that includes a first detection unit configured to detect shake of the image pickup apparatus; a second detection unit configured to detect a moving amount of a captured image captured by an imaging unit; a correction unit configured to correct image blur of an image caused by shake of the image pickup apparatus; a control unit configured to calculate a blur amount of a background in the captured image from a shake detection signal detected by the first detection unit and the moving amount detected by the second detection unit and to control image blur correction performed by the correction unit; and a combining unit configured to combine a plurality of captured images with corrected image blur.