Image Processing Apparatus Predictive Shake Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing systems struggle to compensate for delays in optical system adjustments based on signals from image sensors, particularly in systems where camera shake detection methods cannot account for signal delays, leading to incomplete stabilization and reduced image quality.

Innovation Solution

An image processing apparatus that detects information from image sensor signals, stores and processes these signals to calculate prediction values, and generates control signals to adjust optical system components, effectively reducing the influence of delays and improving stabilization.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If image stabilization is performed based on signals from image sensors, then image stabilization is achieved, but delay in adjustment occurs due to signal processing time

Engineering Contradiction:
Improveimage stabilizationVSAvoidadjustment delay
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent performs image stabilization adjustment in advance based on predicted shake amounts before the actual exposure occurs. By calculating prediction values from previously obtained image signals and performing the adjustment beforehand, the system eliminates the delay that would otherwise occur during the exposure period, ensuring stable images without timing loss.

Inventive Principle:
Principle #10Preliminary action

2Difficulty of detecting and measuring

If camera shake is detected using sensors, then shake detection is achieved, but the detection methods cannot be applied to systems where only image sensor signals are available

Engineering Contradiction:
Improveshake detectionVSAvoidsystem compatibility
Core Design Contradiction:
Difficulty of detecting and measuringVSAdaptability or versatility

Solution Approach 1:

The patent replaces mechanical shake detection sensors with a software-based approach that calculates shake amounts by comparing image signals from the image sensor. By using image processing and prediction algorithms instead of mechanical sensors, the system achieves shake detection functionality that is compatible with systems that only have image sensors, expanding system versatility.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Speed

If adjustment is performed based on current observation signals, then real-time control is achieved, but delay that has already occurred cannot be compensated

Engineering Contradiction:
Improvecontrol responseVSAvoidsignal delay
Core Design Contradiction:
SpeedVSLoss of time

Solution Approach 1:

The patent performs the adjustment action in advance based on prediction values calculated from previously obtained image signals. By executing the stabilization adjustment before the exposure period begins, the system compensates for the inherent signal delay, ensuring that the adjustment is timely and effective without suffering from the lag that would occur with real-time control.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10298844B2Image processing apparatus, method for controlling the same, and image capturing apparatus
Publication Date: 2019.05.21 CANON KK
  • US10298844B2 patent drawing
  • US10298844B2 patent drawing
  • US10298844B2 patent drawing

AI summary

An image processing apparatus detects predetermined information from an image signal and output a detection signal indicating the detected information, stores the detection signals for a plurality of periods, calculates a first prediction value based on a predetermined number of detection signals, from a newer one to older ones excluding a latest detection signal, stored in the storage unit, calculates a coefficient based on a difference between the first prediction value and a value of the latest detection signal, calculates a second prediction value based on the coefficient and the predetermined number of detection signals, from the latest one to older ones, and generates, based on the second prediction value, a control signal for controlling a predetermined constituent member.