Image Processing Apparatus Blur Reduction via Frame Combining

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

High readout frame rates in image sensors can cause moving objects to appear blurred, leading to inconsistent information acquisition, especially when small moving objects like raindrops or water droplets are captured, resulting in changes in information acquisition due to motionlessness at high shutter speeds.

Innovation Solution

An image processing apparatus and method that combines multiple frame images to generate a combined image, with a selecting unit controlling the output between the current frame image and the combined image based on an evaluation value, where the combined image is used if the evaluation value is below a threshold to reduce the influence of blur from moving objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the readout frame rate is increased to improve processing speed, then AF processing and subject tracking performance are improved, but moving objects appear blurred and information acquisition becomes inconsistent

Engineering Contradiction:
Improveprocessing speedVSAvoidinformation acquisition consistency
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent combines multiple frame images (current frame and reference frame) to generate a combined image for evaluation value calculation. This merging approach compensates for the blurring effect caused by high frame rate shooting, ensuring consistent information acquisition while maintaining high processing speed. The combining unit integrates information from multiple frames to produce a reliable evaluation value that reflects the true subject state.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If the shutter speed is increased to capture moving objects clearly, then the objects appear clear and motionless, but information acquired from the image changes from the blurred state

Engineering Contradiction:
Improveobject clarityVSAvoidmotion information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent dynamically selects between using the current frame image and the combined image based on the evaluation value. When the evaluation value indicates sufficient clarity (above threshold), the system uses the current frame; when clarity is insufficient (below threshold), it switches to the combined image. This dynamic adaptation allows the system to optimize between object clarity and motion information preservation based on real-time conditions.

Inventive Principle:
Principle #15Dynamics

3Reliability

If multiple frame images are combined to reduce blur influence, then information acquisition consistency is improved, but processing complexity increases

Engineering Contradiction:
Improveinformation acquisition consistencyVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies the combining operation selectively rather than universally. The generating unit calculates an evaluation value from the current frame and compares it against a threshold. Only when the evaluation value falls below the threshold (indicating significant blur) does the system perform the combining operation. This localized application of the combining technique reduces overall processing complexity while maintaining reliability where it is most needed.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10999489B2Image processing apparatus, image processing method, and image capture apparatus
Publication Date: 2021.05.04 CANON KK
  • US10999489B2 patent drawing
  • US10999489B2 patent drawing
  • US10999489B2 patent drawing

AI summary

An image processing apparatus generates a predetermined evaluation value from a current frame image of a moving image or a combined image by combining a plurality of frame images of the moving image. The image processing apparatus generates the evaluation value from the combined image if a previous evaluation value is smaller than a threshold, and from the current frame image if the previous evaluation value is larger than or equal to the threshold.