Image Compositing via Corresponding Point Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image pickup methods struggle to obtain intended all-in-focus or blur-emphasized images due to camera shake and subject movement during focus bracketing, which disrupts the correlation among images used for compositing.

Innovation Solution

An image pickup apparatus comprising a focus bracketing device, corresponding point detecting device, image transformation device, and image compositing device, which successively shoots images, detects corresponding points, transforms images to align these points, and composites them using weighted averages or digital filtering to achieve intended focus and blur effects, even with camera shake or subject movement.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If focus bracketing is performed by taking successive shots with different focus positions, then all-in-focus images or blur-emphasized images can be obtained, but camera shake and subject movement reduce correlation among images making it impossible to obtain intended images

Engineering Contradiction:
Improvefocus precisionVSAvoidimage correlation
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent applies preliminary action by detecting corresponding points among multiple images shot during focus bracketing and transforming the images to make corresponding points coincide before compositing. This preprocessing step compensates for camera shake and subject movement that occur during shooting, ensuring reliable image correlation and enabling successful compositing to produce all-in-focus or blur-emphasized images.

Inventive Principle:
Principle #10Preliminary action

2Manufacturing precision

If exposure time is minimized to reduce camera shake and subject movement, then sharper images can be obtained, but there remains a possibility of camera shake and subject movement making it impossible to obtain intended images

Engineering Contradiction:
Improveimage sharpnessVSAvoidimage stability
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent converts the harmful effect of camera shake and subject movement into a benefit by detecting corresponding points in the shaken images and applying image transformation to realign them. Instead of trying to prevent movement through faster shutter speeds alone, the system accepts the movement occurs and uses computational methods to correct it, thereby achieving both sharpness and stability.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

3Manufacturing precision

If multiple images are composited to create all-in-focus or blur-emphasized images, then enhanced image quality can be achieved, but any camera shake or subject movement during shooting reduces correlation making compositing impossible

Engineering Contradiction:
Improveimage qualityVSAvoidcompositing process complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent employs feedback by detecting corresponding points among the multiple images and using this information to guide the image transformation process. The corresponding point detection provides feedback about the relative positions and movements between images, enabling the system to automatically adjust transformations to achieve proper alignment before compositing, thereby simplifying the overall process despite the complexity involved.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS8023000B2Image pickup apparatus, image processing apparatus, image pickup method, and image processing method
Publication Date: 2011.09.20 FUJIFILM CORP
  • US8023000B2 patent drawing
  • US8023000B2 patent drawing
  • US8023000B2 patent drawing

AI summary

The present invention, which transforms multiple images so that positions of corresponding points will coincide between the images and composites the images with the corresponding points matched, provides an image pickup apparatus, image processing apparatus, image pickup method, and image processing method which make it possible to obtain an intended all-in-focus image or blur-emphasized image even if there is camera shake or subject movement.