Image Processing Apparatus for Multi-Shot Composite Alignment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image-capturing techniques, such as multi-shot compositing, face challenges in obtaining high-definition images without camera shake, as they require precise alignment of images, which can be difficult to achieve without active vibration correction systems.

Innovation Solution

An image processing apparatus and method that detects positional shifts in images and selects a composite target image based on these shifts, allowing for the creation of high-definition composite images without the need for active vibration correction, by moving the image sensor or using camera shake to align images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If multi-shot compositing is performed without active vibration correction, then device complexity is reduced, but manufacturing precision of image alignment deteriorates

Engineering Contradiction:
Improvevibration correction systemVSAvoidimage alignment precision
Core Design Contradiction:
Device complexityVSManufacturing precision

Solution Approach 1:

The patent replaces the mechanical vibration correction system with an image processing approach. Instead of using physical mechanisms to stabilize the camera or sensor during capture, the invention uses digital image processing to detect positional shifts between multiple captured images and computationally align them during composite image generation, thereby achieving high-precision alignment without complex mechanical vibration correction hardware

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent introduces an intermediary processing step between image capture and composite image generation. The positional shift detection function acts as an intermediary that measures and quantifies the misalignment between images, enabling subsequent computational correction. This intermediary measurement step allows the system to achieve precise alignment through software processing rather than relying on mechanical stability

Inventive Principle:
Principle #24Intermediary (Mediator)

2Manufacturing precision

If images are captured while moving the image sensor to achieve high-definition composite images, then manufacturing precision of composite image is improved, but difficulty of detecting and measuring positional shifts increases

Engineering Contradiction:
Improvecomposite image definitionVSAvoidpositional shift detection
Core Design Contradiction:
Manufacturing precisionVSDifficulty of detecting and measuring

Solution Approach 1:

The patent implements a feedback mechanism where the positional shift detection result is used to guide the image alignment process. The system detects the actual positional shift between images, uses this detection information as feedback to determine the appropriate alignment transformation, and applies the correction accordingly. This closed-loop feedback approach enables accurate positional shift measurement and correction even when images are captured with sensor movement

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary positional shift detection and calculation before generating the composite image. By detecting and calculating the required alignment transformations in advance, the system prepares the alignment parameters beforehand, making the actual composite image generation process more straightforward and accurate. This preliminary measurement and preparation step reduces the complexity of the subsequent image compositing operation

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11394881B2Image processing apparatus, image processing method, storage medium, system, and electronic apparatus
Publication Date: 2022.07.19 RICOH CO LTD
  • US11394881B2 patent drawing
  • US11394881B2 patent drawing
  • US11394881B2 patent drawing

AI summary

An image processing apparatus includes processing circuitry. The processing circuitry is configured to detect a positional shift amount of each of a plurality of images; select a composite target image from the plurality of images based on the detected positional shift amount; and obtain a composite image based on the positional shift amount and the selected composite target image.