Image Combining Ratio Adjustment for Position Offset Correction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The dynamic range of solid-state image sensors, such as CCD and CMOS sensors, is narrow compared to human vision, limiting the ability to capture a wide range of brightness levels in a single image, and existing techniques for combining images with different exposure times do not effectively address position offsets between images.

Innovation Solution

An image processing apparatus and method that acquires images with different exposure times, detects position offsets, calculates a combining ratio based on pixel values and offset amounts, and combines images using this ratio to expand the dynamic range and correct for movement between images.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If images with different exposure times are combined to expand dynamic range, then the brightness representation is improved, but position offsets between images cause unnatural twin images and degradation of image quality

Engineering Contradiction:
Improvedynamic rangeVSAvoidimage alignment accuracy
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by detecting position offsets between images with different exposure times before combining them. The offset detection unit identifies the displacement between corresponding pixels in the first and second images, and this detected offset is used to correct the alignment before the combining process, thereby preventing twin image artifacts and maintaining image quality while expanding dynamic range.

Inventive Principle:
Principle #10Preliminary action

2Ease of operation

If a fixed combining ratio is used to combine images with different exposure times, then the processing is simple, but it cannot adapt to position offsets and results in degraded image quality

Engineering Contradiction:
Improvecombining process simplicityVSAvoidcombined image quality
Core Design Contradiction:
Ease of operationVSManufacturing precision

Solution Approach 1:

The patent applies dynamics by making the combining ratio adaptive rather than fixed. The combining ratio calculation unit dynamically adjusts the ratio based on the detected position offset and the pixel values of the images. When position offsets are detected, the combining ratio is modified to account for the displacement, ensuring that the combination process adapts to the actual image alignment conditions and maintains high image quality.

Inventive Principle:
Principle #15Dynamics

3Productivity

If images are combined without detecting position offsets, then the processing is faster and simpler, but unnatural twin images are generated and image quality deteriorates

Engineering Contradiction:
Improveimage processing speedVSAvoidimage alignment accuracy
Core Design Contradiction:
ProductivityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by performing offset detection before the combining operation. The offset detection unit quickly identifies the position displacement between images with different exposure times, and this information is used to adjust the combining process. This preliminary detection step ensures that the main combining operation can proceed efficiently with correct alignment, maintaining both processing speed and image quality.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS8964055B2Combining images based on position offset detection of a series of images
Publication Date: 2015.02.24 OLYMPUS CORPORATION(JP)
  • US8964055B2 patent drawing
  • US8964055B2 patent drawing
  • US8964055B2 patent drawing

AI summary

An image processing apparatus includes an imaging unit that is configured to acquire a plurality of images with different exposure times, a position offset detection unit that is configured to detect a position offset between a plurality of images filmed by the imaging unit, a combining ratio calculation unit that is configured to calculate a combining ratio in case of combining the plurality of images based on pixel values of at least one image among the plurality of images filmed by the imaging unit and the amount of the position offset detected by the position offset detection unit, and an image combining unit that is configured to combine the plurality of images based on the combining ratio calculated by the combining ratio calculation unit.