Motion Correction for Multi-Exposure Image Synthesis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional motion correction methods for images captured with different sensitivities by time sharing may lower correction accuracy due to the lack of consideration for the synthesis ratio of these images.

Innovation Solution

An image processing apparatus and method that synthesizes images captured at different timings and performs motion correction by setting a criterion for motion amount information based on the synthesis ratio, referring to this information to improve correction accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If motion correction is performed using an image after synthesis as a criterion, then the correction process is simplified, but the correction accuracy is lowered due to not considering the synthesis ratio

Engineering Contradiction:
Improvecorrection process complexityVSAvoidcorrection accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent segments the correction process into two distinct stages: first performing motion correction on individual captured images using motion amount information, and then synthesizing the corrected images. This segmentation allows motion correction to be applied before synthesis, ensuring that the correction accuracy is not compromised by the synthesis ratio, while still maintaining a systematic and organized correction process

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies motion correction as a preliminary action before image synthesis. By correcting motion in the captured images before they are synthesized, the system ensures that the motion correction is performed on the original image data with full accuracy, and the synthesis process simply combines the already-corrected images without introducing additional correction errors

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11064129B2Image processing apparatus, image processing method, imaging apparatus, and program
Publication Date: 2021.07.13 SONY GROUP CORP
  • US11064129B2 patent drawing
  • US11064129B2 patent drawing
  • US11064129B2 patent drawing

AI summary

The present technology relates to an image processing apparatus, an image processing method, an imaging apparatus, and a program that enable motion correction to be performed more appropriately.Provided are a synthesizing unit that synthesizes a plurality of images captured at different timings; and a motion correction unit that performs correction that reduces influence on the images relating to motion, in which the motion correction unit sets a criterion of a section for which motion amount information relating to a motion amount supplied at a predetermined interval is referred to, on the basis of a synthesis ratio when the plurality of images is synthesized, and refers to the motion amount information according to the set criterion to perform the correction. The plurality of images is a long-time exposure image captured during a long-time exposure period and a short-time exposure image captured during a short-time exposure period, and the synthesizing unit synthesizes the long-time exposure image and the short-time exposure image at the synthesis ratio to generate an image with a higher dynamic range. The present technology can be applied to an imaging apparatus.