High Dynamic Range Imaging Motion Artifact Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing high dynamic range imaging techniques often result in undesirable artifacts due to registration errors from motion and fail to capture images with significantly higher dynamic range than single low dynamic range images.

Innovation Solution

A system and method that captures image data with different exposure times using a Fibonacci exposure bracketing scheme, estimates motion between frames, and generates a high dynamic range image by combining and aligning image data to eliminate motion-related artifacts.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If multiple images with different exposure times are captured to achieve high dynamic range, then the dynamic range of the captured image is improved, but motion artifacts and registration errors occur due to scene or camera motion during capture

Engineering Contradiction:
Improvedynamic rangeVSAvoidregistration accuracy
Core Design Contradiction:
Illumination intensityVSManufacturing precision

Solution Approach 1:

The patent applies preliminary action by capturing a motion reference image at the beginning of the capture sequence, before motion occurs. This reference image is used to establish an initial registration state, allowing subsequent images to be aligned relative to this stable reference point, thereby compensating for motion that occurs during the multi-exposure capture process

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements feedback by continuously estimating motion between consecutive images and using this motion information to adjust the alignment of subsequent images. The motion estimation results feed back into the registration process, enabling real-time compensation for scene or camera motion during the capture sequence

Inventive Principle:
Principle #23Feedback

2Illumination intensity

If multiple images with different exposure times are captured to achieve high dynamic range, then the dynamic range of the captured image is improved, but ghosting artifacts occur due to motion between frames

Engineering Contradiction:
Improvedynamic rangeVSAvoidimage quality
Core Design Contradiction:
Illumination intensityVSReliability

Solution Approach 1:

The patent extracts motion information from the image sequence by estimating motion between consecutive frames. This extracted motion data is then used to separate the motion component from the static scene content, allowing the system to align and combine images while removing motion-induced ghosting artifacts through selective masking or warping operations

Inventive Principle:
Principle #2Taking out (Extraction)

3Measurement precision

If the exposure time is increased to capture more light, then the image quality in dark regions is improved, but motion blur increases due to longer exposure duration

Engineering Contradiction:
Improvesignal-to-noise ratioVSAvoidsharpness
Core Design Contradiction:
Measurement precisionVSShape

Solution Approach 1:

The patent segments the total exposure requirement into multiple shorter exposure captures taken at different exposure times. Instead of using a single long exposure that would cause motion blur, the system captures multiple short-exposure images and combines them, with each image contributing signal information while minimizing motion blur through the brief exposure duration of each individual capture

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS10148893B2Methods, systems, and media for high dynamic range imaging
Publication Date: 2018.12.04 SONY GROUP CORP
  • US10148893B2 patent drawing
  • US10148893B2 patent drawing
  • US10148893B2 patent drawing

AI summary

Systems, methods, and media for high dynamic range imaging are provided, the systems comprising: an image sensor; and a hardware processor configured to: cause the image sensor to capture first image data having a first exposure time, second image data having a second exposure time, and third image data having a third exposure time that is substantially equal to the sum of the first exposure time and the second exposure time; generate combined image data using the first image data and the second image data.