Pixel Array Subsets for HDR Imaging Motion Artifact Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing High Dynamic Range (HDR) image sensors face challenges in reducing motion artifacts and shortening the time required to generate HDR images, particularly in varying lighting conditions, due to the serial capture and combination of images which can introduce motion from subjects, background features, and photographer shake.

Innovation Solution

An HDR imaging system that employs a pixel array with control circuitry to capture images using different exposure periods, generating sub-images which are then fused and interpolated to produce a full-resolution HDR image, while applying a weight map and motion mask to minimize motion artifacts and optimize exposure.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If serial capture of images is used to generate HDR image, then dynamic range is improved, but motion artifacts are introduced

Engineering Contradiction:
Improvedynamic rangeVSAvoidmotion artifacts
Core Design Contradiction:
Illumination intensityVSObject-affected harmful factors

Solution Approach 1:

The pixel array is divided into multiple subsets, where each subset captures an image at a different exposure time. This segmentation allows simultaneous multi-exposure capture without requiring sequential capture, thereby maintaining high dynamic range while eliminating motion artifacts between frames.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different subsets of pixels perform periodic exposure cycles with varying exposure times. By coordinating these periodic actions across different pixel subsets, the system captures multiple exposure levels simultaneously, achieving HDR without the motion artifacts that would result from sequential capture.

Inventive Principle:
Principle #19Periodic action

2Illumination intensity

If serial capture of images is used to generate HDR image, then dynamic range is improved, but time required to generate HDR image is increased

Engineering Contradiction:
Improvedynamic rangeVSAvoidtime required to generate HDR image
Core Design Contradiction:
Illumination intensityVSLoss of time

Solution Approach 1:

Multiple pixel subsets are merged to work simultaneously on capturing different exposure levels of the same scene. This combining of capture operations into a single simultaneous event dramatically reduces the total time required to generate HDR images compared to sequential capture methods.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary arrangement of pixel subsets into different exposure groups before capture. This preliminary organization allows all subsets to be ready for simultaneous capture, eliminating the time delays associated with sequential capture and processing.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If multiple exposure periods are used to capture sub-images, then exposure accuracy is improved, but complexity of image processing is increased

Engineering Contradiction:
Improveexposure accuracyVSAvoidcomplexity of image processing
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

Different regions (pixel subsets) of the image array are assigned different local qualities in terms of exposure time. Each pixel subset is optimized for a specific exposure duration suited to its position in the array, allowing precise exposure control across the entire image while maintaining manageable processing complexity through localized differentiation.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS9282256B1System and method for HDR imaging
Publication Date: 2016.03.08 OMNIVISION TECHNOLOGIES INC
  • US9282256B1 patent drawing
  • US9282256B1 patent drawing
  • US9282256B1 patent drawing

AI summary

Generating an image with an imaging system includes capturing a first sub-image during a first exposure with a first pixel subset of an image sensor of the imaging system, capturing a second sub-image during a second exposure with a second pixel subset of the image sensor, capturing a third sub-image during a third exposure with a third pixel subset of the image sensor, and capturing a fourth sub-image during a fourth exposure with a fourth pixel subset of the image sensor. The first, second, third, and fourth exposures have different durations. A preferred exposure is selected from between the first, second, third and fourth exposures by analyzing the first, second, third, and fourth sub-images. Then, a full-resolution image is captured at the preferred exposure. An HDR image is generated based on the full-resolution image and the sub-images.