Coded Spatial Light Transmittance Modulator for High Dynamic Range Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current semiconductor image sensors face challenges in simultaneously capturing poorly lit and brightly lit scene areas due to limited dynamic range, requiring motion stabilization, de-ghosting, and complex camera calibration for multi-exposure image fusion.

Innovation Solution

A coded spatial light transmittance modulator is integrated into the image capture device, allowing for per-pixel or regional light modulation to extend the dynamic range, enabling high dynamic range image capture without the need for motion stabilization or de-ghosting, by adjusting the transmittance of overexposed pixels.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If multi-exposure images are used to extend dynamic range, then dynamic range is improved, but motion stabilization and de-ghosting are required

Engineering Contradiction:
Improvedynamic rangeVSAvoidmotion stabilization and de-ghosting
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent applies a dynamic spatial light transmittance modulator that can change its transmittance properties in real-time. The modulator is configured with varying transmittance values across different regions, allowing it to dynamically adjust light transmission to extend dynamic range without requiring multiple exposures or complex post-processing stabilization techniques.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The spatial light transmittance modulator is pre-configured with specific transmittance patterns before image capture. This preliminary configuration allows the system to capture high dynamic range information in a single shot by pre-establishing the light modulation pattern, eliminating the need for multi-exposure sequences and subsequent de-ghosting operations.

Inventive Principle:
Principle #10Preliminary action

2Illumination intensity

If multi-exposure images are used to extend dynamic range, then dynamic range is improved, but frame rate is reduced

Engineering Contradiction:
Improvedynamic rangeVSAvoidframe rate
Core Design Contradiction:
Illumination intensityVSProductivity

Solution Approach 1:

The spatial light transmittance modulator is pre-configured with specific transmittance patterns before image capture. This preliminary configuration allows the system to capture high dynamic range information in a single shot by pre-establishing the light modulation pattern, eliminating the need for multi-exposure sequences and subsequent de-ghosting operations.

Inventive Principle:
Principle #10Preliminary action

3Illumination intensity

If multiple sensors are used to extend dynamic range, then dynamic range is improved, but camera calibration is complicated

Engineering Contradiction:
Improvedynamic rangeVSAvoidcamera calibration
Core Design Contradiction:
Illumination intensityVSDevice complexity

Solution Approach 1:

The patent merges the dynamic range extension function into a single sensor system by integrating a spatial light transmittance modulator directly with the image sensor. This combination eliminates the need for multiple separate sensors and their associated calibration procedures, as the modulator handles the dynamic range adjustment in-uniformly across the sensor array.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The spatial light transmittance modulator serves multiple functions simultaneously: it extends dynamic range, performs spatially selective exposure control, and eliminates the need for additional sensors or calibration systems. This multi-functionality simplifies the overall system architecture while achieving high dynamic range performance.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This solution allows for high dynamic range image capture with minimal camera modifications, maintaining high frame rates and enabling scenes with varying lighting conditions like sun glare and oncoming headlights to be captured effectively, without the complexity of multiple sensors or alignment.

Implementation Method 1

a spatial light transmittance modulator, the spatial light transmittance modulator having a plurality of pre-defined shadings

Methodology Applied
Scientific EffectLight transmittance modulation: Absorption (EM radiation)

Implementation Method 2

a micro-lens array, having a plurality of micro-lens aligned to at least one of the plurality of pixels

Methodology Applied
Scientific EffectLens focusing: Lens

Data Source

PatentUS11490027B2Extended dynamic range image capture device based on a coded spatial light transmittance modulator
Publication Date: 2022.11.01 BLACK SESAME TECH INC
  • US11490027B2 patent drawing
  • US11490027B2 patent drawing
  • US11490027B2 patent drawing

AI summary

A high dynamic range sensor, comprising a pixel array, having a plurality of pixels, a spatial light transmittance modulator, the spatial light transmittance modulator having a plurality of pre-defined shadings, the plurality of pre-defined shadings are fixed with respect to the plurality of pixels, wherein the plurality of pre-defined shadings is located above the plurality of pixels and a micro-lens array, having a plurality of micro-lens aligned to at least one of the plurality of pixels, wherein the micro-lens array is located above the plurality of pixels.