Micro Lens Array for Single-Frame High Dynamic Range Imaging

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing imaging devices that generate high dynamic range images using low dynamic range imaging elements face challenges such as requiring multiple frames, resulting in memory issues, delay times, and motion blur due to focal position mismatching when capturing moving objects.

Innovation Solution

An imaging device with an imaging lens, object imaging pixels, focal point detection pixels, and a lens array, which includes a phase difference detection unit for focal point adjustment and an image synthesizing unit to combine images with different exposure conditions within a single frame, allowing for focal point matching and high dynamic range image generation without mismatching.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Illumination intensity

If multiple frames are used to generate HDR image, then dynamic range is improved, but memory requirement increases

Engineering Contradiction:
Improvedynamic rangeVSAvoidmemory requirement
Core Design Contradiction:
Illumination intensityVSQuantity of substance

Solution Approach 1:

The imaging element is segmented into multiple pixel types (first photoelectric conversion pixels, second photoelectric conversion pixels, and focal point detection pixels) that simultaneously capture different exposure levels within a single frame, eliminating the need to store multiple separate frames while maintaining HDR capability

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from temporal multiplexing (multiple frames over time) to spatial multiplexing (multiple pixel types in different spatial positions within one frame), thereby capturing multiple exposure levels simultaneously without increasing memory requirements

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Illumination intensity

If multiple frames are captured for HDR, then dynamic range is improved, but processing delay increases

Engineering Contradiction:
Improvedynamic rangeVSAvoidprocessing delay
Core Design Contradiction:
Illumination intensityVSLoss of time

Solution Approach 1:

The imaging element is pre-configured with different pixel types optimized for different exposure levels, allowing immediate capture of HDR data in a single frame without the time delay associated with capturing and processing multiple sequential frames

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system achieves continuous HDR imaging by capturing all necessary exposure data simultaneously in one frame, eliminating the intermittent processing delays that occur when switching between multiple frame captures

Inventive Principle:
Principle #20Continuity of useful action

3Illumination intensity

If multiple frames are used for HDR synthesis, then dynamic range is improved, but motion blur occurs

Engineering Contradiction:
Improvedynamic rangeVSAvoidmotion blur
Core Design Contradiction:
Illumination intensityVSReliability

Solution Approach 1:

The imaging element segments different exposure functions across different pixel types, allowing simultaneous capture of multiple exposure levels within a single exposure time, thereby eliminating motion blur that occurs when capturing multiple frames sequentially

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent merges multiple exposure capture functions into a single frame by using different pixel types for different exposure levels, thereby capturing all exposure data at the same moment in time and eliminating motion artifacts

Inventive Principle:
Principle #5Merging (Combining)

4Measurement precision

If focal point detection pixels are added, then focusing accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvefocusing accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The imaging element achieves multi-functionality by incorporating focal point detection pixels alongside photoelectric conversion pixels in a unified structure, allowing the same device to perform both imaging and autofocus functions without requiring separate focusing mechanisms

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The imaging element performs self-focusing by using dedicated focal point detection pixels that automatically detect phase differences and provide feedback for lens adjustment, eliminating the need for external or complex manual focusing systems

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of high dynamic range images without focal position mismatching, reducing memory requirements, processing delays, and motion blur, while maintaining the original image resolution.

Implementation Method 1

a lens array configured by micro lenses being arranged on a two-dimensional plane, and arranged on a front surface of an imaging surface of the imaging element to be distanced therefrom

Methodology Applied
Scientific EffectRefraction: Refraction

Implementation Method 2

an imaging element which contains object imaging pixels and focal point detection pixels

Methodology Applied
Scientific EffectPhotoelectric conversion: Photoelectric Effect

Data Source

PatentUS10469728B2Imaging device having a lens array of micro lenses
Publication Date: 2019.11.05 SONY GROUP CORP
  • US10469728B2 patent drawing
  • US10469728B2 patent drawing
  • US10469728B2 patent drawing

AI summary

An imaging device includes an imaging lens; an imaging element which contains object imaging pixels and focal point detection pixels; and a lens array configured by micro lenses being arranged on a two-dimensional plane, and arranged on a front surface of an imaging surface of the imaging element to be distanced therefrom.