Microlens Pixel Segmentation for Real-Time Stray Light Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Cameras suffer from aberrations such as veiling glare and lens flare due to internal reflections and misalignments within the camera optics, which affect image quality and object identification in applications like autonomous vehicles.

Innovation Solution

The use of microlenses positioned over subsets of light-sensitive pixels to determine the angle of incidence of incoming light signals, allowing for the identification and compensation of stray light, including veiling glare and ghost images, through hardware or software corrections.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If microlenses are positioned over light-sensitive pixels to detect angle of incidence, then stray light identification capability is improved, but device complexity increases

Engineering Contradiction:
Improvestray light detection accuracyVSAvoidcamera structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The image sensor is divided into two distinct subsets: first light-sensitive pixels for capturing the actual image and second light-sensitive pixels for detecting stray light. Each subset has dedicated microlenses optimized for its specific function, allowing independent optimization without interfering with the other function.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Microlenses are introduced as intermediary optical elements positioned between the incoming light and the light-sensitive pixels. These microlenses focus and direct light at specific angles to the second subset of pixels, enabling angle-of-incidence detection without requiring complex sensor modifications.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If dedicated pixels are allocated for stray light detection, then stray light measurement capability is improved, but image sensor resolution is reduced

Engineering Contradiction:
Improvestray light quantification accuracyVSAvoidimage sensor resolution
Core Design Contradiction:
Measurement precisionVSManufacturing precision

Solution Approach 1:

The image sensor is segmented into two functional zones: first light-sensitive pixels arranged in a first subset for high-resolution image capture, and second light-sensitive pixels arranged in a second subset for stray light detection. This spatial segmentation allows each zone to be optimized for its specific purpose without compromising the other.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different regions of the image sensor are assigned different functional qualities: the first subset of pixels is optimized for capturing the main image with high spatial resolution, while the second subset is optimized for detecting stray light intensity and angle. Each region has tailored microlenses and pixel characteristics suited to its local function.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves image quality by effectively removing stray light, enhancing object identification in computer vision applications and maintaining the integrity of captured images.

Implementation Method 1

a first lens positioned over a first subset of light-sensitive pixels selected from the plurality of light-sensitive pixels... receiving, at a lens positioned over a first subset of light-sensitive pixels... a first light signal

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

The microlenses may be positioned over a set of light-sensitive pixels on the image sensor... directing, using the lens, the first light signal toward the first subset of light-sensitive pixels

Methodology Applied
Scientific EffectLens: Lens

Data Source

PatentUS11343435B2Microlensing for real-time sensing of stray light
Publication Date: 2022.05.24 WAYMO LLC
  • US11343435B2 patent drawing
  • US11343435B2 patent drawing
  • US11343435B2 patent drawing

AI summary

Example embodiments relate to microlensing for real-time sensing of stray light. An example device includes an image sensor that includes a plurality of light-sensitive pixels. The device also includes a first lens positioned over a first subset of light-sensitive pixels selected from the plurality of light-sensitive pixels. Further, the device includes a controller. The controller is configured to determine a first angle of incidence of a first light signal detected by the first subset of light-sensitive pixels. The controller is also configured to, based on the first determined angle of incidence, determine an amount of stray light incident on the image sensor.