Multi-Sensing Pixel Array for Compact ToF Systems

Solution Overview

Problem

Current Time-of-Flight (ToF) camera systems face challenges in efficiently integrating multiple sensing and illumination modalities, particularly in compact devices like smartphones and AR glasses, due to space constraints, power consumption issues, and calibration complexities.

Innovation Solution

A multi-sensing pixel array is proposed, which integrates sensing pixels and active illumination within a multi-layer stacked die, sharing a main optical stack and using light channels to guide illumination outside the package, thereby reducing the number of separate sensors and illuminators needed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If multiple separate sensors and illuminators are used for ToF imaging, then sensing and illumination functions are achieved, but device size and complexity increase

Engineering Contradiction:

Improvemulti-sensing capabilityVSAvoidnumber of separate components

Core Design Contradiction:

Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing functions (imaging pixels and depth sensing pixels) and illumination functions into a single integrated pixel array. Each pixel unit contains both imaging pixels for visible light and depth sensing pixels for infrared light, along with integrated illuminators, eliminating the need for separate sensor modules and reducing overall device complexity.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The integrated pixel array serves multiple functions simultaneously: imaging pixels capture visible light for standard photography, depth sensing pixels detect infrared light for depth mapping, and integrated illuminators provide both visible and infrared illumination. This multi-functional design reduces the number of separate components needed.

Inventive Principle:

Principle #6Universality (Multi-functionality)

2Adaptability or versatility

If multiple separate sensors and illuminators are used for ToF imaging, then sensing and illumination functions are achieved, but device volume increases

Engineering Contradiction:

Improvemulti-sensing capabilityVSAvoiddevice volume

Core Design Contradiction:

Adaptability or versatilityVSVolume of moving object

Solution Approach 1:

The patent combines multiple sensing functions (imaging pixels and depth sensing pixels) and illumination functions into a single integrated pixel array. Each pixel unit contains both imaging pixels for visible light and depth sensing pixels for infrared light, along with integrated illuminators, eliminating the need for separate sensor modules and reducing overall device complexity.

Inventive Principle:

Principle #5Merging (Combining)

Solution Approach 2:

The patent implements a nested structure where depth sensing pixels are integrated within the same pixel array structure as imaging pixels. The illuminators are also integrated within the pixel array, creating a compact nested arrangement that minimizes device volume while maintaining all necessary sensing and illumination functions.

Inventive Principle:

Principle #7Nested doll (Nesting)

3Reliability

If separate sensors and illuminators are used, then functional independence is maintained, but calibration complexity increases

Engineering Contradiction:

Improvefunctional independenceVSAvoidcalibration complexity

Core Design Contradiction:

ReliabilityVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing functions (imaging pixels and depth sensing pixels) and illumination functions into a single integrated pixel array. Each pixel unit contains both imaging pixels for visible light and depth sensing pixels for infrared light, along with integrated illuminators, eliminating the need for separate sensor modules and reducing overall device complexity.

Inventive Principle:

Principle #5Merging (Combining)

4Ease of manufacture

If separate sensors and illuminators are used, then modular design is achieved, but power consumption increases

Engineering Contradiction:

Improvemodular designVSAvoidpower consumption

Core Design Contradiction:

Ease of manufactureVSUse of energy by moving object

Solution Approach 1:

The patent combines multiple sensing functions (imaging pixels and depth sensing pixels) and illumination functions into a single integrated pixel array. Each pixel unit contains both imaging pixels for visible light and depth sensing pixels for infrared light, along with integrated illuminators, eliminating the need for separate sensor modules and reducing overall device complexity.

Inventive Principle:

Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach allows for a more compact and power-efficient design, simplifies calibration, and reduces disparity issues, while maintaining the same field of view for both imaging and depth sensing pixels.

Implementation Method 1

A Time-of-Flight (ToF) camera is a range imaging camera system that determines the distance of objects by measuring the time of flight of a light signal between the camera and the object

Methodology Applied

Scientific EffectLight: Light

Implementation Method 2

A pixel array in the ToF camera collects the light reflected from the scene and measures phase-shift (iToF, indirect-ToF) or the travelling time of the light (dToF, direct-ToF)

Methodology Applied

Scientific EffectPhase-shift measurement:

Data Source

PatentUS20250164642A1Time-of-flight system and method

Publication Date: 2025.05.22 SONY SEMICON SOLUTIONS CORP

AI summary

A multi-sensing pixel array that comprises, within a multi-layer stacked die, sensing pixels (PIX_R, PIX_G, PIX_B, PIX_D) and an active illumination (PIX_I).