Integrated ToF and Image Sensor Detector Array for LIDAR

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing 3D imaging systems, particularly those using time-of-flight Light Detection And Ranging (LIDAR) technology, face challenges in efficiently integrating depth information from time-of-flight sensors with image information from image sensors, leading to increased computational requirements and potential inefficiencies in processing.

Innovation Solution

The integration of time-of-flight (ToF) sensors and image sensors on the same semiconductor substrate, with shared optics and a detector array configuration that correlates depth information from ToF sensors with image information from image sensors, reducing the need for extensive processing to register these data types.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If depth information from time-of-flight sensors and image information from image sensors are processed separately using traditional registration methods, then measurement precision is improved, but device complexity and computational overhead increase

Engineering Contradiction:
Improvedepth measurement precisionVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines time-of-flight sensors and image sensors into a single integrated detector array on the same semiconductor substrate. The sensors share common readout circuitry and processing infrastructure, merging previously separate processing systems into one unified device. This integration maintains the precision benefits of separate sensing while eliminating the complexity of separate processing systems through architectural unification.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If traditional separate processing of ToF and image sensor data is used, then measurement accuracy is maintained, but processing time and computational resources increase

Engineering Contradiction:
Improvedepth and image information accuracyVSAvoiddata processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The integrated detector array performs preliminary correlation of depth and image information at the sensor level through shared readout circuitry and synchronized pixel timing. By establishing spatial correspondence between ToF and image data during the sensing phase rather than during post-processing, the system prepares data for faster fusion downstream, reducing the computational time required for final processing while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If separate detector arrays for ToF and image sensors are used, then individual sensor performance is optimized, but manufacturing cost and system integration complexity increase

Engineering Contradiction:
Improvesensor performance reliabilityVSAvoidsystem integration ease
Core Design Contradiction:
ReliabilityVSEase of manufacture

Solution Approach 1:

The patent merges time-of-flight sensors and image sensors into a single integrated detector array fabricated on the same semiconductor substrate using compatible manufacturing processes. This unified architecture allows both sensor types to be produced simultaneously in the same fabrication run, eliminating the need for separate manufacturing and assembly operations. The shared substrate and readout circuitry reduce integration complexity while maintaining the performance reliability of each sensor type through dedicated sensing regions.

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables faster and less expensive 3D imaging systems by optically correlating depth and image information, thereby reducing computational overhead and enhancing processing efficiency.

Implementation Method 1

Time of flight (ToF) sensors may be provided at a first set of depths, and image sensors may be provided at a second set of depths

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Implementation Method 2

receiver optics configured to collect the light over a field of view and direct first and second portions of the light to the first and second pixels, respectively

Methodology Applied
Scientific EffectOptical focusing: Lens

Implementation Method 3

one or more light detector elements (including semiconductor photodetectors, such as photodiodes, including avalanche photodiodes and single-photon avalanche detectors (SPADs))

Methodology Applied
Scientific EffectPhotoelectric effect: Photoelectric Effect

Data Source

PatentUS12222454B2Integrated lidar image-sensor devices and systems and related methods of operation
Publication Date: 2025.02.11 SENSE PHOTONICS INC
  • US12222454B2 patent drawing
  • US12222454B2 patent drawing
  • US12222454B2 patent drawing

AI summary

A Light Detection and Ranging (LIDAR) apparatus includes a detector having a first pixel and a second pixel configured to output respective detection signals responsive to light incident thereon, and receiver optics configured to collect the light over a field of view and direct first and second portions of the light to the first and second pixels, respectively. The first pixel includes one or more time of flight (ToF) sensors, and the second pixel includes one or more image sensors. At least one of the receiver optics or arrangement of the first and second pixels in the detector is configured to correlate the first and second pixels such that depth information indicated by the respective detection signals output from the first pixel is correlated with image information indicated by the respective detection signals output from the second pixel. Related devices and methods of operation are also discussed.