ToF Sensor Color Detection via Modulation Gate Potentials

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current color sensing with Time-of-Flight (ToF) sensors requires synchronization with RGB cameras, leading to high system costs and complexity due to the need for separate cameras for color information, which is not efficiently addressed by existing methods.

Innovation Solution

A method and apparatus for detecting color using ToF sensors by applying different electrical potentials to modulation gates of sensor pixels, determining charge ratios, and calculating the color based on these ratios, allowing color determination without the need for additional cameras.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If an RGB camera is used together with the ToF camera to provide color information, then color sensing capability is improved, but system costs and system complexity increase

Engineering Contradiction:
Improvecolor sensing capabilityVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the color sensing function into the ToF sensor by adding modulation gates to the existing sensor pixel structure. This integration allows the ToF sensor to perform both depth measurement and color sensing simultaneously, eliminating the need for a separate RGB camera and reducing system complexity while maintaining color sensing capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The ToF sensor is designed with multi-functionality by incorporating modulation gates that enable it to perform both time-of-flight depth measurement and color sensing operations. The sensor pixel can operate in different modes (depth measurement mode and color sensing mode) by applying different electrical potentials to the modulation gates, making a single device serve multiple purposes

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If an RGB camera is used together with the ToF camera to provide color information, then color sensing capability is improved, but system costs increase

Engineering Contradiction:
Improvecolor sensing capabilityVSAvoidsystem costs
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The patent merges the color sensing function into the ToF sensor by adding modulation gates to the existing sensor pixel structure. This integration allows the ToF sensor to perform both depth measurement and color sensing simultaneously, eliminating the need for a separate RGB camera and reducing system complexity while maintaining color sensing capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The ToF sensor is designed with multi-functionality by incorporating modulation gates that enable it to perform both time-of-flight depth measurement and color sensing operations. The sensor pixel can operate in different modes (depth measurement mode and color sensing mode) by applying different electrical potentials to the modulation gates, making a single device serve multiple purposes

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If synchronization between ToF camera and RGB camera is implemented, then color information accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvecolor information accuracyVSAvoidsynchronization complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent merges the color sensing function into the ToF sensor by adding modulation gates to the existing sensor pixel structure. This integration allows the ToF sensor to perform both depth measurement and color sensing simultaneously, eliminating the need for a separate RGB camera and reducing system complexity while maintaining color sensing capability

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent extracts the color sensing capability from the separate RGB camera system and integrates it directly into the ToF sensor pixel structure. By taking out the color sensing function and embedding it within the ToF sensor, the synchronization requirement between separate cameras is eliminated, reducing the complexity associated with coordinating multiple devices

Inventive Principle:
Principle #2Taking out (Extraction)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables color sensing within ToF sensors, reducing system complexity and costs by integrating color detection directly into the ToF imaging process, eliminating the need for separate RGB cameras and improving system efficiency.

Implementation Method 1

A ToF sensor comprises a sensor array comprising a plurality of sensor pixels. Each sensor pixel comprises a plurality of modulation gates arranged laterally with respect to a direction of incidence of light to be sensed by the sensor pixel

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentEP4109126B1Method and apparatus for detecting a color of light received from a scene by a time-of-flight sensor
Publication Date: 2024.02.28 INFINEON TECHNOLOGIES AG
  • EP4109126B1 patent drawingFigure 1
  • EP4109126B1 patent drawingFigure 2
  • EP4109126B1 patent drawingFigure 3(a)~3(c)

AI summary

A method for detecting a color of light received from a scene by a Time-of-Flight (ToF) sensor is provided. The method includes applying a first electrical potential to a first modulation gate of a sensor pixel of the ToF sensor during an exposure time of the ToF sensor. Further, the method includes applying a second electrical potential to a second modulation gate of the sensor pixel during the exposure time. The second electrical potential is different from the first electrical potential. In addition, the method includes receiving data sensor indicating a first amount of charge collected at a first charge storage of the sensor pixel during the exposure time and a second amount of charge collected at a second charge storage of the sensor pixel during the exposure time. The method further includes determining the color of the light received by the sensor pixel based on the first amount of charge and the second amount of charge.