Integrated Pixel Array for Simultaneous 3D Depth and Color Sensing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems cannot simultaneously generate a 3D image that provides both distance and color information of objects in an area, with Time-of-Flight sensors only providing distance data and CMOS image sensors only providing color data.
Innovation Solution
A pixel array is designed that combines Time-of-Flight sensors and CMOS image sensors to generate a 3D ToF color image by integrating ToF sensors and image sensors, such as RGB sensors, where the outputs from both types of sensors are used to create an image that includes both distance and color information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If separate ToF sensors and CMOS image sensors are used, then distance measurement and color detection functions are achieved, but the system cannot simultaneously generate images with both distance and color information
Solution Approach 1:
The patent combines ToF sensors and CMOS image sensors into a single integrated pixel array structure. The ToF sensor includes a photodiode and circuitry for measuring flight time of light, while the CMOS image sensor includes a photodiode and readout circuitry. Both sensor types share the same substrate and are arranged in corresponding pixel locations, allowing simultaneous capture of distance and color information from the same scene points.
Solution Approach 2:
The integrated pixel array serves multiple functions: it performs both time-of-flight distance measurement and color image capture using a unified sensor structure. The shared photodiodes and circuitry enable the system to generate comprehensive 3D color images that contain both depth and color data, making the system versatile for applications requiring both types of information.
2Measurement precision
If ToF sensors are used for distance measurement, then distance data is obtained, but color information is not provided
Solution Approach 1:
The patent merges ToF sensing capabilities with CMOS image sensing capabilities in a single pixel array. Each pixel location contains both ToF measurement circuitry and color detection circuitry, enabling simultaneous acquisition of distance and color information without using separate sensor systems.
Solution Approach 2:
The pixel array is segmented into distinct functional regions within each pixel: one region dedicated to ToF measurement and another region dedicated to color detection. This segmentation allows each region to optimize its specific function while working together to provide complete 3D color image data.
3Measurement precision
If CMOS image sensors are used for color detection, then color data is obtained, but distance information is not provided
Solution Approach 1:
The patent integrates CMOS image sensor functionality with ToF sensor functionality in a unified pixel array structure. The combination enables simultaneous capture of color information by the CMOS portion and distance information by the ToF portion, eliminating the information loss that occurs when using only one sensor type.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution enables the creation of a 3D ToF color image that provides accurate distance and color data, enhancing applications such as 3D module construction, virtual reality, augmented reality, and autonomous vehicles.
Implementation Method 1
Complementary metal oxide semiconductor (CMOS) image sensors utilize light-sensitive CMOS circuitry, referred to as pixel sensors, to convert light energy into electrical energy. A pixel sensor typically includes a photodiode formed in a silicon substrate. As the photodiode is exposed to light, an electrical charge is induced in the photodiode.
Implementation Method 2
Time-of-Flight (ToF) sensors (e.g., sensors that use germanium-on-silicon (GeSi) technology to enable ToF sensing) can be used in a system designed to detect distances to objects in an area. Generally, a given ToF sensor detects a phase difference between a signal transmitted by the system and a corresponding signal received by the given ToF sensor (after reflection of the signal by an object in the area). This phase difference can be used to determine the distance to the object that reflected the signal.
Data Source
AI summary
A pixel array may include a group of time-of-flight (ToF) sensors. The pixel array may include an image sensor comprising a group of pixel sensors. The image sensor may be arranged among the group of ToF sensors such that the image sensor is adjacent to each ToF sensor in the group of ToF sensors.