CMOS Sensor Alternating 2D Color and 3D Depth Rows
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing 3D imaging technologies, such as time-of-flight, stereoscopic, and structured light methods, face limitations in power consumption, resolution, and suitability for portable devices like smartphones due to high power requirements, sensitivity to ambient light, and complexity, making them unsuitable for low-power, compact image sensors.
Innovation Solution
A triangulation-based system using a CMOS image sensor that performs 3D-depth measurements with a visible light laser scan, allowing for dual-mode 2D and 3D imaging, with a pixel array configured to alternate between color and depth information generation, and employing timestamp-based ambiguity removal to reduce computational power and latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If time-of-flight or structured light methods are used for 3D imaging, then depth measurement capability is achieved, but power consumption increases and ambient light sensitivity worsens
Solution Approach 1:
The patent combines 2D color imaging and 3D depth imaging functions into a single image sensor device. The sensor alternates between capturing color information (for 2D imaging) and depth information (for 3D imaging) using the same physical sensor array, eliminating the need for separate sensors and reducing overall power consumption while maintaining depth measurement capability
Solution Approach 2:
The image sensor operates in periodic alternating modes, switching between 2D color imaging mode and 3D depth imaging mode. During 3D mode, the sensor captures depth information using structured light patterns, then switches back to 2D color mode. This periodic action allows the device to achieve both imaging functions with a single sensor, reducing power consumption compared to having always-active separate 3D imaging systems
2Adaptability or versatility
If separate 2D and 3D imaging systems are used, then imaging functionality is comprehensive, but device complexity increases
Solution Approach 1:
The image sensor is designed as a universal device that can perform both 2D color imaging and 3D depth imaging functions. By configuring the sensor to alternate between different imaging modes and using the same physical array for both purposes, the system achieves multi-functionality without requiring separate dedicated sensors for each mode, thereby reducing device complexity
Solution Approach 2:
The patent merges 2D color camera functionality and 3D depth camera functionality into a single integrated image sensor device. The sensor array, processing circuitry, and control mechanisms are shared between both imaging modes, eliminating the need for separate sensor systems and reducing overall device complexity while maintaining comprehensive imaging functionality
3Measurement precision
If high-resolution 3D imaging is implemented, then measurement precision improves, but processing time and latency increase
Solution Approach 1:
The system performs preliminary actions by capturing multiple depth images in rapid succession before final processing. The image sensor takes a series of depth measurements while the object remains in position, then processes these pre-captured images to generate the final high-resolution 3D model. This approach allows computational processing to occur after data collection, reducing real-time latency while maintaining high resolution
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables low-power, high-efficiency 3D imaging on portable devices by reducing power consumption and latency while maintaining high resolution, suitable for smartphones and other mobile applications with improved ambient light rejection and user safety.
Implementation Method 1
A triangulation-based system using a CMOS image sensor that performs 3D-depth measurements with a visible light laser scan
Implementation Method 2
receiving an image of at least one object at an image sensor
Implementation Method 3
pixels of a second group of rows of the array being operable to generate 2D-color information of the at least one object, pixels of a third group of the array being operable to generate 3D-depth information of the at least one object
Data Source
AI summary
Two-dimensional (2D) color information and 3D-depth information are concurrently obtained from a 2D pixel array. The 2D pixel array is arranged in a first group of a plurality of rows. A second group of rows of the array are operable to generate 2D-color information and pixels of a third group of the array are operable to generate 3D-depth information. The first group of rows comprises a first number of rows, the second group of rows comprises a second number of rows that is equal to or less than the first number of rows, and the third group of rows comprises a third number of rows that is equal to or less than the second number of rows. In an alternating manner, 2D-color information is received from a row selected from the second group of rows and 3D-depth information is received from a row selected from the third group of rows.