Single Image Sensor Mosaic Filter for 3D Depth Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems require multiple image sensors to capture both 3D depth maps and 2D color images, increasing cost, size, and complexity, while also needing synchronization of depth maps with color images.
Innovation Solution
A single image sensor captures both monochromatic and color images by projecting a pattern of monochromatic optical radiation, using a mosaic filter and processor to generate and register depth maps with color images, reducing the need for separate sensors and enhancing image alignment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple image sensors are used to capture both depth maps and color images, then measurement precision is improved, but device complexity increases
Solution Approach 1:
The patent makes a single image sensor perform multiple functions by equipping it with a mosaic filter that includes both color filters (RGB) and an infrared-transparent region. This allows the same sensor to capture both color images and infrared pattern information for depth mapping, eliminating the need for separate sensors and reducing system complexity while maintaining measurement precision
Solution Approach 2:
The patent combines the color imaging function and depth mapping function into a single image sensor system. By integrating both color filter arrays and infrared-sensitive regions in the mosaic filter, the system merges previously separate functions into one unified sensor, reducing device complexity while preserving the precision of both imaging modes
2Measurement precision
If multiple image sensors are used to capture depth maps and color images, then measurement precision is improved, but manufacturing cost increases
Solution Approach 1:
The patent makes a single image sensor perform multiple functions by equipping it with a mosaic filter that includes both color filters (RGB) and an infrared-transparent region. This allows the same sensor to capture both color images and infrared pattern information for depth mapping, eliminating the need for separate sensors and reducing system complexity while maintaining measurement precision
Solution Approach 2:
The patent combines the color imaging function and depth mapping function into a single image sensor system. By integrating both color filter arrays and infrared-sensitive regions in the mosaic filter, the system merges previously separate functions into one unified sensor, reducing device complexity while preserving the precision of both imaging modes
3Measurement precision
If multiple image sensors are used to capture depth maps and color images, then measurement precision is improved, but loss of time increases due to synchronization requirements
Solution Approach 1:
The patent combines the color imaging function and depth mapping function into a single image sensor system. By integrating both color filter arrays and infrared-sensitive regions in the mosaic filter, the system merges previously separate functions into one unified sensor, reducing device complexity while preserving the precision of both imaging modes
Solution Approach 2:
The single image sensor with mosaic filter inherently captures both color and infrared pattern information simultaneously in the same exposure. This self-service capability eliminates the need for external synchronization mechanisms between separate sensors, as the sensor automatically provides both data streams in perfect temporal alignment
4Device complexity
If a single image sensor is used to capture both monochromatic and color images, then device complexity is reduced, but measurement precision may worsen
Solution Approach 1:
The patent makes a single image sensor perform multiple functions by equipping it with a mosaic filter that includes both color filters (RGB) and an infrared-transparent region. This allows the same sensor to capture both color images and infrared pattern information for depth mapping, eliminating the need for separate sensors and reducing system complexity while maintaining measurement precision
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach reduces system complexity and cost by using a single image sensor for both functions while ensuring perfect registration of depth maps with color images, enhancing image capture efficiency.
Implementation Method 1
capture a first, monochromatic image of the pattern on the object by receiving the monochromatic optical radiation reflected from the object
Implementation Method 2
capture a second, color image of the object by receiving polychromatic optical radiation
Implementation Method 3
The imaging subassembly includes an array of detector elements and a mosaic filter including a pattern of filter elements overlaid respectively on the detector elements
Data Source
AI summary
Imaging apparatus includes an illumination subassembly, which is configured to project onto an object a pattern of monochromatic optical radiation in a given wavelength band. An imaging subassembly includes an image sensor, which is configured both to capture a first, monochromatic image of the pattern on the object by receiving the monochromatic optical radiation reflected from the object and to capture a second, color image of the object by receiving polychromatic optical radiation, and to output first and second image signals responsively to the first and second images, respectively. A processor is configured to process the first and second signals so as to generate and output a depth map of the object in registration with the color image.