Dual-Mode Imager Using Temporal Filtering for Color and Depth

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional cameras fail to provide adequate information for accurately assessing the relative depths of surfaces in a scene, as they either capture only color information or depth information but not both effectively.

Innovation Solution

A dual-mode imager that uses a shared image sensor to temporally or spatially filter light, allowing it to capture both structured illumination for depth imaging and visible light for color imaging, enabling the construction of both color and depth images using the same sensor.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If a single image sensor is used to capture both color and depth information, then device complexity is reduced, but measurement precision of depth information deteriorates due to interference from visible light

Engineering Contradiction:
Improvenumber of sensorsVSAvoiddepth measurement accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent employs temporal filtering where the image sensor alternates between capturing visible light for color images and structured illumination for depth images. A temporal filter selectively blocks visible light during depth image capture and blocks structured illumination during color image capture, enabling a single sensor to accurately measure both types of information at different time intervals without mutual interference

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The patent divides the imaging process into two distinct temporal segments: one segment captures visible light for color images while blocking structured illumination, and another segment captures structured illumination for depth images while blocking visible light. This temporal segmentation allows a single sensor to perform both functions with high precision by separating the measurement processes in time

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If separate image sensors are used for color and depth imaging, then measurement precision of both types is improved, but device complexity and cost increase

Engineering Contradiction:
Improvecolor and depth imaging accuracyVSAvoidnumber of sensors
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent makes a single image sensor universal by enabling it to perform both color image capture and depth image capture functions. Through temporal filtering and structured illumination techniques, the same sensor that can capture visible light for color images is also capable of capturing reflected structured illumination for depth images, eliminating the need for separate specialized sensors

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent changes the operational parameters of the image sensor between two distinct modes: one mode is optimized for capturing visible light wavelengths for color images, and another mode is optimized for capturing reflected structured illumination wavelengths for depth images. This parameter switching allows a single sensor to achieve the precision of specialized sensors for each function

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the simultaneous capture and processing of color and depth information from a scene, overcoming the limitations of conventional cameras by generating accurate depth images alongside color images without the need for separate cameras.

Implementation Method 1

A temporal or spatial filter is used to selectively block visible light from one or more portions of the detector while passing the structured illumination to the one or more portions of the detector

Methodology Applied
Scientific EffectOptical filtering: Filter (optical)

Data Source

PatentUS8723118B2Imager for constructing color and depth images
Publication Date: 2014.05.13 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8723118B2 patent drawing
  • US8723118B2 patent drawing
  • US8723118B2 patent drawing

AI summary

A dual-mode includes a light source configured to project a structured illumination from which visible light can be filtered. The dual-mode imager also includes a detector configured to capture both the structured illumination and visible light from the scene. A temporal or spatial filter is used to selectively block visible light from one or more portions of the detector while passing the structured illumination to the one or more portions of the detector.