Infrared Depth Estimation via Intensity Ratio

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Existing methods for creating accurate image depth maps, such as those used in 3D video conferencing, are impractical due to the high cost and speed limitations of laser scanners.

Innovation Solution

A camera system equipped with an infrared light source and a natural light source captures images simultaneously, using the ratio of infrared and natural light intensities to estimate depth values and create accurate depth maps, while correcting for object reflectivity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a laser scanner is used to create accurate image depth maps, then measurement precision is improved, but device complexity and cost increase significantly

Engineering Contradiction:

Improvedepth map accuracyVSAvoidscanner complexity

Core Design Contradiction:

Measurement precisionVSDevice complexity

Solution Approach 1:

The patent replaces the mechanical laser scanning system with an optical-based infrared imaging system. Instead of using a mechanical scanner to measure depth point-by-point, the invention uses an infrared camera to capture depth information across the entire field of view simultaneously through optical measurements, thereby reducing mechanical complexity while maintaining depth measurement capability

Inventive Principle:

Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates an optical copy of the depth information by capturing infrared radiation patterns from the scene. The infrared camera records the thermal or reflected infrared signature of objects, which is then processed to generate a depth map that copies the spatial depth structure without requiring physical contact or mechanical scanning

Inventive Principle:

Principle #26Copying

2Measurement precision

If a laser scanner is used to create accurate image depth maps, then measurement precision is improved, but productivity decreases due to speed limitations

Engineering Contradiction:

Improvedepth map accuracyVSAvoiddepth map generation speed

Core Design Contradiction:

Measurement precisionVSProductivity

Solution Approach 1:

The patent uses periodic modulation of the infrared light source and synchronous detection to capture depth information. By modulating the infrared illumination at a specific frequency and detecting the modulated reflected signal, the system can extract depth information rapidly for all pixels simultaneously, greatly increasing measurement speed compared to sequential laser scanning

Inventive Principle:

Principle #19Periodic action

Solution Approach 2:

The patent performs preliminary capture of the entire scene's infrared radiation pattern in a single exposure, rather than scanning point-by-point. The infrared camera captures depth information for all pixels in the field of view simultaneously during one exposure period, enabling rapid depth map generation without sequential measurement delays

Inventive Principle:

Principle #10Preliminary action

3Measurement precision

If an infrared light source and natural light source are used to capture images simultaneously, then depth estimation accuracy is improved, but use of energy increases

Engineering Contradiction:

Improvedepth estimation accuracyVSAvoidenergy consumption

Core Design Contradiction:

Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent merges the infrared imaging function with the visible light imaging function into a single camera system. By combining both infrared and visible light sensors in one device and processing both image streams simultaneously, the system achieves depth estimation and reflectivity correction without requiring separate imaging systems, thereby reducing total energy consumption compared to using multiple independent devices

Inventive Principle:

Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enables the creation of accurate image depth maps without the constraints of laser scanners, facilitating cost-effective and efficient depth estimation for applications like 3D video conferencing.

Implementation Method 1

capturing a second image illuminated by infrared light

Methodology Applied

Scientific EffectInfrared radiation: Infrared Radiation

Implementation Method 2

capturing a first image illuminated by natural light

Methodology Applied

Scientific EffectNatural light: Light

Implementation Method 3

an IR filter; a processor associated with the camera programmed to run a demosaicing algorithm to process IR intensity and IR reflectance

Methodology Applied

Scientific EffectInfrared detection: Filter (optical)

Data Source

PatentUS8194149B2Infrared-aided depth estimation

Publication Date: 2012.06.05 CISCO TECHNOLOGY INC

AI summary

Systems and methods are disclosed for creating image maps. Some embodiments include a method comprising the steps of: capturing a first image illuminated by natural light and capturing a second image illuminated by infrared light. The second image may be captured at the same time as the first image. The R, G, and B values for each pixel in the first image may be determined. The intensity for each pixel in the first image may be calculated. An IR intensity for each pixel in the second image may be calculated. A depth value may then be estimated for each pixel using the ratio of the IR intensity and the intensity of corresponding pixels in the first and second images.