Foreign Substance Detection in Depth Sensing Optical Components

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Depth sensing technologies, such as time-of-flight cameras in head-mounted display devices, face accuracy issues due to foreign substances like dust or fingerprints on optical components, causing light scattering and distortion in depth maps.

Innovation Solution

A processor-based system in the depth imaging device detects blurred depth maps by identifying excessive intermediate depth pixels or gradient ramps, generated due to light scattering from foreign substances on optical components, and alerts the user or triggers cleaning mechanisms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Duration of action of stationary object

If foreign substances adhere to optical components during normal use, then the depth sensing system continues to operate, but the accuracy of depth measurements decreases due to light scattering and distortion

Engineering Contradiction:
Improvecontinuous operation of depth sensing systemVSAvoidaccuracy of depth measurements
Core Design Contradiction:
Duration of action of stationary objectVSMeasurement precision

Solution Approach 1:

The system performs preliminary detection of foreign substances on optical components by analyzing depth map characteristics (intermediate depth pixels, gradient ramps) before they significantly degrade measurement accuracy. This early detection enables preventive cleaning actions to maintain measurement precision while allowing continuous operation.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the system continuously monitors depth maps for foreign substance detection, then detection accuracy improves, but processing time and computational complexity increase

Engineering Contradiction:
Improvedetection accuracy of foreign substancesVSAvoidprocessing time for depth map analysis
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system applies localized analysis techniques by focusing computational resources on specific regions of the depth map where foreign substances are most likely to appear (e.g., boundaries between foreground and background). By analyzing gradient ramps and intermediate depth pixels only in critical regions rather than the entire depth map, the system maintains high detection accuracy while reducing overall processing time.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If the system generates user alerts for foreign substance presence, then measurement accuracy is maintained through timely cleaning, but device complexity increases

Engineering Contradiction:
Improvemaintenance of depth measurement accuracyVSAvoidcomplexity of detection and alerting system
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system implements self-service by automatically detecting foreign substances through analysis of depth map characteristics and generating user alerts without requiring external monitoring equipment. The depth sensing system itself serves dual purposes: both capturing depth information and detecting contamination on its own optical components, thereby maintaining measurement accuracy through timely user intervention without significantly increasing device complexity.

Inventive Principle:
Principle #25Self-service

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system effectively identifies and alerts users to foreign substances on optical components, maintaining accurate depth measurements and preventing distortion in depth maps, thereby enhancing object segmentation and tracking applications.

Implementation Method 1

an image sensor to receive through an optical component the light reflected by an environment of the depth imaging device

Methodology Applied
Scientific EffectLight reflection: Reflection

Implementation Method 2

Any foreign substance on the optical components can decrease accuracy of the depth measurements by causing scattering of the light and therefore distortion of the depth map

Methodology Applied
Scientific EffectLight scattering: Scattering

Data Source

PatentUS10192147B2Foreign substance detection in a depth sensing system
Publication Date: 2019.01.29 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10192147B2 patent drawing
  • US10192147B2 patent drawing
  • US10192147B2 patent drawing

AI summary

Disclosed are an apparatus and a method for detection of foreign substances in a depth sensing system. In one embodiment, a depth sensing device includes a light source to emit light, an image sensor and a processor. The image sensor receives through an optical component the light reflected by environment of the depth sensing device. The image sensor further generates a depth map including a plurality of pixel values corresponding to distances between the depth sensing device and the environment. The processor detects a blurred portion of the depth map due to a presence of a foreign substance on the optical component. The processor may further cause outputting a user alert of the presence of the foreign substance on the optical component.