Depth Sensing With Fixed Coded Aperture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional depth sensing systems using optical pulses are costly and complex, especially for 3D volume reconstruction, due to the need for expensive spatial light modulators and multiple sensors, which are cumbersome and prone to failure in mobile applications.

Innovation Solution

A novel depth sensing system employing a fixed coded aperture, significantly reducing the number of required sensors by using a model-based compressive sensing framework that exploits low variation in depth scenes, allowing for real-time reconstruction with a single pulse transmission per frame and achieving frame-rates comparable to more expensive systems at a lower cost.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional depth sensing systems use multiple sensors and spatial light modulators for 3D volume reconstruction, then measurement precision and reconstruction quality are improved, but device complexity and cost increase significantly

Engineering Contradiction:
Improvedepth sensing precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent combines multiple sensing functions into a single sensor array by using a fixed coded aperture mask that modulates the optical path. Instead of using multiple spatial light modulators and sensors, the invention merges the coding and sensing functions into one integrated system where the fixed mask patterns enable compressive sensing with a single sensor array, dramatically reducing device complexity while maintaining depth sensing precision

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The invention extracts only the essential measurement information needed for depth reconstruction by using compressive sensing theory. Rather than capturing complete optical field information with multiple sensors, the system extracts sufficient depth data through sparse sampling enabled by the fixed coded aperture, reducing the number of sensors required while preserving measurement precision

Inventive Principle:
Principle #2Taking out (Extraction)

2Measurement precision

If conventional systems use spatial light modulators and multiple sensors, then reconstruction quality is improved, but reliability decreases due to more components prone to failure

Engineering Contradiction:
Improvereconstruction qualityVSAvoidsystem reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

By merging multiple sensing components into a single sensor array with a fixed coded aperture, the invention reduces the number of potential failure points. The fixed mask is a passive, robust component with no moving parts or active elements that could fail, while the single sensor array eliminates the need for multiple synchronized sensors and spatial light modulators, thereby improving reliability while maintaining reconstruction quality through compressive sensing algorithms

Inventive Principle:
Principle #5Merging (Combining)

3Measurement precision

If conventional depth sensing systems use expensive sensor arrays and spatial light modulators, then measurement precision is improved, but manufacturing cost increases

Engineering Contradiction:
Improvesensing qualityVSAvoidmanufacturing cost
Core Design Contradiction:
Measurement precisionVSEase of manufacture

Solution Approach 1:

The invention extracts the essential depth information using compressive sensing, requiring far fewer sensors than conventional systems. This extraction approach allows the use of simpler, less expensive sensor arrays while achieving the same measurement precision through intelligent sampling and reconstruction algorithms enabled by the fixed coded aperture

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The fixed coded aperture mask can be implemented as a simple, inexpensive optical element such as a printed or etched pattern on a transparent substrate. This disposable or easily replaceable component replaces expensive spatial light modulators and complex sensor arrays, dramatically reducing manufacturing cost while maintaining sensing quality through the compressive sensing measurement model

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The system reduces sensor requirements by over 85% while maintaining sensing quality, enabling cost-effective and efficient 3D depth map reconstruction with negligible impact on performance.

Implementation Method 1

depth sensing using optical pulses

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS9638801B2Depth sensing using optical pulses and fixed coded aperature
Publication Date: 2017.05.02 MITSUBISHI ELECTRIC RESEARCH LABORATORIES INC
  • US9638801B2 patent drawing
  • US9638801B2 patent drawing
  • US9638801B2 patent drawing

AI summary

In a system and method for reconstructing a scene, a light source transmits an optical pulse unto the scene, and a set of sensors receive a reflected pulse to acquire sensed signals corresponding to the optical pulse. There is a fixed coded aperture in an optical path between the light source and set of sensors. Then, a processor performs a method to reconstruct the scene as a three-dimensional (3D) depth map using a scene model.