Dual-Camera 3D Sensing with Pattern Projection for Lower Power

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D image capture systems are power-hungry, making them inefficient for real-time and in-situ applications, and there is a need for methods that reduce power consumption while maintaining effective imaging capabilities.

Innovation Solution

A 3D sensing apparatus comprising two cameras, a projector, and processors that synchronize image capture and project a pre-defined pattern, utilizing methods for depth image production and power management to conserve energy, while ensuring eye safety and efficient projector operation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Use of energy by moving object

If current 3D image capture systems are used, then 3D imaging capability is achieved, but power consumption is excessive

Engineering Contradiction:
Improvepower consumptionVSAvoidimaging capability
Core Design Contradiction:
Use of energy by moving objectVSReliability

Solution Approach 1:

The system is divided into two separate cameras instead of using a single complex 3D imaging device. Each camera captures 2D images independently, and the 3D information is derived through image processing and correlation of the two views. This segmentation allows each camera to operate at lower power while maintaining overall 3D imaging capability.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The dual-camera system captures images at periodic intervals rather than continuously operating high-power 3D sensors. By taking snapshots at specific time points and processing them to generate 3D information, the system reduces average power consumption while still providing real-time 3D imaging capability when needed.

Inventive Principle:
Principle #19Periodic action

2Speed

If real-time 3D imaging is implemented, then imaging speed is improved, but power consumption increases

Engineering Contradiction:
Improveimaging speedVSAvoidpower consumption
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The system performs preliminary actions by capturing multiple 2D images from different angles in rapid succession before processing. The cameras take snapshots and store them temporarily, then the processor correlates these pre-captured images to generate 3D information. This approach allows real-time 3D output without requiring continuous high-power operation.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of using a single high-power 3D sensor, the system uses two lower-power cameras that create copies of the scene from different perspectives. These 2D image copies are then processed to reconstruct 3D information, achieving real-time imaging at reduced power consumption.

Inventive Principle:
Principle #26Copying

3Measurement precision

If in-situ 3D capture is performed, then measurement precision is improved, but device complexity increases

Engineering Contradiction:
Improvedepth accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The two cameras serve multiple functions: they capture 2D images for standard photography, capture stereo pairs for 3D imaging, and can be used for image processing and correlation to derive depth information. This multi-functionality allows the same simple camera components to achieve precise in-situ 3D measurement without requiring specialized complex 3D sensors.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution enables efficient 3D image capture with reduced power consumption, allowing for real-time and mobile applications, while maintaining image quality and ensuring safe operation of the projector.

Implementation Method 1

a projector of a pre-defined pattern

Methodology Applied
Scientific EffectLight: Light

Implementation Method 2

a photodiode positioned within the housing for monitoring emitted light

Methodology Applied
Scientific EffectPhotoelectric Effect: Photoelectric Effect

Data Source

PatentUS11770516B2Apparatus and methods for three-dimensional sensing
Publication Date: 2023.09.26 XRPRO LLC
  • US11770516B2 patent drawing
  • US11770516B2 patent drawing
  • US11770516B2 patent drawing

AI summary

A three-dimensional (3D) sensing apparatus together with a projector subassembly is provided. The 3D sensing apparatus includes two cameras, which may be configured to capture ultraviolet and/or near-infrared light. The 3D sensing apparatus may also contain an optical filter and one or more computing processors that signal a simultaneous capture using the two cameras and processing the captured images into depth. The projector subassembly of the 3D sensing apparatus includes a laser diode, one or optical elements, and a photodiode that are useable to enable 3D capture.