Depth Imaging Device Blind Zone Reduction via Dual System Switching

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current depth imaging devices have a 'blind zone' in their field of vision, where they cannot determine the distance of objects, and this limitation affects safety, especially in power-constrained systems like unmanned aerial vehicles and sweeping robots, where energy efficiency is crucial.

Innovation Solution

A depth imaging device with two depth imaging systems and a control unit that adjusts which system is active based on confidence values and distance thresholds, allowing the device to switch between binocular vision and structured light methods to minimize the blind zone and conserve power.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a single depth imaging system is used, then the system structure is simple and power consumption is low, but a blind zone exists in the field of vision where distance cannot be determined

Engineering Contradiction:
Improvedistance measurement coverageVSAvoidsystem structure
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The depth imaging system is segmented into two distinct subsystems: a first depth imaging system using binocular vision for distant objects, and a second depth imaging system using structured light for close-range objects. Each subsystem has its own camera and processing path, allowing them to operate independently and cover different spatial ranges, thereby eliminating the blind zone while maintaining manageable complexity through modular architecture.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system dynamically switches between the first and second depth imaging systems based on detected object distance and confidence values. The control unit monitors measurement confidence and automatically activates the appropriate subsystem, making the system adaptive to different operating conditions and eliminating the need for a fixed complex multi-system configuration.

Inventive Principle:
Principle #15Dynamics

2Reliability

If both depth imaging systems operate simultaneously, then the blind zone is eliminated, but power consumption increases significantly

Engineering Contradiction:
Improvedistance measurement coverageVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system employs periodic action by sequentially activating depth imaging systems only when needed. The control unit periodically evaluates confidence values from the active system and switches to the other system when confidence thresholds are not met, rather than keeping both systems continuously operational. This periodic switching ensures complete coverage while minimizing average power consumption.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The depth imaging system performs self-service through automatic switching based on confidence value evaluation. The control unit autonomously determines when to switch between systems without external intervention, using the confidence metrics from depth maps to self-regulate system operation and optimize power usage based on actual measurement needs.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If the second depth imaging system is activated to cover close-range blind zone, then measurement accuracy improves, but power consumption increases

Engineering Contradiction:
Improveclose-range depth measurementVSAvoidpower consumption
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The system changes operational parameters by switching between different depth imaging modes based on object distance parameters. When close-range objects are detected or confidence values indicate measurement uncertainty, the system activates the structured light system with its optimized baseline and projection parameters. This parameter-based switching ensures high measurement precision for close objects while avoiding unnecessary power consumption when the first system suffices.

Inventive Principle:
Principle #35Parameter changes

4Reliability

If confidence threshold is set low, then system switches frequently ensuring coverage, but power consumption increases due to frequent switching

Engineering Contradiction:
Improvemeasurement confidenceVSAvoidpower consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The system implements feedback control by continuously monitoring confidence values from depth maps and using this information to determine when switching between systems is necessary. The control unit compares confidence values against thresholds and only activates the second system when the first system's confidence is insufficient, creating a feedback loop that optimizes switching frequency and reduces unnecessary power consumption while maintaining measurement reliability.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The solution effectively reduces the visual blind zone and achieves a power-saving effect by dynamically switching between depth imaging systems, ensuring accurate distance measurement and optimizing energy usage.

Implementation Method 1

The binocular vision refers to that the parallax generated by two eyes is used for measuring a three-dimensional structure of an object through a triangulation measurement

Methodology Applied
Scientific EffectParallax: Parallax

Implementation Method 2

The structured light is to project a patterned light surface to an object, where light patterns with different depths may be deformed

Methodology Applied
Scientific EffectStructured light:

Implementation Method 3

project a patterned light surface to an object, where light patterns with different depths may be deformed

Methodology Applied
Scientific EffectLight reflection: Reflection

Data Source

PatentUS10516873B2Depth imaging device and driving method thereof
Publication Date: 2019.12.24 LITE ON ELECTRONICS (GUANGZHOU) LTD
  • US10516873B2 patent drawing
  • US10516873B2 patent drawing
  • US10516873B2 patent drawing

AI summary

A depth imaging device is provided. A first camera and a second camera form a first depth imaging system. A projection element and a second camera form a second depth imaging system. The control unit is configured to instruct one of the first and second depth imaging systems to acquire a depth map and a confidence map, and determine whether each of confidence values in the confidence map is less than a confidence threshold value. If each of the confidence values is less than the confidence threshold value, then the control unit turns on the other of the first and second depth imaging systems. If at least one of the confidence values is not less the confidence threshold value, then the control unit determines whether a closest distance in the depth map falls within a predetermined range or not. A driving method of a depth imaging device is also provided.