Hybrid Binocular Structured Light Depth Sensor

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for obtaining depth information, such as binocular, structured light, and Time of Flight manners, face limitations in measuring distances beyond a certain range due to interference from outdoor light sources or structural dead zones, preventing the acquisition of full depth information for target objects.

Innovation Solution

A photographing device combining a binocular and structured light manner using a first image sensor with both infrared and visible light sensing pixels, and an infrared light source, where the processor switches between methods based on distance to ensure depth information is obtained across a wide range, from millimeters to tens of meters.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the structured light manner is used to obtain depth information, then depth information can be obtained for close objects, but depth information cannot be obtained for distant objects due to outdoor light interference

Engineering Contradiction:
Improvedepth information acquisition capabilityVSAvoideffective distance range
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent combines the structured light manner and binocular manner into a unified depth acquisition system. The processor selectively switches between the two methods based on the measured distance: using structured light for close objects (within effective distance) and binocular vision for distant objects (beyond effective distance), thereby resolving the contradiction between measurement precision and adaptability across different distance ranges

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system changes the operating mode parameter based on distance conditions. When the distance is within the effective range of structured light, the system uses structured light mode; when the distance exceeds the effective range, it switches to binocular mode. This dynamic parameter change allows the system to maintain high measurement precision across varying distance conditions

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If the binocular manner is used to obtain depth information, then depth information can be obtained for distant objects, but depth information cannot be obtained for close objects due to blind distance limitations

Engineering Contradiction:
Improvedepth information acquisition capabilityVSAvoideffective distance range
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent merges the binocular manner and structured light manner into a complementary system where each method covers the other's limitations. The structured light component fills the blind distance gap of binocular vision for close objects, while binocular vision extends the effective range for distant objects, achieving full-distance depth coverage

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The processor acts as an intermediary that mediates between the two depth acquisition methods. It measures the distance to the target object and determines which method is appropriate, switching between structured light and binocular modes to ensure continuous depth information acquisition across all distance ranges

Inventive Principle:
Principle #24Intermediary (Mediator)

3Device complexity

If only one depth acquisition method is used, then the device structure is simple, but depth information cannot be obtained across all distance ranges

Engineering Contradiction:
Improvesystem structureVSAvoideffective distance range
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The photographing device achieves multi-functionality by integrating both structured light and binocular depth acquisition capabilities into a single system. The first image sensor captures both infrared light images and visible light images, enabling the device to perform both structured light and binocular depth measurement functions, thereby expanding the effective distance range while maintaining reasonable device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This combination avoids the limitations of structured light and binocular methods, enabling the acquisition of full depth information for objects at various distances, including those previously inaccessible due to outdoor light interference or structural dead zones.

Implementation Method 1

the first image sensor is configured to acquire an infrared light image and a visible light image

Methodology Applied
Scientific EffectInfrared detection: Infrared Radiation

Implementation Method 2

the first image sensor includes M infrared light sensing pixels and N visible light sensing pixels

Methodology Applied
Scientific EffectVisible light detection: Photoelectric Effect

Implementation Method 3

the infrared light source is configured to project a particular pattern to a target object

Methodology Applied
Scientific EffectInfrared light emission: Infrared Radiation

Data Source

PatentUS10560686B2Photographing device and method for obtaining depth information
Publication Date: 2020.02.11 HUAWEI TECH CO LTD
  • US10560686B2 patent drawing
  • US10560686B2 patent drawing
  • US10560686B2 patent drawing

AI summary

A photographing device and a method are provided for obtaining depth information, where a binocular manner and a structured light manner are combined, and full depth information of a target object can be obtained. The method may include: obtaining, when a distance between a target object and a photographing device is greater than an effective distance of a structured light manner, depth information of the target object by using a binocular manner; and obtaining, when the distance between the target object and the photographing device is less than an effective distance of the binocular manner, the depth information of the target object by using the structured light manner.