Monocular Camera Depth Map Generation via Focus Variation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Monocular cameras struggle to extract depth information effectively for video monitoring scenes, limiting the development of robust video content analysis systems, as existing methods are costly and complex, especially when scanning entire scenes for 3-D information.

Innovation Solution

A method that generates a depth map by varying the focus settings of a camera to capture multiple partial regions within the monitoring scene, using image gradients to select and stitch together depth information, allowing for accurate depth estimation and interpolation, particularly effective for detecting objects and obstacles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the entire capturing region is scanned to generate depth information, then complete 3-D coverage is achieved, but the complexity and cost increase significantly

Engineering Contradiction:
Improvedepth information accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The capturing region is divided into multiple partial regions (tiles), and depth information is generated separately for each partial region by aiming the camera at different locations. This segmentation approach reduces the complexity of processing the entire scene while maintaining comprehensive depth coverage through systematic division and combination of partial depth maps.

Inventive Principle:
Principle #1Segmentation

2Loss of information

If focus settings are varied across the entire capturing region, then depth information can be extracted, but the time and resources required increase

Engineering Contradiction:
Improvedepth information completenessVSAvoiddepth map generation time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The capturing region is divided into multiple partial regions that are processed separately. By varying focus settings only within each partial region rather than the entire capturing region, the time and computational resources required for depth map generation are significantly reduced while still achieving complete depth information coverage.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of processing the entire capturing region uniformly, the method applies focus variation only to specific partial regions at a time. This partial action approach reduces the overall processing time and resource consumption while maintaining the completeness of depth information through systematic coverage of all partial regions.

Inventive Principle:
Principle #16Partial or excessive action

3Device complexity

If a monocular camera is used for video monitoring, then system simplicity is maintained, but depth information extraction becomes difficult

Engineering Contradiction:
Improvecamera system complexityVSAvoiddepth information quality
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The monocular camera is made dynamic by varying its focus settings and aiming directions to different partial regions. This dynamic operation allows a simple monocular camera to extract depth information through temporal variations in focus and orientation, eliminating the need for complex multi-camera or active sensing systems.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The method changes the focus parameter and aiming angle parameter of the monocular camera to extract depth information. By systematically varying these parameters across different partial regions and combining the results, a simple monocular camera achieves depth mapping capability without requiring complex hardware modifications.

Inventive Principle:
Principle #35Parameter changes

4Adaptability or versatility

If PTZ cameras are used to observe different regions, then monitoring flexibility improves, but the system complexity increases

Engineering Contradiction:
Improvemonitoring flexibilityVSAvoidcamera system complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The PTZ camera's pan, tilt, and zoom capabilities are dynamically utilized to aim at different partial regions during depth map generation. This dynamic positioning allows flexible observation of multiple regions while maintaining a single camera system, achieving monitoring versatility without the complexity of multiple fixed cameras.

Inventive Principle:
Principle #15Dynamics

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables the generation of accurate depth maps with reduced costs and complexity, enhancing object tracking and video content analysis, and providing valuable 3-D information for improved monitoring and security applications, applicable to existing camera systems.

Implementation Method 1

For each of the partial regions, a depth information item is ascertained from the respective partial region by varying a focus setting of the camera

Methodology Applied
Scientific EffectFocus setting variation: Focusing

Data Source

PatentUS10237535B2Method for generating a depth map using a camera
Publication Date: 2019.03.19 ROBERT BOSCH GMBH
  • US10237535B2 patent drawing
  • US10237535B2 patent drawing
  • US10237535B2 patent drawing

AI summary

A method for generating a depth map of at least one selected region (210) of a capturing region (200) of a camera (100), wherein the camera (100) is aimed at a plurality of mutually different partial regions (220, 221, 222) of the at least one selected region (210), wherein for each of the partial regions (220, 221, 222) a depth information item is ascertained from the respective partial region (220, 221, 222) by varying a focus setting of the camera (100), and wherein the depth map (400) is generated taking into account the depth information of the partial regions (220, 221, 222), and to such a camera (100).