Single Camera Depth Map Generation via Image Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current 3D depth mapping devices are limited to single applications and require multiple cameras or camera arrays, which increase device volume and complexity, and struggle with determining depth from a single image effectively, especially when objects move quickly.

Innovation Solution

A single camera module with fixed near-field focus captures images, segments them into regions, determines focus metrics, and generates depth maps by mapping these metrics to depth values, allowing for object tracking and gesture recognition.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If multiple cameras or camera arrays are used to determine depth, then measurement precision is improved, but device complexity and volume increase

Engineering Contradiction:
Improvedepth measurement precisionVSAvoidcamera system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the image into multiple regions of interest and calculates focus metrics for each region independently. This allows depth information to be extracted from a single camera by analyzing different spatial segments, achieving depth measurement precision comparable to multi-camera systems without the hardware complexity

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameter being measured from multiple camera positions to focus metric values within a single camera image. By using focus metrics (such as variance, gradient, or Laplacian) as a proxy for depth, the system achieves depth measurement capability from a single sensor, resolving the contradiction between measurement precision and device complexity

Inventive Principle:
Principle #35Parameter changes

2Manufacturing precision

If multiple cameras or camera arrays are used to determine depth, then depth mapping accuracy is improved, but device volume increases

Engineering Contradiction:
Improvedepth map accuracyVSAvoiddevice volume
Core Design Contradiction:
Manufacturing precisionVSVolume of stationary object

Solution Approach 1:

The image is divided into multiple regions of interest, and depth is calculated for each region using focus metrics. This segmentation approach enables accurate depth mapping across the entire scene using only a single camera, avoiding the need for multiple cameras that would increase device volume

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates a depth map (a copy of spatial information) from focus metric data obtained from a single camera image. This computational copying of depth information replaces the need for physical multiple-camera copies, maintaining depth map accuracy while minimizing device volume

Inventive Principle:
Principle #26Copying

3Productivity

If focus metrics are calculated for multiple regions from a single image, then depth map generation speed is improved, but processing complexity increases

Engineering Contradiction:
Improvedepth map generation speedVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the image into regions of interest and calculates focus metrics for each segment in parallel. This segmentation enables efficient depth map generation by distributing the computational workload across multiple regions, improving processing throughput while managing complexity through modular region-based analysis

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables efficient generation of depth maps from a single image, reducing hardware and processing requirements, and effectively tracks objects and recognizes gestures for various applications, such as automotive environments.

Implementation Method 1

a single camera module with a fixed near field focus configured to capture a single image

Methodology Applied
Scientific EffectOptical focusing: Focusing

Implementation Method 2

an image divider configured to segment the image into a plurality of regions

Methodology Applied
Scientific EffectImage segmentation: Image Processing

Implementation Method 3

a focus metric determiner configured to determine a focus metric for each of the plurality of regions

Methodology Applied
Scientific EffectFocus metric measurement: Depth of Field

Implementation Method 4

a depth map generator configured to map the focus metric into a depth value for each of the plurality of regions and combine the plurality of depth values to generate a depth map

Methodology Applied
Scientific EffectFocus-depth relationship: Depth of Field

Data Source

PatentUS10839537B2Depth maps generated from a single sensor
Publication Date: 2020.11.17 STMICROELECTRONICS (RES & DEV) LTD
  • US10839537B2 patent drawing
  • US10839537B2 patent drawing
  • US10839537B2 patent drawing

AI summary

A camera module with a fixed near field focus is configured to capture a single image. That single image is segmented by an image divider a number of regions. A focus metric determiner then determines a focus metric for each of the regions. A depth map generator maps the focus metric into a depth value for each of the regions and combines the depth values to generate a depth map.