Camera Exposure Control Using Depth Information

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing camera exposure control techniques fail to achieve optimal exposure, particularly when prioritizing the foreground object in a scene, as they lack the ability to effectively manage dynamic range and prioritize exposure based on depth information.

Innovation Solution

A system and method that utilize depth information to control exposure by determining the distance of objects in a scene and adjusting exposure data, such as histogram data, to prioritize exposure for the foreground object, employing cameras like array, stereoscopic, or time-of-flight cameras to ensure optimal image capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional exposure control techniques are used, then exposure is calculated based on average scene brightness, but optimal exposure for foreground objects cannot be achieved

Engineering Contradiction:
Improveexposure measurement accuracyVSAvoidexposure control reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the image into multiple depth layers using depth information, separating foreground objects from background. This allows independent exposure calculation for each depth layer, with priority given to the foreground layer, thereby achieving precise exposure control for specific regions rather than relying on average scene brightness.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies different exposure characteristics to different spatial regions based on depth information. The foreground region receives optimized exposure parameters while the background region uses different parameters, enabling local optimization of exposure quality rather than uniform exposure across the entire scene.

Inventive Principle:
Principle #3Local quality

2Reliability

If exposure is optimized for the foreground object, then foreground exposure adequacy is improved, but background exposure management becomes more complex

Engineering Contradiction:
Improveforeground exposure adequacyVSAvoidexposure control system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent performs preliminary depth map generation and foreground object identification before exposure calculation. By pre-segmenting the scene into foreground and background regions based on depth information, the system simplifies subsequent exposure calculations by focusing computational resources on the priority foreground region while applying simplified rules to the background.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent introduces depth information and depth maps as intermediary data structures that bridge the gap between raw image data and exposure control decisions. These intermediaries enable the system to automatically distinguish foreground from background and apply appropriate exposure strategies without requiring complex manual intervention.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If depth information is utilized for exposure control, then exposure prioritization based on distance is achieved, but additional processing requirements increase

Engineering Contradiction:
Improveexposure prioritization capabilityVSAvoidprocessing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent employs a universal depth map generation approach that can be applied across different camera types (single-camera, multi-camera arrays, stereoscopic cameras). The same depth-based exposure control methodology works universally for various scene types and camera configurations, reducing the need for specialized processing pipelines for different scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS9918015B2Exposure control using depth information
Publication Date: 2018.03.13 SONY GROUP CORP
  • US9918015B2 patent drawing
  • US9918015B2 patent drawing
  • US9918015B2 patent drawing

AI summary

The invention is directed to exposure control in a camera. An exemplary method comprises determining depth information associated with a portion of an image frame; obtaining exposure data associated with the portion of the image frame; and controlling an amount of exposure for the portion of the image frame based on the depth information and the exposure data.