Bokeh Control Using Time-of-Flight Sensor Distance Estimation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Photographers face challenges in achieving a visually pleasing bokeh effect due to the need for manual adjustment of camera settings such as focus distance and aperture size, which often requires trial and error, even for experienced photographers.

Innovation Solution

A method and device utilizing a time-of-flight sensor to estimate the minimum and maximum distances to a target object, allowing for automatic adjustment of camera focus distance and aperture settings to achieve a good bokeh effect by determining the depth of field.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If manual adjustment of camera settings is used to achieve bokeh effect, then image quality can be improved, but operation complexity and time consumption increase

Engineering Contradiction:
Improveimage qualityVSAvoidoperation complexity
Core Design Contradiction:
Manufacturing precisionVSEase of operation

Solution Approach 1:

The camera system automatically determines focus distance and aperture settings using TOF sensor data without requiring manual intervention. The system serves itself by autonomously calculating the depth of field parameters and adjusting the camera settings to achieve optimal bokeh effect, thereby improving ease of operation while maintaining image quality

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical adjustment system with an automated optical-mechanical system. The TOF sensor and processing circuitry substitute for manual operator intervention, using time-of-flight measurements to automatically determine the focus distance and aperture settings that would otherwise require manual trial and error adjustment

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Manufacturing precision

If manual trial and error adjustment is used to achieve bokeh effect, then optimal settings can be found, but time consumption increases

Engineering Contradiction:
Improvefocus accuracyVSAvoidtime consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The TOF sensor performs preliminary distance measurement before the actual image capture. By determining the focus distance and aperture settings in advance based on the measured distance to the target object, the system eliminates the need for time-consuming trial and error adjustments during the photography process

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from the TOF sensor's distance measurements to automatically adjust the camera settings. The processing circuitry receives the measured distance information and uses it to determine the appropriate focus distance and aperture settings, creating a closed-loop system that quickly achieves optimal bokeh effect without manual iteration

Inventive Principle:
Principle #23Feedback

3Extent of automation

If TOF sensor is used to estimate distances, then automation is improved, but device complexity increases

Engineering Contradiction:
Improveautomatic setting controlVSAvoidsystem complexity
Core Design Contradiction:
Extent of automationVSDevice complexity

Solution Approach 1:

The TOF sensor serves multiple functions within the camera system: it measures the distance to the target object, provides data for focus distance determination, and enables aperture setting calculation. This multi-functionality justifies the added device complexity by enabling comprehensive automatic bokeh control without requiring separate components for each measurement function

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines the TOF sensor, processing circuitry, and camera control into an integrated system. The distance measurement function is merged with the autofocus and aperture control functions, allowing the system to achieve automatic bokeh effect with a unified device architecture rather than separate independent systems

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Automatically determines optimal camera settings for a good bokeh effect, reducing the need for manual adjustments and improving image quality by accurately capturing the target object in sharp focus while blurring the background.

Implementation Method 1

time-of-flight sensor device, in operation, transmits an optical pulse signal into an image scene and receives return optical pulse signals corresponding to portions of the transmitted optical pulse signal reflected by one or more objects in the image scene

Methodology Applied
Scientific EffectTime of flight: Time of Flight

Data Source

PatentUS10877238B2Bokeh control utilizing time-of-flight sensor to estimate distances to an object
Publication Date: 2020.12.29 STMICROELECTRONICS BEIJING R& D
  • US10877238B2 patent drawing
  • US10877238B2 patent drawing
  • US10877238B2 patent drawing

AI summary

Embodiments are directed to devices and methods including a time-of-flight sensor and a camera. In one embodiment, a device is provided that includes a time-of-flight sensor, distance estimation circuitry, a camera, and processing circuitry. The time-of-flight sensor transmits an optical pulse signal and receives return optical pulse signals corresponding to portions of the transmitted optical pulse signal reflected by an object. The distance estimation circuitry estimates a minimum distance to the object based on a time between transmitting the optical pulse signal and receiving a first portion of the return optical pulse signals, and estimates a maximum distance to the object based on a time between transmitting the optical pulse signal and receiving a second portion of the return optical pulse signals. The processing circuitry controls a focus distance and an aperture setting of the camera based on the estimated minimum and maximum distances to the object.