Single Sensor Depth of Field Adjustment via Time of Flight
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional image capture devices require complex multi-camera setups and post-processing techniques to achieve depth of field adjustments, leading to artifacts and increased computational and hardware costs.
Innovation Solution
An image capturing apparatus that uses a single image sensor acting as both a time of flight system and image sensor to generate depth maps, allowing for depth of field adjustments without additional post-processing, by calculating the time of flight of light signals and adjusting the aperture and lens position to focus on specific regions of interest.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a multi-camera setup with separate TOF system and image sensor is used, then depth of field parameters can be determined, but device complexity and hardware requirements increase
Solution Approach 1:
The patent combines the TOF system and image sensor into a single integrated device, where one image sensor performs both TOF measurements and standard image capture functions. This merging eliminates the need for separate multi-camera setups while maintaining the capability to determine depth of field parameters through TOF data acquisition and processing.
Solution Approach 2:
The single image sensor is designed to perform multiple functions: it acts as both a standard image sensor for capturing visual information and a TOF sensor for measuring depth information. This multi-functionality allows the device to obtain depth of field parameters without requiring additional specialized hardware, thereby reducing device complexity.
2Manufacturing precision
If post-processing techniques are applied to add depth of field to images, then depth of field can be achieved, but artifacts are introduced due to incorrect estimation of plane of focus
Solution Approach 1:
The patent performs TOF measurements and determines the plane of focus before final image capture and processing. By pre-determining accurate depth information through TOF data, the system establishes correct focus parameters in advance, which guides subsequent image processing steps and prevents incorrect plane of focus estimation that would lead to artifacts.
Solution Approach 2:
The system uses TOF depth data as feedback to continuously refine and adjust the plane of focus estimation during image capture. The depth information from the TOF system provides real-time feedback that corrects and validates the focus settings, ensuring accurate depth of field rendering without introducing artifacts from incorrect focus plane determination.
3Measurement precision
If multi-camera setup with separate TOF system is used, then depth of field can be determined, but computational cost increases
Solution Approach 1:
By merging the TOF system and image sensor into a single integrated device, the patent reduces the overall computational burden. The single sensor architecture allows for more efficient data correlation between depth and image information, eliminating the need for complex multi-camera data fusion algorithms and reducing computational cost while maintaining depth of field determination accuracy.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This solution provides cost-effective, space-saving, and modular depth of field adjustments, eliminating the need for multi-camera setups and reducing artifacts, while ensuring sharp focus on specific objects while keeping others blurry.
Implementation Method 1
calculating a time of flight of a set of light signals emitted towards a plurality of objects in a scene
Implementation Method 2
a set of received light signals that corresponds to a reflection of the emitted light signals from the surfaces of the plurality of objects
Data Source
AI summary
An image capturing apparatus and a method for depth of filed (DOF) adjustment in images based on time of flight (TOF) depth maps is provided. The image capturing apparatus includes an image sensor and circuitry. The circuitry generates a TOF depth map of a scene that includes a plurality of objects. The TOF depth map includes information associated with distances between the image sensor and surfaces of the plurality of objects. The circuitry divides the TOF depth map into a plurality of regions that corresponds to at least one object of the plurality of objects. The circuitry determines a region of interest from the plurality of regions and adjusts the DOF of the at least one object associated with the determined region of interest. The circuitry further controls the image sensor to capture an image of the scene based on the adjusted DOF.