Camera Focus Adjustment Using Viewfinder Depth Maps

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for improving image and video capture in electronic devices, such as mobile phones, fail to provide fast, accurate, and efficient image/video captures, especially in low-light conditions and maintain continuous autofocus in burst images.

Innovation Solution

A method involving the receipt of a viewfinder depth map to select objects based on depth information, adjusting camera focus accordingly, and generating images by shifting image portions based on depth changes between depth maps, allowing for efficient and accurate image/video capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If focal stack capture is used to improve image quality, then manufacturing precision is improved, but loss of time increases

Engineering Contradiction:
Improveimage qualityVSAvoidcapture time
Core Design Contradiction:
Manufacturing precisionVSLoss of time

Solution Approach 1:

The system performs preliminary depth estimation using a depth map before actual image capture. This preliminary action identifies the depth range of interest, allowing the camera to pre-calculate and prepare the specific focal stack range needed, avoiding unnecessary captures across the entire focal range and thus reducing capture time while maintaining image quality.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the parameter of focal stack range from a fixed full-range capture to a dynamically adjusted range based on depth map information. By modifying the focal stack parameters (start and end focal positions) according to the estimated depth range, the system captures only the necessary focal positions, reducing the number of captures required while preserving image quality for objects of interest.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If traditional autofocus methods are used, then ease of operation is maintained, but measurement precision deteriorates

Engineering Contradiction:
Improvefocus accuracyVSAvoidoperation complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system introduces a depth map as an intermediary between the scene and the autofocus mechanism. The depth map provides intermediate depth information that guides the autofocus process, enabling more accurate focus determination without requiring complex manual intervention. This intermediary layer automates the precision-focused tasks while keeping the user interface simple.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system implements feedback by using depth map information to continuously adjust and refine focus decisions. The depth estimates provide feedback about object distances, allowing the autofocus system to make precise adjustments automatically. This feedback loop maintains high measurement precision while keeping operation simple for the user.

Inventive Principle:
Principle #23Feedback

3Productivity

If depth-based focal stack capture is implemented, then productivity is improved, but device complexity increases

Engineering Contradiction:
Improvecapture efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system replaces mechanical focus adjustment mechanisms with computational depth estimation. Instead of relying solely on mechanical focal stack capture across all positions, the system uses depth map computation to determine which focal positions are necessary, substituting mechanical brute-force scanning with intelligent computational selection. This improves productivity while managing device complexity through software-based solutions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system achieves multi-functionality by using the depth map for multiple purposes: guiding focal stack capture, determining focus ranges, and optimizing capture parameters. This single depth estimation component serves multiple functions that would otherwise require separate systems, improving productivity without proportionally increasing device complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS10091409B2Improving focus in image and video capture using depth maps
Publication Date: 2018.10.02 NOKIA TECHNOLOGIES OY
  • US10091409B2 patent drawing
  • US10091409B2 patent drawing
  • US10091409B2 patent drawing

AI summary

In an example embodiment, method, apparatus and computer program product for improving image and video captures using depth maps of viewfinder depth map, are provided. The method includes facilitating receipt of a viewfinder depth map of a scene, the viewfinder depth map comprising depth information of a plurality of objects in the scene. One or more objects are selected from the plurality of objects based on depth information of the one or more objects in the viewfinder depth map. Two or more images of the scene are facilitated to be captured by at least adjusting focus of a camera corresponding to the depth information of the one or more objects that are selected. In an example, a method also includes facilitating capture of an image of the scene by at least adjusting focus of a camera corresponding to the depth information of the two or more objects that are selected.