Camera Defocus Direction Estimation via Frequency Domain Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for determining the direction of defocus in digital cameras are ambiguous, as the same distance in depth of field in front or behind the focus plane results in similar defocus blur, making it difficult to determine whether an object is in front or behind the focus plane.

Innovation Solution

The solution involves performing a frequency domain analysis of the camera's point spread functions (PSFs) in the captured image, evaluating differences in these functions relative to training images to estimate feature distributions, and applying statistical methods to determine if the image was taken in front or behind the focus plane.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If defocus blur estimation is used to determine distance from the focus plane, then the distance in units of depth of field can be known, but the direction of defocus (in front or behind the focus plane) remains ambiguous

Engineering Contradiction:
Improvedistance estimation accuracyVSAvoiddefocus direction information
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent transforms the defocus analysis from spatial domain to frequency domain using Fourier transform. By analyzing the frequency characteristics of the point spread function, the system extracts defocus direction information that is not apparent in the spatial domain, effectively adding a new dimension of analysis to resolve the ambiguity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent changes the parameter space by evaluating the point spread function at multiple radial frequencies. By examining how the frequency response varies with radius, the system can distinguish between defocus in front of versus behind the focus plane, transforming a single-parameter problem into a multi-parameter analysis.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If traditional defocus estimation methods are used, then processing can be simple, but the ability to determine defocus direction is lost

Engineering Contradiction:
Improveprocessing complexityVSAvoiddefocus direction determination
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent replaces complex optical mechanisms (such as multiple lenses or moving parts) with a computational approach. By using frequency domain analysis and statistical evaluation of the point spread function, the system achieves defocus direction determination through software processing rather than additional hardware complexity.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If multiple images or complex mechanisms are used to determine defocus direction, then accuracy may improve, but processing time and system complexity increase

Engineering Contradiction:
Improvedefocus direction accuracyVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent extracts only the essential frequency domain characteristics needed for defocus direction determination from the point spread function. By focusing on specific radial frequency components and their statistical properties, the system avoids processing the entire image data, reducing computation time while maintaining accuracy.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent uses training images to pre-establish the statistical distributions of frequency domain features for different defocus directions. This preliminary characterization allows the system to quickly classify new images by comparing their features against the pre-computed distributions, significantly reducing real-time processing requirements.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS9214011B2Camera defocus direction estimation
Publication Date: 2015.12.15 SONY GROUP CORP
  • US9214011B2 patent drawing
  • US9214011B2 patent drawing
  • US9214011B2 patent drawing

AI summary

Apparatus and methods for estimating defocus direction from a single image obtained, such as in a digital camera apparatus, are presented. To determine defocus direction, point spread function (PSF) differences for the image are evaluated in the frequency domain, with frequency pairs being found having largest difference in their Fourier transform magnitudes, from which a direction estimate feature is extracted, and defocus direction estimated based on relation of estimated feature and statistics derived from camera image tests. The method can be applied for controlling autofocus mechanisms in cameras, or other applications requiring rapid determination of defocus directions, such as from a single image.