Autofocus Using Out-of-Focus Face Detection Classifiers

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional auto focus mechanisms in digital cameras, such as contrast detect and phase detect, are either slow or prone to focus hunting, and face detection methods often fail to detect blurry or out-of-focus faces, leading to unsatisfactory image capture processes.

Innovation Solution

A method utilizing trained classifiers for out-of-focus face detection, determining face size to calculate focus depth, and adjusting lens positions for precise focusing, combined with MEMS technology for fast and reliable tracking, reduces focus hunting and enhances image capture speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional contrast detect auto focus is used, then focusing precision is improved, but image capture speed deteriorates due to slow scanning

Engineering Contradiction:
Improvefocusing precisionVSAvoidimage capture speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary face detection and classification before focusing. By detecting faces and determining their out-of-focus state in advance, the system can predict the required focus adjustment direction and magnitude, eliminating the need for slow scanning and enabling direct focus positioning.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces the mechanical scanning process of conventional contrast detect autofocus with a computational approach using machine learning classifiers. Instead of incrementally shifting the lens and measuring contrast at each step, the system uses image processing and classification algorithms to determine focus requirements, significantly speeding up the process while maintaining precision.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If conventional face detection is used, then in-focus face detection is improved, but out-of-focus face detection deteriorates leading to non-detection events

Engineering Contradiction:
Improveface detection accuracyVSAvoiddetection across focus states
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The face detection process is segmented into multiple stages with different classifiers. The system first applies a coarse classifier to detect potentially out-of-focus faces, then uses a fine classifier to confirm and refine detection. This segmentation allows the system to handle both in-focus and out-of-focus faces effectively without compromising overall detection accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system changes detection parameters dynamically based on the detected face's focus state. Different classifiers with adjusted parameters are applied depending on whether the face appears in-focus or out-of-focus. This adaptive parameter adjustment enables reliable detection across varying focus conditions while maintaining high accuracy for each state.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If conventional auto focus mechanisms are used, then focus acquisition is achieved, but focus hunting occurs when subjects move

Engineering Contradiction:
Improvefocus acquisitionVSAvoidfocus hunting time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system continuously monitors face detection results and focus state, providing real-time feedback to adjust focus positioning. By detecting faces and their focus status in each frame and comparing with previous states, the system can predict subject movement and proactively adjust focus, preventing focus hunting rather than reacting to it after it occurs.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The focus system transitions from static, periodic focus adjustments to a dynamic, continuous adaptation process. The system continuously tracks face positions and focus states, enabling real-time focus adjustments that follow moving subjects smoothly without the oscillatory behavior characteristic of focus hunting in conventional systems.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP2622840B1Continuous autofocus based on face detection and tracking
Publication Date: 2017.07.19 FOTONATION LIMITED
  • EP2622840B1 patent drawingFigure 1
  • EP2622840B1 patent drawingFigure 2A~2B
  • EP2622840B1 patent drawingFigure 3A~3B

AI summary

An autofocus method includes acquiring an image of a scene that includes one or more out of focus faces and/or partial faces. The method includes detecting one or more of the out of focus faces and/or partial faces within the digital image by applying one or more sets of classifiers trained on faces that are out of focus. One or more sizes of the one of more respective out of focus faces and/or partial faces is/are determined within the digital image. One or more respective depths is/are determined to the one or more out of focus faces and/or partial faces based on the one or more sizes of the one of more faces and/or partial faces within the digital image. One or more respective focus positions of the lens is/are adjusted to focus approximately at the determined one or more respective depths.