Facial Expression Detection Using Adaboost Classifier

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image capturing devices struggle to detect and ensure optimal facial expressions, often resulting in unnatural or unsatisfactory portrait photos due to the photographer's inability to coordinate with the subject, leading to closed eyes or mouth during picture-taking.

Innovation Solution

An electronic image capturing device method that detects facial expressions by identifying the positions and states of eyes and mouth using a facial feature classifier trained with the Adaboost algorithm, issuing a warning signal for unnatural or closed states and allowing photo capture only when expressions are open and natural.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If the photographer takes the portrait photo without real-time facial expression detection, then the photo capture process is simple and fast, but the facial expression quality becomes poor with closed eyes or mouth

Engineering Contradiction:
Improvefacial expression qualityVSAvoiddetection system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent replaces manual visual inspection and subjective judgment of facial expressions with an automated computer vision system using the Adaboost algorithm. This substitutes the mechanical/manual process of photographer observation with an automated digital detection system that objectively analyzes facial feature positions and states, thereby improving reliability while managing complexity through software-based solutions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system enables the photographed person to self-monitor their facial expression state through real-time feedback. The detection system provides immediate information about whether eyes and mouth are in optimal positions, allowing the subject to self-adjust their expression without requiring constant photographer intervention or complex manual assessment procedures.

Inventive Principle:
Principle #25Self-service

2Reliability

If the photographer waits for the photographed person to maintain a smile face for a long time, then the facial expression becomes more natural, but the photographed person cannot keep still and the expression becomes unnatural or stiffed

Engineering Contradiction:
Improvefacial expression naturalnessVSAvoidtime to capture optimal expression
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements real-time feedback by continuously monitoring facial expression parameters (eye position, mouth position) and providing immediate information to both the photographer and photographed person. This feedback mechanism eliminates the need for prolonged waiting periods, as the system identifies the optimal capture moment in real-time based on objective facial feature analysis, thereby maintaining naturalness while reducing time loss.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system performs preliminary detection and analysis of facial expression trends before the optimal moment occurs. By monitoring the progression of facial features and predicting the optimal capture window, the system prepares the photographer in advance, allowing for immediate capture at the precise moment of natural expression without requiring extended posing time.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If the photographed person is told to maintain a smile face, then the facial expression shows a smile face, but the expression becomes unnatural or stiffed when the person cannot keep still

Engineering Contradiction:
Improvefacial expression authenticityVSAvoidease of maintaining expression
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent replaces the subjective and difficult-to-maintain instructed expression with an objective, data-driven detection system. Instead of relying on the photographed person's ability to consciously maintain a smile (which becomes stiff over time), the system objectively measures actual facial feature positions and states, capturing natural expressions without requiring the subject to consciously control or maintain a specific pose.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

4Reliability

If the photographer and photographed person have communication or unspoken consensus, then the photographed person knows when to smile, but there is still lack of communication and the person closes eyes or mouth unintentionally

Engineering Contradiction:
Improvecoordination between photographer and subjectVSAvoidcommunication system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent establishes real-time feedback communication between the detection system and the photographed person. The system continuously monitors facial features and provides immediate visual or auditory feedback when optimal expression conditions are met, creating a clear communication channel that eliminates uncertainty about when to smile or hold an expression, thereby improving coordination without requiring complex interpersonal communication protocols.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS7715598B2Method for detecting facial expressions of a portrait photo by an image capturing electronic device
Publication Date: 2010.05.11 ARCSOFT INC
  • US7715598B2 patent drawing
  • US7715598B2 patent drawing
  • US7715598B2 patent drawing

AI summary

In a method for detecting facial expressions of a portrait photo by an image capturing electronic device, a face captured in the portrait photo is detected. The position and range of the opened and closed facial features are detected, and the facial features within an identified range are magnified according to a specific proportion. A patch of facial features and their surroundings within a specific range is cut according to the magnified identified range, so that the patch can show a change of facial expressions and a specific range of their surroundings. A facial feature classifier is trained by a specific number of opened and closed facial feature samples based on the Adaboost algorithm and used for detecting the facial features in the patch to determine whether the facial feature is situated at an opened state or a closed state.