Facial Attribute Detection Using Local Region Segmentation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current facial attribute detection methods are inefficient and limited in accuracy, requiring high memory and computing resources, and are often specific to one type of attribute, making them unsuitable for diverse applications and platforms.

Innovation Solution

A unified framework for facial attribute detection using a multi-layer perceptron (MLP) with local binary patterns (LBP) or histogram of oriented gradients (HoG) for feature extraction, combined with a boosting process to select local regions, allowing for fast and accurate detection of multiple attributes like smile, gender, and age on various computing platforms.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If current facial attribute detection methods are used, then detection accuracy can be achieved, but memory usage and computing resources are excessively high

Engineering Contradiction:
Improvedetection accuracyVSAvoidmemory usage
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent divides the facial image into multiple local regions (e.g., eye region, mouth region, cheek region) and processes each region separately using small classification models. This segmentation allows the system to achieve accurate detection while using minimal memory, as each local model requires far less memory than a single large global model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from a single global classification model to multiple local classification models operating in parallel across different spatial regions. This dimensional change from one comprehensive model to many specialized models enables both high accuracy and low memory consumption, as each local model can be much smaller while collectively covering the entire face.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If current facial attribute detection methods are used, then detection accuracy can be achieved, but processing speed is too slow for real-time applications

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

By dividing the face into local regions and using small classification models for each region, the patent enables parallel processing that significantly increases processing speed. The segmented approach allows multiple regions to be processed simultaneously, achieving real-time performance while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs lightweight, simple classification models for each local region that are computationally inexpensive and fast to execute. These simplified models trade some individual complexity for speed, enabling real-time processing when aggregated across multiple regions.

Inventive Principle:
Principle #27Cheap short-living objects (Disposable)

3Adaptability or versatility

If current facial attribute detection methods are used, then specific attribute detection can be performed, but the methods are limited to one type of attribute and not suitable for diverse applications

Engineering Contradiction:
Improveapplication versatilityVSAvoidmethod complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent creates a universal framework where the same local region segmentation and classification approach can detect multiple facial attributes (smile, gender, age, etc.) simultaneously. By making the system multi-functional through parallel attribute detection on the same local features, it achieves high versatility without proportionally increasing complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines multiple attribute detection tasks into a unified framework that processes local regions once and extracts multiple attributes from the same features. This merging of detection tasks reduces overall complexity compared to running separate detection systems for each attribute type.

Inventive Principle:
Principle #5Merging (Combining)

4Measurement precision

If high computing power methods are used, then detection accuracy improves, but the methods cannot be deployed on embedded devices with limited resources

Engineering Contradiction:
Improvedetection accuracyVSAvoidplatform adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The segmentation into local regions with small classification models enables deployment on resource-constrained embedded devices while maintaining accuracy. Each local model is small enough to fit in limited memory and execute on low-power processors, yet collectively they achieve high detection accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes the parameters of the classification models from large, complex global models to small, simple local models with reduced feature dimensions and fewer parameters. This parameter reduction enables deployment on embedded devices while preserving detection accuracy through the collective power of multiple specialized models.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS8805018B2Method of detecting facial attributes
Publication Date: 2014.08.12 TAHOE RES LTD
  • US8805018B2 patent drawing
  • US8805018B2 patent drawing
  • US8805018B2 patent drawing

AI summary

Detection of a facial attribute such as a smile or gender in a human face in an image is performed by embodiments of the present invention in a computationally efficient manner. First, a face in the image is detected to produce a facial image. Facial landmarks are detected in the facial image. The facial image is aligned and normalized based on the detected facial landmarks to produce a normalized facial image. Local features from selected local regions are extracted from the normalized facial image. A facial attribute is predicted in each selected local region by inputting each selected local feature into a weak classifier having a multi-layer perceptron (MLP) structure. Finally, output data is aggregated from each weak classifier component to generate all indication that the facial attribute is detected in the facial image.