Facial Attribute Detection Using Local Region Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current facial attribute detection methods are inefficient and limited in accuracy, requiring high memory and computing resources, and are often specific to one type of attribute, making them unsuitable for diverse applications and platforms.
Innovation Solution
A unified framework for facial attribute detection using a multi-layer perceptron (MLP) with local binary patterns (LBP) or histogram of oriented gradients (HoG) for feature extraction, combined with a boosting process to select local regions, allowing for fast and accurate detection of multiple attributes like smile, gender, and age on various computing platforms.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If current facial attribute detection methods are used, then detection accuracy can be achieved, but memory usage and computing resources are excessively high
Solution Approach 1:
The patent divides the facial image into multiple local regions (e.g., eye region, mouth region, cheek region) and processes each region separately using small classification models. This segmentation allows the system to achieve accurate detection while using minimal memory, as each local model requires far less memory than a single large global model.
Solution Approach 2:
The patent transitions from a single global classification model to multiple local classification models operating in parallel across different spatial regions. This dimensional change from one comprehensive model to many specialized models enables both high accuracy and low memory consumption, as each local model can be much smaller while collectively covering the entire face.
2Measurement precision
If current facial attribute detection methods are used, then detection accuracy can be achieved, but processing speed is too slow for real-time applications
Solution Approach 1:
By dividing the face into local regions and using small classification models for each region, the patent enables parallel processing that significantly increases processing speed. The segmented approach allows multiple regions to be processed simultaneously, achieving real-time performance while maintaining accuracy.
Solution Approach 2:
The patent employs lightweight, simple classification models for each local region that are computationally inexpensive and fast to execute. These simplified models trade some individual complexity for speed, enabling real-time processing when aggregated across multiple regions.
3Adaptability or versatility
If current facial attribute detection methods are used, then specific attribute detection can be performed, but the methods are limited to one type of attribute and not suitable for diverse applications
Solution Approach 1:
The patent creates a universal framework where the same local region segmentation and classification approach can detect multiple facial attributes (smile, gender, age, etc.) simultaneously. By making the system multi-functional through parallel attribute detection on the same local features, it achieves high versatility without proportionally increasing complexity.
Solution Approach 2:
The patent combines multiple attribute detection tasks into a unified framework that processes local regions once and extracts multiple attributes from the same features. This merging of detection tasks reduces overall complexity compared to running separate detection systems for each attribute type.
4Measurement precision
If high computing power methods are used, then detection accuracy improves, but the methods cannot be deployed on embedded devices with limited resources
Solution Approach 1:
The segmentation into local regions with small classification models enables deployment on resource-constrained embedded devices while maintaining accuracy. Each local model is small enough to fit in limited memory and execute on low-power processors, yet collectively they achieve high detection accuracy.
Solution Approach 2:
The patent changes the parameters of the classification models from large, complex global models to small, simple local models with reduced feature dimensions and fewer parameters. This parameter reduction enables deployment on embedded devices while preserving detection accuracy through the collective power of multiple specialized models.
Data Source
AI summary
Detection of a facial attribute such as a smile or gender in a human face in an image is performed by embodiments of the present invention in a computationally efficient manner. First, a face in the image is detected to produce a facial image. Facial landmarks are detected in the facial image. The facial image is aligned and normalized based on the detected facial landmarks to produce a normalized facial image. Local features from selected local regions are extracted from the normalized facial image. A facial attribute is predicted in each selected local region by inputting each selected local feature into a weak classifier having a multi-layer perceptron (MLP) structure. Finally, output data is aggregated from each weak classifier component to generate all indication that the facial attribute is detected in the facial image.


