Face Detection via Multi-Stage Classifier Cascade and Skin Tone Validation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing face detection solutions face limitations such as limited accuracy, high computational demands, and inability to perform real-time processing, making them unsuitable for widespread adoption in applications like video coding.

Innovation Solution

The implementation of a multi-stage facial search system using Viola-Jones face detection techniques, integral images, adaptive boosting, and classifier cascading to enhance face detection accuracy and speed, along with skin tone validation for robustness and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If existing face detection solutions are used, then face detection can be performed, but accuracy is limited and false positives occur

Engineering Contradiction:
Improveface detection accuracyVSAvoidfalse positive rate
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The face detection process is divided into multiple stages: initial detection stage, verification stage, and refinement stage. Each stage processes candidate regions with different levels of scrutiny, progressively eliminating false positives while maintaining detection accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A verification module acts as an intermediary between the initial detector and final results. This module cross-checks detected faces against multiple criteria (feature consistency, spatial relationships, temporal coherence) before confirming detections, thereby reducing false positives.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If high accuracy face detection is implemented, then detection reliability improves, but computational demands increase

Engineering Contradiction:
Improvedetection reliabilityVSAvoidcomputational energy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The detection system segments processing resources across multiple stages: fast initial filtering, medium-complexity verification, and slow detailed analysis. This staged approach achieves high reliability while managing computational energy consumption by applying intensive processing only where necessary.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies partial verification to all detections and excessive verification only to ambiguous cases. This selective approach ensures high reliability for critical detections while avoiding unnecessary computational energy expenditure on obvious cases.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If comprehensive face detection processing is performed, then detection accuracy improves, but real-time processing capability is lost

Engineering Contradiction:
Improvedetection accuracyVSAvoidprocessing speed
Core Design Contradiction:
Measurement precisionVSSpeed

Solution Approach 1:

The detection pipeline is segmented into fast initial detection, medium-speed verification, and slow refinement stages. By processing frames through these stages sequentially and in parallel where possible, the system achieves high detection accuracy while maintaining real-time processing throughput.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary detection and filtering at lower resolution or with simplified models before applying comprehensive analysis. This preliminary action reduces the computational burden of subsequent detailed processing, enabling real-time performance without sacrificing accuracy.

Inventive Principle:
Principle #10Preliminary action

4Speed

If multi-stage facial search with classifier cascading is implemented, then face detection speed improves, but system complexity increases

Engineering Contradiction:
Improvedetection speedVSAvoidsystem complexity
Core Design Contradiction:
SpeedVSDevice complexity

Solution Approach 1:

The detection system is segmented into a cascade of classifiers with increasing complexity. Early stages use simple, fast classifiers to eliminate obvious non-faces, while later stages use more complex classifiers for difficult cases. This segmentation achieves high detection speed while managing system complexity through modular design.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The classifier cascade applies partial processing (simple classifiers) to most regions and excessive processing (complex classifiers) only to regions of interest. This selective application of complexity maintains high detection speed while achieving accurate results where needed.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10628700B2Fast and robust face detection, region extraction, and tracking for improved video coding
Publication Date: 2020.04.21 INTEL CORP
  • US10628700B2 patent drawing
  • US10628700B2 patent drawing
  • US10628700B2 patent drawing

AI summary

Techniques related to improved video coding based on face detection, region extraction, and tracking are discussed. Such techniques may include performing a facial search of a video frame to determine candidate face regions in the video frame, testing the candidate face regions based on skin tone information to determine valid and invalid face regions, rejecting invalid face regions, and encoding the video frame based on valid face regions to generate a coded bitstream.