Facial Tracking with Classifiers for Crowded Environments

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing facial detection technologies face challenges in accurately tracking faces in crowded environments due to the saturation of facial information data with spurious data, making it difficult to identify and locate specific individuals in real-time.

Innovation Solution

A computer-implemented method for facial tracking that involves obtaining videos, partitioning them into frames, detecting facial points, refining their locations, estimating future locations, and simulating an output for a facial detector, which includes generating a bounding box to predict the presence and location of faces in subsequent frames.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Quantity of substance

If facial detection is performed in crowded environments, then more facial data is captured, but the data becomes saturated with spurious information making identification difficult

Engineering Contradiction:
Improvequantity of facial data capturedVSAvoidsignal-to-noise ratio of facial data
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The system segments facial tracking into multiple stages: initial detection phase that captures all potential faces, followed by refinement phases that progressively narrow down to specific targets. This segmentation allows the system to handle crowded environments by processing data in manageable stages rather than attempting to identify all faces simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary facial detection and bounding box generation before refinement. By pre-identifying potential facial locations and creating initial bounding boxes, the system filters out spurious data early in the process, allowing subsequent refinement stages to focus computational resources on promising candidates rather than processing all captured facial data equally.

Inventive Principle:
Principle #10Preliminary action

2Speed

If real-time facial tracking is implemented, then response time is reduced, but accuracy decreases due to data saturation

Engineering Contradiction:
Improvespeed of facial trackingVSAvoidaccuracy of facial location detection
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The system implements periodic refinement cycles where facial detection and bounding box refinement are performed at regular intervals rather than continuously on every frame. This periodic action maintains real-time responsiveness while allowing sufficient processing time to achieve accurate results by focusing computational effort at strategic moments rather than attempting continuous high-precision processing.

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically adjusts the level of refinement applied to different detected faces based on confidence scores and environmental conditions. In crowded environments, the system applies more aggressive filtering and refinement to high-priority targets while using lighter processing for lower-priority detections, allowing real-time performance while maintaining accuracy for critical identifications.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If comprehensive facial analysis is performed, then identification accuracy is improved, but computational complexity increases

Engineering Contradiction:
Improveaccuracy of facial identificationVSAvoidcomputational complexity of facial processing
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system applies different levels of analysis quality to different regions and detected faces. High-precision comprehensive analysis is applied only to high-priority targets with clear detections, while lower-priority or ambiguous detections receive simplified processing. This local quality approach maintains high identification accuracy for critical cases while reducing overall computational complexity by avoiding exhaustive analysis of all detected faces.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The system changes processing parameters dynamically based on detection confidence and environmental context. When detection confidence is high or environmental conditions are favorable, the system employs comprehensive analysis with high computational resources. When confidence is low or environments are challenging, the system adjusts parameters to use more efficient, lower-complexity algorithms, maintaining acceptable accuracy while managing computational load.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS10614289B2Facial tracking with classifiers
Publication Date: 2020.04.07 AFFECTIVA
  • US10614289B2 patent drawing
  • US10614289B2 patent drawing
  • US10614289B2 patent drawing

AI summary

Concepts for facial tracking with classifiers is disclosed. One or more faces are detected and tracked in a series of video frames that include at least one face. Video is captured and partitioned into the series of frames. A first video frame is analyzed using classifiers trained to detect the presence of at least one face in the frame. The classifiers are used to initialize locations for a first set of facial landmarks for the first face. The locations of the facial landmarks are refined using localized information around the landmarks, and a rough bounding box that contains the facial landmarks is estimated. The future locations for the facial landmarks detected in the first video frame are estimated for a future video frame. The detection of the facial landmarks and estimation of future locations of the landmarks are insensitive to rotation, orientation, scaling, or mirroring of the face.