Facial Recognition Using Motion Vector Trained Model

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing facial recognition systems are inefficient and vulnerable to unauthorized access, particularly when attempting to recognize individuals in dynamic environments, as they often require static images and additional verification methods, and fail to utilize contextual information effectively.

Innovation Solution

The use of a motion neural network to generate biometric motion signatures from video data, which are compared to stored signatures to determine candidate identities, improving authentication confidence and efficiency by incorporating motion information and reducing the need for additional verification steps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If static image recognition is used, then system simplicity is maintained, but authentication reliability deteriorates due to photograph vulnerability and inability to verify physical presence

Engineering Contradiction:
Improveauthentication reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system transitions from static image recognition to dynamic video-based recognition by capturing motion information of facial features over time. The neural network processes temporal sequences of facial landmarks to generate motion signatures, enabling the system to verify physical presence through dynamic movement patterns while maintaining computational efficiency through optimized processing architectures.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system adds the temporal dimension to traditional 2D facial recognition by incorporating motion vectors that describe the movement of facial features across multiple frames. This transforms the recognition problem from spatial pattern matching to spatio-temporal pattern matching, where motion signatures provide an additional dimension of verification that prevents photograph-based attacks.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Productivity

If additional verification methods are required, then authentication reliability improves, but user convenience and processing efficiency deteriorate

Engineering Contradiction:
Improveprocessing efficiencyVSAvoiduser convenience
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The system merges identity verification and liveness detection into a single unified process by extracting motion signatures from the same video sequence used for facial recognition. Instead of requiring separate verification steps, the neural network simultaneously processes facial feature positions and their temporal derivatives, generating both identity classification and motion-based authenticity verification in one computational pass.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system uses the user's natural facial movements during normal interaction as the verification mechanism. Users simply need to display their face in video frames, and the system automatically extracts motion information from their natural expressions and head movements without requiring deliberate gestures or additional actions. This transforms the verification burden from user action to system processing.

Inventive Principle:
Principle #25Self-service

3Reliability

If motion information is incorporated, then authentication reliability and anti-spoofing capability improve, but computational complexity and data processing requirements increase

Engineering Contradiction:
Improveauthentication reliabilityVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system extracts only the essential motion information needed for verification by computing motion vectors specifically for facial landmark points rather than processing entire video frames. This selective extraction focuses computational resources on critical features (eye movements, mouth transitions, jaw motion) while discarding redundant visual data, significantly reducing processing requirements compared to full-frame analysis.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The system transforms raw video pixel data into motion parameter representations by calculating temporal derivatives of facial landmark positions. This parameter transformation converts high-dimensional pixel information into compact motion vectors that capture essential dynamic characteristics with fewer degrees of freedom, enabling efficient neural network processing while preserving authentication-critical motion patterns.

Inventive Principle:
Principle #35Parameter changes

4Loss of information

If video data is used instead of static images, then contextual information and motion cues are captured, but data processing time and computational resources increase

Engineering Contradiction:
Improvecontextual information retentionVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The system performs preliminary processing of video data by pre-detecting and tracking facial landmarks across frames before motion signature generation. Facial feature points are identified and tracked in advance, creating a structured representation of facial geometry that simplifies subsequent motion calculation. This preliminary structuring of data reduces the computational burden during the actual authentication processing phase.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11682198B2Methods and systems for facial recognition using motion vector trained model
Publication Date: 2023.06.20 REALNETWORKS LLC
  • US11682198B2 patent drawing
  • US11682198B2 patent drawing
  • US11682198B2 patent drawing

AI summary

Systems and methods are provided for determining a candidate identity of a person in video data based on a biometric motion signature corresponding to motion of a face of the person in the video data. Motion information is obtained corresponding to motion of the face in the video data. The motion information is provided as input to a neural network and the neural network generates the biometric motion signature in response. The biometric motion signature is compared with a plurality of biometric signatures stored in data storage. The candidate identity of the person is determined as a result of a correspondence between the biometric motion signature and a stored biometric signature of the plurality of biometric signatures.