Machine Learning Model for Subtle Facial Expression Recognition

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional image capturing systems are inflexible, inefficient, and inaccurate in capturing digital images, particularly in recognizing subtle or personalized facial expressions across different users or contexts.

Innovation Solution

The system utilizes a machine learning model trained to determine subtle pose differentiations, analyzing a repository of captured digital images to automatically capture images that match previous contextual poses of a user, improving flexibility, efficiency, and accuracy.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If conventional annotation-based computational models are used to determine automatic image capture, then the system operates with simple rigid rules, but the system fails to capture subtle or personalized facial expressions across different users or contexts

Engineering Contradiction:
Improveability to capture subtle or personalized facial expressionsVSAvoidcomputational model complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The patent transitions from static annotation-based models to dynamic machine learning models that continuously learn and adapt to individual user facial expressions. The system dynamically adjusts its recognition criteria based on trained models specific to each user, enabling capture of subtle expressions while maintaining computational efficiency through optimized neural network architectures.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the parameters of the computational model from fixed annotation thresholds to learnable parameters in neural networks. By training models on user-specific data, the system adapts parameter values to recognize subtle variations in facial expressions, thereby improving versatility without requiring excessive complexity in the base model structure.

Inventive Principle:
Principle #35Parameter changes

2Productivity

If conventional systems capture digital images based on rigid facial expression rules, then the system operates efficiently with simple algorithms, but the system captures unnecessary digital images that consume storage and processing resources

Engineering Contradiction:
Improveimage capture efficiencyVSAvoidstorage and processing resources
Core Design Contradiction:
ProductivityVSLoss of energy

Solution Approach 1:

The system implements feedback loops where captured images are analyzed by machine learning models to determine quality and user intent. The model provides feedback on whether an image meets capture criteria, allowing the system to avoid storing low-quality or unwanted images. This feedback mechanism improves productivity by filtering captures in real-time and reduces resource loss by preventing storage of unnecessary images.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The machine learning model serves itself by continuously learning from captured data to improve its own accuracy in determining when to capture images. The system automatically refines its understanding of user preferences and expression patterns, enabling more efficient capture decisions without manual intervention, thereby improving productivity while reducing wasted resources on poor-quality captures.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If conventional user-agnostic annotation models are used, then the system operates with universal rules applicable to all users, but the system is inaccurate in recognizing subtle facial expressions of specific users

Engineering Contradiction:
Improvefacial expression recognition accuracyVSAvoiduser-specific model training
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the universal image capture problem into user-specific sub-problems by training separate machine learning models for each individual. This segmentation allows each model to specialize in recognizing that particular user's facial expressions, dramatically improving measurement precision. The segmentation approach manages complexity by creating modular, independent models rather than one complex universal model.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary action by training user-specific machine learning models before actual image capture begins. This pre-training phase allows the system to learn individual facial expression patterns in advance, so that during operation, the models can accurately recognize subtle expressions without requiring complex real-time analysis. The preliminary training invests computational resources upfront to reduce complexity during actual capture.

Inventive Principle:
Principle #10Preliminary action

4Ease of operation

If conventional systems require duplicative user interactions to manually capture images, then the system maintains simple automated capture logic, but the system wastes additional time and computing resources

Engineering Contradiction:
Improveautomatic capture capabilityVSAvoiduser interaction time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The machine learning-powered system serves itself by automatically determining when capture conditions are met based on real-time analysis of facial expressions. The system eliminates the need for user interactions by autonomously making capture decisions, thereby improving ease of operation. The self-service capability reduces time loss by capturing images immediately when criteria are satisfied rather than requiring manual user input.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20250069437A1Capturing digital images utilizing a machine learning model trained to determine subtle pose differentiations
Publication Date: 2025.02.27 ADOBE INC
  • US20250069437A1 patent drawing
  • US20250069437A1 patent drawing
  • US20250069437A1 patent drawing

AI summary

The present disclosure describes systems, non-transitory computer-readable media, and methods for utilizing a machine learning model trained to determine subtle pose differentiations to analyze a repository of captured digital images of a particular user to automatically capture digital images portraying the user. For example, the disclosed systems can utilize a convolutional neural network to determine a pose/facial expression similarity metric between a sample digital image from a camera viewfinder stream of a client device and one or more previously captured digital images portraying the user. The disclosed systems can determine that the similarity metric satisfies a similarity threshold, and automatically capture a digital image utilizing a camera device of the client device. Thus, the disclosed systems can automatically and efficiently capture digital images, such as selfies, that accurately match previous digital images portraying a variety of unique facial expressions specific to individual users.