Probabilistic Model for Person Recognition via Context

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing face recognition systems are not human-like in their ability to make inferences using context and recognize familiar strangers, limiting their functionality and usability compared to human recognition capabilities.

Innovation Solution

An image processing system employing a probabilistic model that separates identities and names, using a feature extractor to predict identities and names based on image features and context, with the ability to infer familiar strangers by learning from environmental and contextual data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If template matching or classification with annotated templates/training images is used, then face recognition can be performed in controlled environments, but significant time and expense are involved in annotation and the system is not robust to lighting changes, occlusion, and different camera viewpoints

Engineering Contradiction:
Improverecognition accuracyVSAvoidannotation complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system enables unsupervised training where the probabilistic model automatically learns from images without requiring manual annotation of facial features or templates. The model self-organizes clusters of image features and learns identities and names through environmental context, eliminating the need for human annotators to label training data.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system transitions from supervised learning with fixed annotated templates to unsupervised learning with a probabilistic model that dynamically adapts parameters based on environmental context. The model learns to recognize faces under varying conditions (lighting, occlusion, viewpoints) by adjusting its internal representations based on contextual cues from the environment.

Inventive Principle:
Principle #35Parameter changes

2Ease of operation

If existing face recognition systems operate without context awareness, then simple template matching can be performed, but the systems do not behave or operate in the same way as a human and are not intuitive to use or integrate with other automated systems

Engineering Contradiction:
ImproveintuitivenessVSAvoidcontext utilization
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The probabilistic model acts as an intermediary between raw image features and human-like recognition decisions. It incorporates environmental context as a mediating factor that bridges the gap between simple feature matching and intuitive human recognition behavior, allowing the system to make inferences similar to human context-based recognition.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system dynamically adapts its recognition behavior based on environmental context rather than using fixed template matching rules. The probabilistic model continuously adjusts its predictions based on contextual information from the environment, making the system more flexible and human-like in its operation.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If a probabilistic model separates identities and names with context learning, then familiar strangers can be recognized and recognition accuracy improves, but the system complexity increases

Engineering Contradiction:
Improveidentity prediction accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The probabilistic model segments the recognition task into distinct components: image feature extraction, context learning, identity prediction, and name prediction. By separating identities from names and processing them through different pathways within the model, the system can accurately recognize familiar strangers while maintaining a structured approach that manages complexity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240037913A1Image processing for person recognition
Publication Date: 2024.02.01 MICROSOFT TECHNOLOGY LICENSING LLC
  • US20240037913A1 patent drawing
  • US20240037913A1 patent drawing
  • US20240037913A1 patent drawing

AI summary

An image processing system is described which has a memory holding at least one image depicting at least one person previously unseen by the image processing system. The system has a trained probabilistic model which describes a relationship between image features, context, identities and a plurality of names of people, wherein at least one of the identities identifies a person depicted in the image without an associated name in the plurality of names. The system has a feature extractor which extracts features from the image, and a processor which predicts an identity of the person depicted in the image using the extracted features and the probabilistic model.