AR Headset Face Recognition via Wristband EMG Sensors
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Augmented reality systems with head-mounted displays often clutter the user's field of view by labeling every face, including familiar individuals, leading to irrelevant information and decreased usability.
Innovation Solution
A system that detects physical and non-physical encounters using a wristband with EMG and motion sensors to differentiate between initial and subsequent encounters, adding relevant information to a database and presenting it only when necessary, thereby filtering out known individuals from the display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If the AR system labels every face in the field of view using facial recognition software, then the system provides comprehensive face identification information, but the display becomes cluttered with irrelevant information and usability decreases
Solution Approach 1:
The system extracts only the relevant face identification information (unknown faces) from the complete set of detected faces, excluding already-known individuals. This selective extraction prevents information clutter while maintaining the useful face identification functionality.
Solution Approach 2:
The system applies different treatment to different faces based on their classification status. Known faces are filtered out completely, while unknown faces receive identification labels. This localized differentiation ensures information is provided only where needed, improving usability without losing valuable identification data.
2Measurement precision
If the system uses a wristband with EMG and motion sensors to detect physical encounters, then the system can differentiate between initial and subsequent encounters, but the device complexity increases
Solution Approach 1:
The wristband acts as an intermediary device that captures physiological signals (EMG) and motion data, which are then processed to infer encounter status. This intermediary approach enables precise encounter detection without requiring complex processing in the main AR system, distributing complexity appropriately.
Solution Approach 2:
The system replaces direct visual or manual verification of encounters with automated sensor-based detection using EMG and motion sensors. This substitution of mechanical/visual verification with electronic sensing improves measurement precision while the modular sensor design helps manage overall system complexity.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Effectively manages information by categorizing and presenting only new encounters, reducing clutter and enhancing user experience by providing relevant data without overwhelming the user with unnecessary labels.
Implementation Method 1
A sensor such as an electromyogram (EMG) sensor can be used to detect gestures
Implementation Method 2
by adding an acceleration sensor or the like for measuring the movement of an arm itself
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A system, a method, and a computer program product for managing information for an interface device are provided. The system detects for one of a present physical encounter between a user of the interface device and a person, and a non-physical encounter between the user and a person. The system determines if a detected present physical encounter is an initial encounter or a subsequent encounter, and adds content associated with the person to a database of previously encountered persons when the present physical encounter is an initial encounter. When the present physical encounter is a subsequent encounter or a present non-physical encounter is detected, the system determines if the person is known by the user, and presents information to the interface device corresponding to the person when the person is not known by the user.