AR Overlay for Masked Facial Expression Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Personal protective equipment (PPE) such as face masks hinder socialization by obscuring facial expressions and dampening voices, leading to miscommunications, especially for individuals with disabilities, due to limited visibility and audibility.
Innovation Solution
An augmented reality system that identifies and generates AR representations of facial expressions and sentiments, overlaying them on PPE surfaces for those wearing CMR devices, enhancing communication by providing barrier-free interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If face masks are worn for protection, then health safety is improved, but facial expression visibility is reduced
Solution Approach 1:
An augmented reality system acts as an intermediary between the masked individual and observers. The system captures facial expressions through cameras, processes them, and displays them as AR overlays on the mask surface, allowing expressions to be seen without removing the protective mask
Solution Approach 2:
The system creates a digital copy or representation of the individual's facial expressions and displays it on the mask surface. This copy conveys the emotional state and communication intent without requiring direct visibility of the actual facial features
2Reliability
If face masks are worn for protection, then health safety is improved, but communication quality is reduced
Solution Approach 1:
The AR system serves as a communication mediator by translating facial expressions into visible AR representations that can be perceived by others, thereby maintaining communication quality while the mask remains in place for health protection
Solution Approach 2:
The system transforms physical facial expressions (which are obscured) into digital visual parameters that can be displayed on the mask surface, changing the mode of expression transmission from direct visual to augmented digital display
3Reliability
If PPE is worn by individuals with disabilities, then health protection is improved, but accessibility to communication methods is reduced
Solution Approach 1:
The AR system provides a universal communication enhancement that benefits multiple user groups including individuals with disabilities. It works alongside other communication methods (speech, text) to provide multiple channels for expression and communication accessibility
Data Source
AI summary
Techniques are described with respect to a system, method, and computer product for enhancement of socialization between one or more individuals wearing personal protective equipment. An associated method includes identifying a plurality of social communications between one or more individuals wearing personal protective equipment (PPE) and assigning an identifier to a participant associated with at least one of the social communications. The method further includes analyzing content of the at least one social communication and generating an augmented reality (AR) based representation of the content for presentation on an augmented reality device associated with the user, the augmented reality device presenting the content for visualization replacing PPE based at least in-part on the identifier.