Wearable Emotion Detection via Sensor Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current mixed reality technologies lack the ability to accurately interpret and provide feedback on emotional states of subjects within a wearer's field of view, limiting effective human interaction and social behavior analysis.
Innovation Solution
A see-through head-mounted display device equipped with sensors that detect and analyze audible and visual behaviors in real-time, comparing the input against a database of human and primate gestures, posture, and speech to compute emotional states and provide feedback to the wearer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If sensors and processing devices are added to the head-mounted display to detect and analyze emotional states, then the ability to interpret emotional states is improved, but the device complexity increases
Solution Approach 1:
The system divides emotional state detection into multiple independent sensor modules (audio sensors, visual sensors, speech analysis modules) that can be processed separately and integrated, making the complex detection task manageable and modular
Solution Approach 2:
A processing device acts as an intermediary between the sensors and the display system, analyzing sensor data and generating emotional state interpretations before presenting feedback to the wearer, thereby managing system complexity through layered processing
2Loss of time
If real-time sensor data processing is performed to compute emotional states, then the feedback timeliness is improved, but the energy consumption increases
Solution Approach 1:
The system processes sensor data at optimized intervals rather than continuously, analyzing emotional states at regular time periods that balance timeliness requirements with energy conservation, reducing unnecessary processing while maintaining effective feedback timing
Solution Approach 2:
The system processes only the most relevant sensor data portions needed for emotional state detection rather than analyzing all available data streams in full detail, reducing computational energy consumption while maintaining detection accuracy
3Measurement precision
If multiple sensors are integrated into the head-mounted display to detect audible and visual behaviors, then the emotional state detection capability is improved, but the device weight increases
Solution Approach 1:
The system uses multi-functional sensors that can detect multiple types of behaviors (audible, visual, speech patterns) with a single sensor component, reducing the total number of sensors needed while maintaining comprehensive emotional state detection capability
Solution Approach 2:
The patent integrates sensors and processing components within the existing head-mounted display structure, nesting detection elements within the display framework to minimize additional weight while maximizing detection functionality
Data Source
AI summary
A see-through, head mounted display and sensing devices cooperating with the display detect audible and visual behaviors of a subject in a field of view of the device. A processing device communicating with display and the sensors monitors audible and visual behaviors of the subject by receiving data from the sensors. Emotional states are computed based on the behaviors and feedback provided to the wearer indicating computed emotional states of the subject. During interactions, the device, recognizes emotional states in subjects by comparing detected sensor input against a database of human/primate gestures/expressions, posture, and speech. Feedback is provided to the wearer after interpretation of the sensor input.