Facial Muscle Monitoring for Dynamic Emotion Recognition Accuracy
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing emotion recognition technologies face challenges in accurately identifying emotions through facial expressions due to the dynamic nature of emotions, especially in medical settings where voice or body information may be unavailable, and small muscle movements are difficult to capture or ignored, leading to inaccurate recognition.
Innovation Solution
A method and device for dynamic recognition of emotion based on facial muscle movement monitoring, utilizing three-dimensional displacement sensors to capture muscle movement data and continuous frame images from key facial areas, forming a training set, and building an emotion recognition model to determine emotional states through muscle change feature data and image features.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple consecutive facial images are combined to analyze facial dynamic expressions, then the ability to capture emotion dynamics is improved, but small muscle movements are difficult to capture or are ignored due to time differences between frames, resulting in inaccurate facial expression recognition
Solution Approach 1:
The patent divides the facial region into multiple key areas (forehead, eyebrow, orbital, cheek, mouth corner, jaw, nose tip areas) and focuses monitoring on these segmented regions. By segmenting the face into functionally relevant zones, the system can detect subtle muscle movements in specific areas without being overwhelmed by the complexity of the entire facial surface, thereby improving measurement precision while maintaining reliability.
Solution Approach 2:
The patent transitions from analyzing two-dimensional image frames to incorporating three-dimensional displacement sensor data that captures muscle movement in multiple spatial dimensions. This dimensional enhancement allows for more precise detection of small muscle movements by measuring displacement in x, y, and z directions, overcoming the limitation of 2D image analysis where subtle movements are easily missed.
2Device complexity
If facial expression recognition is performed using only single static face images, then the processing simplicity is maintained, but accurate recognition of emotions cannot be achieved because emotions are dynamic processes that take time to appear
Solution Approach 1:
The patent performs preliminary actions by pre-segmenting the facial region into key areas and pre-positioning displacement sensors in these areas before emotion detection begins. The system also pre-establishes the correspondence relationships between different key areas and their symmetrical counterparts. This preliminary preparation enables the system to process dynamic facial expressions efficiently without requiring complex real-time analysis of the entire face, thus maintaining processing simplicity while improving reliability.
Solution Approach 2:
The patent extracts and focuses on the most relevant features for emotion recognition by isolating key facial areas and their corresponding displacement movements, rather than processing the entire facial image or all possible features. This extraction of essential elements (key areas + displacement data) reduces processing complexity while capturing the dynamic nature of emotions, thereby improving recognition accuracy without proportionally increasing system complexity.
3Measurement precision
If three-dimensional displacement sensors are used to capture muscle movement data, then small muscle movements can be detected, but the device complexity and data processing requirements increase
Solution Approach 1:
The patent applies local quality by placing displacement sensors only in key facial areas where muscle movements are most indicative of emotions (forehead, eyebrow, orbital, cheek, mouth corner, jaw, nose tip areas), rather than deploying sensors across the entire face or body. This localized approach maintains high measurement precision for critical regions while significantly reducing device complexity and data processing requirements compared to comprehensive full-face monitoring.
Solution Approach 2:
The patent utilizes the asymmetry principle by focusing monitoring on one side of the face (obtaining muscle movement data from key areas on one side) and corresponding this data to symmetrical key areas on the other side through established correspondence relationships. This asymmetric monitoring strategy reduces the number of sensors needed by approximately half while maintaining comprehensive emotion detection capability, thereby reducing device complexity without sacrificing measurement precision.
Data Source
AI summary
The present disclosure provides a method and device for dynamic recognition of emotion based on facial muscle movement monitoring, including: obtaining muscle movement data on one side and continuous frame images on the other side; obtaining multiple emotional states related to emotions, associating each emotional state with its corresponding continuous frame images, associating each emotional state with the muscle movement data corresponding to the continuous frame images at the same location and at the same time, to form a training set, building an emotion recognition model; inputting the muscle movement data and continuous frame images obtained in real time into the emotion recognition model to obtain a corresponding emotional state. This method builds an emotion recognition model through muscle movement data and continuous frame image, and uses motion data to make up for the parts of small action images that cannot be collected, thereby obtaining accurate emotion detection results.