Wearable Face And Emotion Recognition For Social Memory Support
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Autistic children and elderly individuals face challenges in social interaction and memory due to limited communication skills and cognitive decline, respectively, with existing assistive devices being expensive and less functional.
Innovation Solution
An intelligent assistive device worn on the user, equipped with an image capture device, display, and controller, performs character and emotion recognition, providing augmented reality images and corresponding audio to enhance interaction and memory.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If traditional AAC assistive devices (communication boards, voice recorders) are used, then communication function is improved, but device cost and complexity increase
Solution Approach 1:
The wearable device integrates multiple functions including face recognition, emotion detection, character identification, and audio playback into a single device. The controller executes diverse processing tasks (face recognition processing, emotion recognition processing, character audio playback) that would traditionally require multiple separate devices, thereby reducing overall system complexity and cost while maintaining enhanced communication capabilities.
Solution Approach 2:
The device automatically performs face recognition and emotion detection without requiring manual input from the user. The image capture device continuously captures images, the controller automatically processes them through recognition algorithms, and provides appropriate responses (character identification, audio playback) autonomously, reducing the need for complex manual operation interfaces.
2Ease of operation
If physical objects and communication cards are used for emotional recognition, then ease of operation is improved, but functional versatility deteriorates
Solution Approach 1:
The device dynamically adapts its functionality based on real-time emotion detection. The controller adjusts the type of audio playback, character identification, and interaction modes according to the detected emotion state, allowing the same hardware to serve multiple communication purposes without requiring physical replacement of tools.
Solution Approach 2:
The system changes its operational parameters based on detected emotions. Different emotion states trigger different processing modes (e.g., happy emotion triggers one set of character audio responses, while sad emotion triggers another), enabling a single device to provide versatile communication functions without physical reconfiguration.
3Reliability
If augmented reality images are displayed to interact with user, then engagement and memory retention are improved, but device complexity increases
Solution Approach 1:
The processing pipeline is segmented into distinct modules: image capture, face recognition processing, emotion recognition processing, and audio playback. Each module handles a specific task independently, making the overall complex system more manageable and efficient. The controller coordinates these segmented processes to generate augmented reality images that enhance memory retention without requiring all processing to occur simultaneously.
Data Source
AI summary
An interactive wearable electronic device with facial expression and face recognition and prompting functions and a processing method for the interactive wearable electronic device are provided. The interactive wearable electronic device includes a controller, an image capture device and a display device. The controller detects whether there is a character image among a plurality of captured images. When the plurality of captured images include the character image, the controller performs a face recognition process on the character image to generate a character recognition text. When the plurality of captured images include the character image, the controller performs an emotion recognition process on the character image to provide an emotion image corresponding to the character image.