Emotion-Aware Robot Control Using Face and Biological Signals
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing robots struggle to perform actions that align with user emotions, leading to unnatural interactions and user boredom due to inappropriate responses.
Innovation Solution
A robot equipped with an acquisition unit for face images and biological information, and an action control unit to perform actions based on emotional states, utilizing a learning device for emotion estimation and action generation through machine learning.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If the robot performs unidirectional actions without emotion recognition, then the device complexity is reduced, but the naturalness of communication and user comfort deteriorates
Solution Approach 1:
The patent introduces an emotion recognition module as an intermediary between the robot and the user. This module processes facial expressions and biological information to estimate user emotions, enabling the robot to adapt its actions accordingly. The intermediary layer resolves the contradiction by adding intelligence without requiring complete system redesign.
Solution Approach 2:
The system implements feedback loops where the robot continuously monitors user emotional states through facial recognition and biological sensors, then adjusts its actions based on this feedback. This creates a dynamic interaction system that improves communication naturalness while maintaining manageable complexity through iterative adaptation.
2Device complexity
If the robot estimates emotion without performing matching actions, then the device complexity is reduced, but the user comfort and interaction quality deteriorates
Solution Approach 1:
The patent makes the robot's action selection dynamic by linking it to real-time emotion estimation. The action control unit dynamically adjusts robot behaviors based on current emotional states, ensuring actions match user needs. This dynamic adaptation improves reliability of user comfort without requiring overly complex predetermined action sets.
Solution Approach 2:
The system changes operational parameters (robot actions) based on detected emotional parameters. When emotions are estimated through facial and biological data, the robot modifies its behavior parameters accordingly, creating a responsive system that maintains user comfort while avoiding excessive complexity.
3Measurement precision
If the robot uses multiple data sources for emotion estimation, then the measurement precision of emotion is improved, but the device complexity increases
Solution Approach 1:
The patent merges multiple data sources (facial expression recognition and biological information sensors) into a unified emotion estimation system. The emotion recognition module integrates inputs from cameras and biological sensors to produce comprehensive emotion estimates, improving precision while managing complexity through unified processing architecture.
Solution Approach 2:
The emotion recognition module serves multiple functions: it processes facial expressions, analyzes biological information, estimates emotional states, and guides action selection. This multi-functional component improves measurement precision across different modalities while avoiding the complexity of separate dedicated systems for each function.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Actions that do not match an emotion of a user are reduced. A robot includes an acquisition unit configured to acquire a face image of a user and biological information of the user, and an action control unit configured to perform a predetermined action in accordance with an emotional state of the user based on the face image and the biological information.