Robot Emotion Recognition via Motion Reproduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current robots lack the ability to effectively provide emotional expression and transmission during video calls, limiting their usability in conveying complex emotional states and enhancing user interaction.
Innovation Solution
A robot system that includes a robot and a server, equipped with emotion recognition technology using artificial neural networks, which recognizes emotions through image, speech, and bio-signals, and responds with appropriate avatar characters and motions to enhance emotional communication during video calls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If robots transmit only image files for emotional expression, then device complexity is reduced, but emotional transmission effectiveness deteriorates
Solution Approach 1:
The patent combines multiple communication modalities (image transmission, video call, and motion reproduction) into a unified system. The robot receives image data from a user, reproduces the user's motions through articulated movements, and transmits both visual and kinetic information to convey emotional states more effectively than image files alone.
Solution Approach 2:
The patent adds the temporal and kinetic dimension to emotional expression by enabling real-time motion reproduction during video calls. Instead of static image transmission, the robot captures and reproduces dynamic motions, adding a new dimension of emotional communication through articulated body movements and gestures.
2Reliability
If robots perform simple functions, then reliability is improved, but adaptability deteriorates
Solution Approach 1:
The patent enables the robot to perform multiple functions: it acts as a communication device for video calls, an emotional expression device through motion reproduction, and an interactive partner by responding to user inputs. The robot processes various types of data (image, audio, motion) and performs diverse operations (motion reproduction, emotional expression, communication), demonstrating multi-functionality that enhances both reliability and adaptability.
3Ease of manufacture
If robots use pre-manufactured characters for communication, then ease of manufacture is improved, but emotional transmission effectiveness deteriorates
Solution Approach 1:
The patent uses the user's actual motions as a template or model, copying the user's physical expressions and translating them into robot movements. This copying approach preserves the authenticity of the user's emotional expression while adapting it to the robot's physical capabilities, maintaining personal emotional expression rather than relying on generic pre-programmed characters.
Data Source
AI summary
A method of operating a robot includes detecting movement of a video call counterpart using a video call counterpart robot included in image data received from the video call counterpart robot; canceling movement of a user from detected movement of the video call counterpart; and determining motion corresponding to the canceled movement of the video call counterpart.