Robot Speech Control Synchronizing Motion With Audio Output
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices that speak to users lack the ability to execute physical motions associated with their messages, making it difficult for them to engage in affective communication with users.
Innovation Solution
A speech and behavior control device that synchronizes the movement of a robot's movable parts with audio output, selecting utterance content and corresponding motions to express feelings, ensuring that audio is output only after the movement has started, enhancing the robot's communication effectiveness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the electronic apparatus utters an attention-seeking wording to direct user attention, then the user can be prevented from missing the message, but the user cannot have a sense of anticipation that the electronic apparatus will utter some sort of message
Solution Approach 1:
The robot performs a preliminary motion action before uttering the message. The movement control section controls the movable part to execute a motion corresponding to the feeling associated with the utterance content, and only after this motion has been executed does the audio control section output the utterance content. This preliminary action creates user anticipation while ensuring reliable message delivery.
2Productivity
If the robot outputs audio immediately to convey information efficiently, then communication speed is improved, but the affectiveness and emotional expression of the communication deteriorates
Solution Approach 1:
The system dynamically adjusts the timing of audio output based on the execution status of movement actions. The audio control section is configured to output utterance content only after the movement control section has executed the corresponding motion. This dynamic timing adjustment maintains communication efficiency while significantly improving affective communication effectiveness by synchronizing audio with expressive motion.
Data Source
AI summary
The present invention allows a robot to carry out communication with excellent affectiveness. A speech and behavior control device (1) includes an utterance content selecting section (16) which selects utterance content of a robot (100) from among a plurality of utterances, a movement control section (17) which controls a movable part (13) to move based on a kind of feeling corresponding to the utterance content, and an audio control section (18) which controls the robot (100) to output the utterance content as audio after movement of the movable part (13) has been started.