Interactive Robot Speech and Motion Adaptation via Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional robots lack environmental adaptability and personality reflection in speech and motion, leading to repetitive interactions that fail to convey a friendly and intelligent demeanor during conversations with humans.

Innovation Solution

A method and apparatus that analyze interlocutor conversation information, including voice and image data, to determine and adjust the speech and motion properties of an interactive robot based on verbal and nonverbal properties, context, and default settings, enabling dynamic responses that emulate or contrast the interlocutor's behavior.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If robots use preset vocal characteristics and preset gestures, then the robot can maintain consistent personality, but the robot lacks environmental adaptability and cannot reflect the interlocutor's verbal property

Engineering Contradiction:
Improveenvironmental adaptabilityVSAvoidspeech and motion control complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system extracts verbal properties (pitch, amplitude, speed) and nonverbal properties (motion frequency, motion size) from the interlocutor's conversation information, then uses this extracted information as feedback to dynamically determine the robot's speech and motion properties. This feedback loop enables the robot to adapt its behavior to match or contrast with the interlocutor's characteristics while maintaining its own personality.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent implements dynamic adjustment of speech and motion properties by allowing the robot to change its vocal characteristics (pitch, amplitude, speed) and motion characteristics (frequency, size) based on real-time analysis of interlocutor properties and conversation context, rather than using fixed preset values. This makes the robot's behavior flexible and adaptive to different interaction scenarios.

Inventive Principle:
Principle #15Dynamics

2Ease of operation

If robots repeat the same type of speech and gestures, then the robot maintains consistent personality, but the interaction becomes repetitive and fails to convey friendliness and intelligence

Engineering Contradiction:
Improveinteraction qualityVSAvoidspeech and motion determination complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The system continuously monitors and extracts properties from the interlocutor's speech and gestures, then uses this information to dynamically adjust the robot's own speech and motion properties. This feedback mechanism enables the robot to vary its behavior in response to the interlocutor, making interactions more engaging and natural while maintaining personality consistency through controlled adaptation.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent changes multiple parameters simultaneously including pitch, amplitude, speed of speech, and frequency and size of motions. By adjusting these parameters based on interlocutor properties and conversation context, the robot can convey different emotions and levels of engagement, making interactions feel more friendly and intelligent without requiring complex natural language generation capabilities.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If the robot adapts speech and motion properties based on interlocutor properties and context, then the robot appears friendly and intelligent, but the computational requirements and processing time increase

Engineering Contradiction:
Improveconversation adaptabilityVSAvoidproperty determination time
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The system extracts only the essential properties needed for adaptation - verbal properties (pitch, amplitude, speed) and nonverbal properties (motion frequency, motion size) - from the interlocutor's conversation information. By focusing on extracting these specific key parameters rather than analyzing all aspects of the interlocutor's behavior, the system achieves effective adaptation with reduced computational overhead and faster processing.

Inventive Principle:
Principle #2Taking out (Extraction)

Data Source

PatentUS10777198B2Apparatus for determining speech properties and motion properties of interactive robot and method thereof
Publication Date: 2020.09.15 ELECTRONICS & TELECOMM RES INST
  • US10777198B2 patent drawing
  • US10777198B2 patent drawing
  • US10777198B2 patent drawing

AI summary

Disclosed herein are an apparatus and method for determining the speech and motion properties of an interactive robot. The method for determining the speech and motion properties of an interactive robot includes receiving interlocutor conversation information including at least one of voice information and image information about an interlocutor that interacts with an interactive robot, extracting at least one of a verbal property and a nonverbal property of the interlocutor by analyzing the interlocutor conversation information, determining at least one of a speech property and a motion property of the interactive robot based on at least one of the verbal property, the nonverbal property, and context information inferred from a conversation between the interactive robot and the interlocutor, and controlling the operation of the interactive robot based on at least one of the determined speech property and motion property of the interactive robot.