Robot Audio Augmentation for Condition-Based State Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

User interaction with mobile robots is challenging due to limited electronic communication capabilities and the need for more intuitive feedback on their internal state, leading to frustration and a lack of responsiveness.

Innovation Solution

Implementing audio enhancements that augment the physical sounds of a robot's movable components to convey its internal conditional state, such as emotion or operational mode, providing real-time, intuitive feedback to users.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If audio enhancement is added to convey internal state, then communication bandwidth is improved, but device complexity increases

Engineering Contradiction:
Improvecommunication bandwidthVSAvoiddevice complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent introduces audio enhancement as an intermediary medium to convey the robot's internal state to the user. The audio subsystem acts as a mediator that translates internal conditional states (emotions, operational modes) into audible signals, enabling communication without requiring direct visual contact or complex electronic displays.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional visual/mechanical communication methods (screens, lights, physical gestures) with audio-based communication. This substitution allows the robot to convey internal states through sound waves rather than requiring complex visual display systems or mechanical expressiveness.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If audio enhancement is used to convey internal state, then user engagement is improved, but manufacturing cost increases

Engineering Contradiction:
Improveuser engagementVSAvoidmanufacturing cost
Core Design Contradiction:
Ease of operationVSEase of manufacture

Solution Approach 1:

The audio subsystem is designed to serve multiple functions: conveying operational status, expressing emotional states, providing feedback, and enabling communication. This multi-functionality allows a single audio component to replace what would otherwise require multiple separate systems (displays, sensors, actuators), thereby reducing overall manufacturing costs while improving user engagement.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Object-generated harmful factors

If physical sounds are diminished through audio enhancement, then desirable sound perception is improved, but actual acoustic output is reduced

Engineering Contradiction:
Improveundesirable physical soundsVSAvoidsound output
Core Design Contradiction:
Object-generated harmful factorsVSReliability

Solution Approach 1:

The patent converts the harmful effect of undesirable physical sounds (mechanical noises from motors, actuators) into a benefit by using audio enhancement to mask or mask them. The generated audio signals are designed to complement or mask the unwanted mechanical sounds, transforming a negative acoustic characteristic into an opportunity for creating a more pleasant overall sound profile that conveys the robot's internal state.

Inventive Principle:
Principle #22Blessing in disguise (Convert harm into benefit)

Data Source

PatentUS11633863B2Condition-based robot audio techniques
Publication Date: 2023.04.25 DIGITAL DREAM LABS INC
  • US11633863B2 patent drawing
  • US11633863B2 patent drawing
  • US11633863B2 patent drawing

AI summary

Methods, systems, and apparatus, including computer programs encoded on computer storage media, for audio augmentation of physical robot sounds. A robot can determine that a first physically moveable component of the robot is to be actuated and in response, obtain a conditional state of the robot. The robot can obtain an audio object that generates an audio enhancement for the first physically moveable component being actuated, the audio enhancement having one or more characteristics that match the obtained conditional state of the robot. The robot can output the audio enhancement while actuating the first physically moveable component.