Robot Sound Event Detection Using Adaptive Noise Modeling

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current robots lack the ability to accurately detect and recognize sound events in their surroundings and interact accordingly, limiting their effectiveness in communication and interaction with users.

Innovation Solution

A robot equipped with microphones to detect sound signals, controllers to determine reference sound pressure levels and detect sound events, and a sound event recognizer to identify and respond to recognized events, along with a mechanism to rotate the robot to face the sound source, enabling it to interact with users more effectively.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the robot uses basic sound detection without background noise adaptation, then the device complexity is reduced, but the measurement precision of sound events deteriorates

Engineering Contradiction:
Improvesound event detection accuracyVSAvoidsound processing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary action by establishing a background noise model before actual sound event detection. The controller continuously monitors and learns the background noise characteristics during idle periods, building a reference profile that is then used to enhance the detection accuracy of subsequent sound events. This preliminary adaptation allows the robot to distinguish actual events from ambient noise more effectively.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements feedback by continuously updating the background noise model based on ongoing environmental monitoring. The controller compares detected sounds against the established noise profile, and when deviations are identified, it adjusts the model accordingly. This closed-loop feedback mechanism enables the system to adapt to changing acoustic environments while maintaining high detection precision without requiring complex manual configuration.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If the robot continuously monitors all sound signals with high sensitivity, then the detection precision is improved, but the loss of time for processing increases

Engineering Contradiction:
Improvesound event detection accuracyVSAvoidsound signal processing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system applies partial action by selectively processing only those sound signals that exhibit characteristics consistent with actual events rather than background noise. Using the established noise model, the controller filters out signals that match the background profile and only performs detailed analysis on deviations. This approach maintains high detection precision while significantly reducing the time spent processing irrelevant continuous sound data.

Inventive Principle:
Principle #16Partial or excessive action

3Adaptability or versatility

If the robot uses a fixed threshold for sound event detection, then the device complexity is reduced, but the adaptability to different environments deteriorates

Engineering Contradiction:
Improveenvironmental adaptation capabilityVSAvoidthreshold adjustment mechanism complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system implements dynamics by transitioning from fixed thresholds to adaptive thresholding based on the learned background noise model. The controller dynamically adjusts detection thresholds according to the current environmental noise characteristics. When the background noise level changes, the system automatically recalibrates its detection parameters, enabling seamless adaptation to different acoustic environments without manual intervention or complex configuration mechanisms.

Inventive Principle:
Principle #15Dynamics

4Ease of operation

If the robot rotates to face the sound source immediately upon detection, then the interaction effectiveness is improved, but the loss of time for rotation and orientation increases

Engineering Contradiction:
Improveuser interaction effectivenessVSAvoidrotation response time
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system performs preliminary action by pre-positioning the robot through rotation to face the detected sound source before initiating full interaction sequences. This preliminary orientation ensures that sensors, cameras, and other interaction components are already optimally positioned when communication begins, enhancing interaction effectiveness while minimizing the time penalty through efficient, pre-planned rotational movements.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The robot can efficiently detect and recognize sound events, allowing for active interaction and improved user communication by accurately determining the source of sounds and responding appropriately.

Implementation Method 1

a microphone configured to receive sound signals

Methodology Applied
Scientific EffectAcoustic to electrical conversion:

Data Source

PatentUS11654575B2Robot
Publication Date: 2023.05.23 LG ELECTRONICS INC
  • US11654575B2 patent drawing
  • US11654575B2 patent drawing
  • US11654575B2 patent drawing

AI summary

A robot includes a microphone configured to receive sound signals, and one or more controllers configured to determine a reference sound pressure level of background noise based on a sound signal received at a first time point via the microphone, detect occurrence of a sound event based on the reference sound pressure level and a sound pressure level of a sound signal received at a second time point via the microphone, recognize an event corresponding to the detected sound event, and control an operation of the robot based on the recognized event.