Acoustic Sound Source Localization Using World Model Reflections

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Automated vehicles face challenges in precisely locating two-wheeled vehicles, such as motorbikes, due to their agility and smaller size, which makes them difficult to recognize in traffic, especially when occluded by other vehicles or structures, and visual perception is limited.

Innovation Solution

A method using multiple microphones on a vehicle to record sound and determine the direction or position of a sound source, incorporating a world model created from environment sensor data and digital map information to account for sound reflections and occlusions, allowing for more precise localization and adaptation of driving behavior.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If visual perception systems are used to detect two-wheeled vehicles, then detection capability is improved under clear conditions, but detection reliability deteriorates when vehicles are occluded by other vehicles or structures

Engineering Contradiction:
Improvedetection capabilityVSAvoiddetection reliability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent introduces sound as an intermediary sensing modality to detect two-wheeled vehicles. Microphones capture acoustic signals from motorbikes, and the system uses sound reflection patterns off surrounding objects to locate vehicles that are visually occluded. This complementary acoustic sensing approach maintains detection capability when visual systems fail due to occlusion.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system combines multiple sensing functions - visual perception for clear conditions and acoustic perception for occluded conditions - into a unified detection system. The control device processes both visual data from cameras and acoustic data from microphones, allowing the same system to reliably detect two-wheeled vehicles across varying environmental conditions and occlusion scenarios.

Inventive Principle:
Principle #6Universality (Multi-functionality)

2Measurement precision

If sound reflections are utilized to locate sound sources, then localization precision in occluded environments is improved, but system complexity increases due to world model integration

Engineering Contradiction:
Improvelocalization precisionVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system performs preliminary actions by pre-building a world model that maps the environment and identifies reflective surfaces before acoustic localization is needed. This pre-established environmental model allows the system to quickly interpret sound reflection patterns without real-time computational complexity, as the geometric relationships are already calculated and stored.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system uses feedback from the world model to correct and refine sound source localization. By comparing expected sound reflection patterns based on the pre-built environmental model with actual acoustic measurements, the system can iteratively improve localization precision while keeping computational complexity manageable through model-based predictions.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables earlier detection and more precise localization of two-wheeled vehicles, improving safety by allowing the vehicle to adjust its behavior to avoid potential collisions and provide warnings to the driver.

Implementation Method 1

a sound generated by the sound source is recorded by several microphones arranged on a vehicle

Methodology Applied
Scientific EffectSound wave propagation: Sound

Implementation Method 2

a direction and/or position of the sound source is determined relative to the vehicle using a delay in the reception of the sound at one of the microphones in relation to another of the microphones

Methodology Applied
Scientific EffectTime delay of sound reception: Speed of Sound

Implementation Method 3

a world model, which is created using data recorded by means of an environment sensor system of the vehicle and/or map information from a digital map and which contains information about objects on which the sound is reflected

Methodology Applied
Scientific EffectSound reflection: Reflection

Data Source

PatentUS20240334124A1Method for locating a sound source
Publication Date: 2024.10.03 DAIMLER TRUCK AG
  • US20240334124A1 patent drawing
  • US20240334124A1 patent drawing

AI summary

A sound source is located by recording a sound generated by the sound source by several microphones arranged on a vehicle. A direction or position of the sound source is determined relative to the vehicle using a delay in the reception of the sound at one of the microphones in relation to another of the microphones.