Audio-Based Emergency Vehicle Detection Using Doppler Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Reliable detection and tracking of acoustic event sources, such as emergency vehicle sirens, are challenging in real-world environments with noise and interfering signals, especially when the source and detection platform are in motion.

Innovation Solution

A detection and tracking system employing beamforming with time-frequency mask noise reduction, neural network-based event detection, pattern extraction, angular spectrum analysis, and Doppler shift frequency tracking to identify the source's direction and motion relative to the platform.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional acoustic detection methods are used in noisy environments with motion, then detection reliability deteriorates, but implementing advanced signal processing increases system complexity

Engineering Contradiction:
Improvedetection reliabilityVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The acoustic signal processing is segmented into multiple stages: beamforming to separate spatial signals, noise reduction to isolate target frequencies, and neural network classification to identify event types. This segmentation allows each component to focus on specific aspects of signal processing, improving reliability without requiring all components to handle the full complexity simultaneously.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

A neural network classifier is introduced as an intermediary between raw acoustic signals and detection decisions. This intermediary processes the beamformed and noise-reduced signals, learning to distinguish emergency vehicle sirens from other acoustic events, thereby improving detection reliability while encapsulating complexity within the trained model rather than requiring complex real-time processing logic.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If advanced signal processing techniques are applied to distinguish signal from noise, then measurement precision improves, but computational requirements and processing time increase

Engineering Contradiction:
Improvesource detection precisionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

Beamforming and noise reduction are applied as preliminary processing steps before event detection. By pre-processing the acoustic signals to enhance spatial separation and reduce background noise, the subsequent neural network classification operates on cleaner, more distinguishable features, improving measurement precision while reducing the computational burden during critical detection phases.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If multiple processing stages are implemented to track moving acoustic sources, then tracking accuracy improves, but device complexity increases

Engineering Contradiction:
Improvetracking accuracyVSAvoidprocessing system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The tracking system is segmented into distinct functional modules: beamforming for spatial signal separation, noise reduction for signal enhancement, neural network classification for event identification, and direction-of-arrival estimation for tracking. Each module handles a specific aspect of the tracking problem, improving overall tracking accuracy while allowing independent optimization and maintenance of each component.

Inventive Principle:
Principle #1Segmentation

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Improves the reliability of detecting and tracking acoustic sources by effectively distinguishing between signal and noise, even in noisy environments, and determining the source's direction and motion, enhancing safety in autonomous vehicle operations.

Implementation Method 1

acoustic signals received from an array of microphones

Methodology Applied
Scientific EffectAcoustic signal reception: Sound

Implementation Method 2

performing beamforming on a plurality of acoustic signal spectra to generate a first beam signal spectrum and a second beam signal spectrum

Methodology Applied
Scientific EffectBeamforming:

Implementation Method 3

beamforming with time-frequency mask noise reduction

Methodology Applied
Scientific EffectTime-frequency analysis:

Implementation Method 4

detecting an acoustic event associated with the acoustic source, in at least one of the first beam signal spectrum and the second beam signal spectrum

Methodology Applied
Scientific EffectAcoustic event detection:

Implementation Method 5

estimating a direction of motion of the acoustic source relative to the array of microphones, the estimation based on a Doppler frequency shift of the acoustic event

Methodology Applied
Scientific EffectDoppler shift: Doppler Effect

Data Source

PatentUS11711648B2Audio-based detection and tracking of emergency vehicles
Publication Date: 2023.07.25 INTEL CORP
  • US11711648B2 patent drawing
  • US11711648B2 patent drawing
  • US11711648B2 patent drawing

AI summary

Techniques are provided for audio-based detection and tracking of an acoustic source. A methodology implementing the techniques according to an embodiment includes generating acoustic signal spectra from signals provided by a microphone array, and performing beamforming on the acoustic signal spectra to generate beam signal spectra, using time-frequency masks to reduce noise. The method also includes detecting, by a deep neural network (DNN) classifier, an acoustic event, associated with the acoustic source, in the beam signal spectra. The DNN is trained on acoustic features associated with the acoustic event. The method further includes performing pattern extraction, in response to the detection, to identify time-frequency bins of the acoustic signal spectra that are associated with the acoustic event, and estimating a motion direction of the source relative to the array of microphones based on Doppler frequency shift of the acoustic event calculated from the time-frequency bins of the extracted pattern.