Auralization for Multi-Microphone Devices with Arbitrary Geometry

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing signal processing techniques for estimating sound source location using multiple microphones are limited by the assumption of linear or circular arrays, and changes in device geometry, such as arbitrary shapes, complicate sound wave analysis, leading to resource wastage due to the need for re-recording in different environments.

Innovation Solution

A method and system for auralizing a multi-microphone device that determines path information using simulated room dimensions and reflection coefficients, generating an auralized impulse response by combining array-related transfer functions and room impulse responses, allowing for accurate sound source localization in arbitrarily shaped environments without the need for re-recording.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If microphones are arranged in linear or circular arrays, then sound wave analysis is simplified, but device geometry flexibility is reduced

Engineering Contradiction:
Improvemicrophone array geometryVSAvoidsound wave analysis
Core Design Contradiction:
Device complexityVSEase of operation

Solution Approach 1:

The patent creates virtual copies of the physical environment through simulated room impulse responses. Instead of physically rearranging microphones, the system synthesizes virtual microphone positions and room acoustics through signal processing, allowing complex geometries to be analyzed as if they were simple arrays.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces physical microphone array configurations with computational models. Rather than mechanically arranging microphones in specific geometries, the system uses digital signal processing to simulate the acoustic field, substituting physical constraints with computational solutions.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of manufacture

If device shape changes to accommodate arbitrary geometries, then manufacturing flexibility is improved, but sound source localization accuracy deteriorates

Engineering Contradiction:
Improvedevice shape flexibilityVSAvoidsound source location estimation
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent transforms the problem by changing parameters from physical microphone positions to virtual impulse responses. By measuring or simulating room impulse responses at different virtual positions and using these as filtering characteristics, the system maintains localization accuracy regardless of physical device geometry.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent creates a universal solution that works for any device geometry. The auralization technique can be applied to arbitrarily shaped devices by generating appropriate virtual impulse responses, making the sound source localization system geometry-independent and universally applicable.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If multiple recordings are done for different device shapes, then localization accuracy for each shape is improved, but resource consumption increases

Engineering Contradiction:
Improvelocalization accuracy per geometryVSAvoidrecording resources
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The patent performs preliminary actions by pre-computing or pre-measuring room impulse responses for various virtual positions and storing them as filtering characteristics. When localization is needed, these pre-computed filters are directly applied without requiring new recordings, saving resources while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

Instead of creating multiple physical recordings for different geometries, the patent creates virtual copies through signal processing. A single set of measurements can be processed to generate impulse responses for multiple virtual positions, eliminating the need for redundant physical recordings.

Inventive Principle:
Principle #26Copying

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate estimation of sound source location in complex environments with arbitrarily shaped devices, reducing resource wastage by simulating various room configurations and accounting for scattering and reverberation effects, thus improving the accuracy and adaptability of multi-microphone devices.

Implementation Method 1

determining path information for one or more sound paths using dimensions and room reflection coefficients of a simulated room

Methodology Applied
Scientific EffectReflection: Reflection

Implementation Method 2

generating an auralized impulse response for the one of the plurality of microphones based at least on the retrieved ARTFs and the determined path information

Methodology Applied
Scientific EffectConvection: Convection

Implementation Method 3

Sound waves may be diffracted and scattered across the device before they are detected by the microphones

Methodology Applied
Scientific EffectScattering: Scattering

Implementation Method 4

Scattering effects, reverberations, and other linear and nonlinear effects across an arbitrarily shaped device may complicate the analysis

Methodology Applied
Scientific EffectReverberation: Reverberation

Data Source

PatentUS11924618B2Auralization for multi-microphone devices
Publication Date: 2024.03.05 GOOGLE LLC
  • US11924618B2 patent drawing
  • US11924618B2 patent drawing
  • US11924618B2 patent drawing

AI summary

A method for auralizing a multi-microphone device. Path information for one or more sound paths using dimensions and room reflection coefficients of a simulated room for one of a plurality of microphones included in a multi-microphone device is determined. An array-related transfer functions (ARTFs) for the one of the plurality of microphones is retrieved. The auralized impulse response for the one of the plurality of microphones is generated based at least on the retrieved ARTFs and the determined path information.