Audio Signal Alignment Using Beamforming and Noise Removal

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for capturing and mixing audio signals from multiple sources in a spatial field require significant manual effort and struggle with aligning close and spatial audio signals, especially as distance increases, due to noise interference and time mismatches.

Innovation Solution

A processor-based system that receives audio signals from a close microphone and a microphone array, determines the orientation angle, generates a beam-formed audio signal, and adjusts the beam width to align the signals by identifying and removing noise segments, thereby determining a precise time difference for accurate alignment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual positioning and mixing of audio signals is used, then alignment accuracy can be maintained, but significant time and effort are required

Engineering Contradiction:
Improvealignment accuracyVSAvoidtime and effort required
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system automatically determines the position of the close microphone using HAIP positioning and autonomously calculates the time delay needed for alignment, eliminating the need for manual positioning and mixing while maintaining alignment accuracy

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system uses the determined position information and audio signal characteristics to feedback-adjust the time delay applied to the close microphone signal, ensuring accurate alignment without manual intervention

Inventive Principle:
Principle #23Feedback

2Measurement precision

If known alignment methods are used, then alignment can be achieved at close distances, but alignment fails when the distance between close microphone and spatial capture device increases

Engineering Contradiction:
Improvealignment capabilityVSAvoiddistance range
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The system preliminarily enhances the close microphone signal using beamforming before alignment processing, ensuring the signal remains detectable and alignable even at greater distances where it would otherwise be overwhelmed by noise

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the spatial parameters of the close microphone signal by applying beamforming with specific orientation angles and beam widths, improving signal characteristics to enable alignment at extended distances

Inventive Principle:
Principle #35Parameter changes

3Object-affected harmful factors

If beam width is kept narrow to reduce noise, then noise interference is reduced, but the audio signal from the close microphone may be lost if positioning is inaccurate

Engineering Contradiction:
Improvenoise interferenceVSAvoidsignal detection reliability
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The beam width is made dynamic and adjustable based on positioning accuracy and signal characteristics, narrowing to reduce noise when conditions permit and widening to ensure signal capture when positioning uncertainty exists

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the beam width parameter adaptively based on the determined position accuracy and signal-to-noise conditions, optimizing the balance between noise reduction and signal reliability

Inventive Principle:
Principle #35Parameter changes

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach enhances the alignment of audio signals by reducing background noise and improving the accuracy of time alignment, even at greater distances, by focusing the microphone array on the close microphone source and selectively removing interfering audio segments.

Implementation Method 1

receive a beam-formed audio signal from a microphone array, wherein the beam-formed audio signal is a result of forming a beam of the microphone array directed from the microphone array towards the close microphone so as to enhance the audio signal

Methodology Applied
Scientific EffectBeamforming: Focusing

Data Source

PatentUS10785565B2Distributed audio capture and mixing controlling
Publication Date: 2020.09.22 NOKIA TECHNOLOGIES OY
  • US10785565B2 patent drawing
  • US10785565B2 patent drawing
  • US10785565B2 patent drawing

AI summary

Apparatus including a processor configured to: receive an audio signal from a close microphone, wherein the audio signal is input in a spatial audio mixing, and the close microphone is associated with a first sound source; receive a beam-formed audio signal from a microphone array, wherein the beam-formed audio signal is a result of forming a beam of the microphone array directed from the microphone array towards the close microphone so as to enhance the audio signal; determine a time duration where no further sound source is active within the sound scene the first sound source; and determine a time difference, during the time duration, between the audio signal and the beam-formed audio signal to enable alignment of the audio signal and the beam-formed audio signal.