Spatial Ducking Audio via Beamforming Loudspeaker Array

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio systems disrupt listeners when outputting ongoing sound program content, such as music, during interactions with virtual personal assistants (VPAs) due to volume changes or pausing, which can be distracting for both the user and others.

Innovation Solution

The audio system employs spatial ducking, using a loudspeaker array to move the sound program content into the background by decorrelating and redistributing its audio beams, allowing alert audio from the VPA to be output in the foreground without pausing or significantly reducing the music's volume.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the volume of ongoing sound program content is reduced or paused to output alert audio, then the intelligibility of alert audio is improved, but the listener experience is disrupted and distracted

Engineering Contradiction:
Improveintelligibility of alert audioVSAvoidlistener distraction
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent applies spatial dimensionality by using beamforming technology to create distinct spatial zones for program audio and alert audio. The program audio is directed toward specific listening positions while alert audio is projected in other directions, allowing both to coexist without volume reduction. This spatial separation resolves the contradiction by adding a dimensional aspect (spatial positioning) to the audio output strategy.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The audio system segments the sound field into multiple independent beam regions, each carrying different audio content. The program audio is segmented into specific directional beams while alert audio is segmented into other directional beams. This segmentation allows simultaneous output of both audio types without mutual interference, eliminating the need for volume reduction or pausing.

Inventive Principle:
Principle #1Segmentation

2Measurement precision

If the volume of ongoing sound program content is reduced to output alert audio, then the alert audio becomes more audible, but the disruption to both the user and other listeners increases

Engineering Contradiction:
Improveaudibility of alert audioVSAvoiddisruption to listeners
Core Design Contradiction:
Measurement precisionVSObject-generated harmful factors

Solution Approach 1:

The system transitions from a single-dimension volume control approach to a multi-dimensional spatial audio approach. By utilizing directional beamforming, the system can maintain full program audio volume while projecting alert audio in specific spatial directions where it will be heard by intended listeners without disrupting others who are not in the alert audio's directional path.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The patent implements local quality by creating spatially localized audio zones. Different regions of the listening environment receive different audio content at different levels. Listeners in specific locations hear alert audio clearly while program audio continues at full volume in other spatial zones, thereby achieving alert audibility without causing widespread disruption.

Inventive Principle:
Principle #3Local quality

3Measurement precision

If simple volume reduction is used to output alert audio, then the alert audio is more audible, but the listener experience becomes less pleasant and more disruptive

Engineering Contradiction:
Improveaudibility of alert audioVSAvoidlistener experience quality
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The system replaces the one-dimensional volume adjustment mechanism with a multi-dimensional spatial positioning mechanism. Instead of reducing volume to make alert audio audible, the system uses directional beamforming to project alert audio spatially, maintaining program audio volume and creating a more natural, less disruptive listening experience that preserves audio quality and listener engagement.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach provides a seamless and less disruptive listening experience by maintaining the music in the background while ensuring clear, intelligible VPA alerts are heard, reducing distractions and maintaining a pleasant audio environment.

Implementation Method 1

a beam former may receive input audio channels of sound program content (e.g., music) and convert the input audio channels to several driver signals that drive the transducers of a loudspeaker array to produce one or more sound beam patterns

Methodology Applied
Scientific EffectElectroacoustic transduction:

Data Source

PatentEP3410740B1Spatially ducking audio produced through a beamforming loudspeaker array
Publication Date: 2021.09.08 APPLE INC
  • EP3410740B1 patent drawingFigure 1A
  • EP3410740B1 patent drawingFigure 1B
  • EP3410740B1 patent drawingFigure 2A

AI summary

A method for adjusting audio being outputted through a beam forming loudspeaker array. Program audio is rendered to drive the loudspeaker array to produce sound beams having i) a main content pattern that is aimed at a listener, superimposed with ii) several diffuse content patterns that are aimed away from the listener. In response to receiving an alert message that refers to alert audio, the portion of the program audio in the main pattern is moved into the diffuse patterns, and the alert audio is rendered to drive the loudspeaker array so that the portion of the program audio in the main pattern is replaced with the alert audio. Other embodiments are also described and claimed.