Content-Aware Audio Ducking for Consistent Loudness Separation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing audio systems perform audio ducking by attenuating the volume of slave tracks without considering their loudness relative to the master track, leading to issues with imperceptible changes and difficulty in adjusting parameters for desired loudness levels.

Innovation Solution

A content-aware audio ducking method that specifies a minimum loudness separation between master and slave tracks, attenuating the slave tracks based on their loudness levels and performing ducking on a window-by-window basis to minimize the effect of short-term transients and outlier samples.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If audio ducking is performed by attenuating slave track volume without considering loudness levels, then the master track becomes more audible, but the slave track may become nearly or completely inaudible when already quiet, or remain too loud when far too loud

Engineering Contradiction:
Improveloudness level considerationVSAvoidmanual parameter adjustment
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The audio system automatically determines the appropriate attenuation amount for slave tracks by comparing loudness levels between master and slave tracks, eliminating the need for manual parameter adjustment. The system serves itself by intelligently calculating and applying the correct ducking amount based on measured loudness differentials.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system measures the loudness levels of both master and slave tracks, compares them to determine the differential, and uses this feedback to automatically adjust the attenuation amount. This closed-loop feedback mechanism ensures the slave track is attenuated by the precise amount needed to achieve desired loudness separation.

Inventive Principle:
Principle #23Feedback

2Measurement precision

If audio compressor is used with threshold-based attenuation, then the slave track volume is reduced when master track is loud, but quick transients trigger attenuation even when not perceived as loud, requiring painstaking parameter tweaking

Engineering Contradiction:
Improveperceptible loudness detectionVSAvoidparameter adjustment complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The system changes from using fixed threshold parameters to dynamically calculated attenuation amounts based on measured loudness differentials. By computing the actual loudness differential between master and slave tracks, the system adapts the attenuation parameter to match perceptible loudness differences rather than relying on fixed thresholds that require manual tweaking.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The audio system automatically determines and adjusts compression parameters based on measured loudness levels, eliminating the need for manual parameter tweaking. The system serves itself by calculating the appropriate attenuation amount from the loudness differential without requiring user intervention.

Inventive Principle:
Principle #25Self-service

3Reliability

If window-by-window ducking is performed based on worst case differential, then the effect of short-term transients and outlier samples is minimized, but the processing complexity increases

Engineering Contradiction:
Improvetransient resistanceVSAvoidprocessing complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The audio processing is divided into discrete time windows, with loudness levels measured independently for each window. By segmenting the audio stream into windows and evaluating the worst case differential within each window, the system reliably identifies sustained loudness differences while ignoring transient outliers that occur within individual windows.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system applies attenuation based on the worst case differential within each window, which may be more conservative than necessary for individual samples but ensures reliable performance. This partial action approach processes only the critical worst-case scenario within each window rather than every individual sample, reducing the impact of transient outliers.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS9300268B2Content aware audio ducking
Publication Date: 2016.03.29 APPLE INC
  • US9300268B2 patent drawing
  • US9300268B2 patent drawing
  • US9300268B2 patent drawing

AI summary

A novel audio ducking method that is aware of the loudness levels of the audio content is provided. The method specifies a minimum loudness separation between audio tracks that are designated as masters and audio tracks that are designated as slaves. The method attenuates the volume of the slave tracks in order to provide at least the minimum loudness separation between the slave tracks and the master tracks. The amount of attenuation for a slave is determined based on the loudness levels of the slave and of a master.