Audio Mixing Simulation for Live-Like Nonlinear Sound Playback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Modern audio playback systems fail to replicate the acoustic attributes of live performances due to electronic recording techniques that lack the nonlinear propagation and mixing effects present in live sound, resulting in a sterile listening experience.

Innovation Solution

A mixing signal processing technique that simulates the linear and nonlinear effects of sound propagation and mixing in air by modifying digital audio recordings to introduce intermodulation products and frequency-dependent attenuation, enhancing the audio reproduction to mimic live performances.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If electronic recording techniques are used to capture and reproduce audio, then audio playback is convenient and controllable, but the acoustic attributes of live performance are lost

Engineering Contradiction:
Improveaudio playback convenienceVSAvoidacoustic attribute fidelity
Core Design Contradiction:
Ease of operationVSReliability

Solution Approach 1:

The patent introduces an acoustic simulation processing module as an intermediary between the digital audio signal and the output transducer. This module synthesizes virtual acoustic effects (reverberation, spatial distribution, nonlinear mixing) that mimic live performance characteristics, thereby mediating between the convenience of electronic playback and the fidelity of live acoustic attributes

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a virtual copy of the live acoustic environment by modeling and reproducing its key characteristics through signal processing. This includes copying the nonlinear mixing effects, frequency-dependent attenuation, and spatial distribution patterns of live sound fields, allowing electronic recordings to convey the essence of live performance without requiring actual live acoustics

Inventive Principle:
Principle #26Copying

2Adaptability or versatility

If manual sound controls are provided for adjusting audio characteristics, then user customization is enabled, but the listening experience is compromised due to sub-optimal settings and lack of training

Engineering Contradiction:
Improveuser customization capabilityVSAvoidaudio reproduction quality
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent implements automatic acoustic simulation processing that self-adjusts audio characteristics based on the recorded signal properties and playback context. The system autonomously analyzes the audio content and applies appropriate acoustic effects without requiring user intervention or expertise, thereby providing reliable audio reproduction while maintaining adaptability to different content types

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent dynamically changes multiple audio parameters (reverberation time, spatial distribution, frequency response, nonlinear mixing coefficients) based on automated analysis of the audio signal characteristics. This allows the system to optimize audio reproduction quality for different types of recorded content without requiring manual user adjustment

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If multiple audio transducers are employed for generating audible sound, then sound output flexibility is increased, but the listening experience is compromised because reproduction does not account for transducer type and manufacture

Engineering Contradiction:
Improvetransducer output flexibilityVSAvoidaudio reproduction accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent applies different acoustic simulation processing parameters tailored to specific transducer types and characteristics. The system analyzes the playback device properties and adjusts the acoustic effects (reverberation, spatial distribution, frequency response) to compensate for each transducer's unique strengths and weaknesses, thereby maintaining accurate audio reproduction across diverse hardware platforms

Inventive Principle:
Principle #3Local quality

4Device complexity

If digital audio recordings are reproduced without simulating nonlinear propagation effects, then processing complexity is reduced, but the listening experience lacks acoustic richness and tonal balance

Engineering Contradiction:
Improvesignal processing complexityVSAvoidacoustic richness
Core Design Contradiction:
Device complexityVSReliability

Solution Approach 1:

The patent implements a selective approach to nonlinear effect simulation, applying only the most perceptually significant acoustic effects at optimized intensity levels. Rather than attempting to perfectly replicate all physical propagation effects, the system focuses on reproducing the key characteristics (second-order nonlinear mixing, frequency-dependent attenuation) that have the greatest impact on perceived acoustic richness, thereby achieving good results with moderate processing complexity

Inventive Principle:
Principle #16Partial or excessive action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

The technique improves the listening experience by recreating the natural acoustic richness and tonal balance of live performances, making digital recordings sound more immersive and enjoyable, even at lower volumes.

Implementation Method 1

modifies digital audio recordings to simulate the linear and nonlinear effects of propagation and mixing of sounds in air

Methodology Applied
Scientific EffectNonlinear propagation:

Implementation Method 2

When multiple sounds or complex sounds comprised of multiple frequencies in the audible spectrum propagate in such a nonlinear medium, they transfer energy into sound at new frequencies given by the sums and differences of the original signal frequencies

Methodology Applied
Scientific EffectIntermodulation: Heterodyne

Implementation Method 3

The mixing signal processing technique may improve the ability of a system to reproduce the effects of a live performance using a digital audio recording

Methodology Applied
Scientific EffectFrequency-dependent attenuation: Absorption (EM radiation)

Data Source

PatentUS9560466B2Systems and methods for simulation of mixing in air of recorded sounds
Publication Date: 2017.01.31 DM DSP LLC
  • US9560466B2 patent drawing
  • US9560466B2 patent drawing
  • US9560466B2 patent drawing

AI summary

A mixing signal processing technique modifies digital audio recordings to simulate the linear and nonlinear effects of propagation and mixing of sounds in air. When multiple sounds or complex sounds comprised of multiple frequencies in the audible spectrum propagate in such a nonlinear medium, they transfer energy into sound at new frequencies given by the sums and differences of the original signal frequencies. The mixing signal processing technique may improve the ability of a system to reproduce the effects of a live performance using a digital audio recording.