Multitrack Audio Masking Visualization for Real-Time Mixing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Multitrack audio mixing is challenging due to the complexity of adjusting multiple parameters and the nonlinear way audio signals combine perceptually, with changes to one track affecting other tracks, compounded by human auditory perception, making it difficult to identify and visualize masking and loudness effectively.
Innovation Solution
Utilizes computational models of human auditory perception to estimate loudness and masking, displaying these in the time domain, allowing real-time visualization and adjustment of audio inputs to reduce masking, and identifying which tracks are causing masking on a selected track.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple audio tracks are mixed together, then the audio output is richer and more complex, but the difficulty of identifying and visualizing masking and loudness increases
Solution Approach 1:
The patent segments the audio spectrum into multiple frequency bands and divides the time domain into segments, allowing individual analysis of masking and loudness in each segment. This segmentation enables visualization of complex multi-track mixes by breaking down the overall signal into manageable components that can be individually processed and displayed.
Solution Approach 2:
The patent introduces an intermediary computational model of human auditory perception that acts as a mediator between the complex audio signals and the visualization display. This intermediary model processes the audio tracks through psychoacoustic calculations, translating complex masking relationships into visual representations that engineers can interpret.
2Measurement precision
If computational models of human auditory perception are used to estimate loudness and masking, then the accuracy of masking detection improves, but the processing time and computational complexity increase
Solution Approach 1:
The patent applies partial action by using simplified versions of computational auditory models that capture essential masking characteristics without requiring full complex psychoacoustic simulations. The system processes audio through a subset of necessary computational steps, achieving sufficient accuracy for mixing decisions while maintaining acceptable processing speeds.
3Ease of operation
If real-time visualization of masking is implemented, then the ability to adjust audio tracks improves, but the processing requirements and system complexity increase
Solution Approach 1:
The patent implements preliminary action by pre-calculating and storing masking information for different audio scenarios and using these pre-computed values during real-time mixing. The system prepares computational frameworks and lookup tables in advance, allowing rapid retrieval and application of masking data during actual audio processing without requiring complex real-time calculations.
Data Source
AI summary
In certain aspects, a method includes receiving a plurality of audio inputs. The method includes determining masking of each audio input of the plurality of audio inputs. The method includes displaying the partial loudness and the masking of each audio input of the plurality of audio inputs in a time domain. Systems and machine-readable media are also provided.