Audio Description Mixing Using Loudness-Based Gain Adjustment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The existing audio mixing systems require significant time and effort from audio engineers to generate audio mixes with audio descriptions, especially when multiple formats and languages are involved, leading to lengthy processing times for content like movies.
Innovation Solution
A computer-implemented method for automatically generating audio mixes by receiving audio object and description data, calculating loudness, and adjusting mixing parameters to visualize and apply gain adjustments, thereby reducing the time required for mixing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual mixing is performed by audio engineers, then quality and consistency of audio description mixing is maintained, but time consumption increases significantly (16-24 person-hours per 90-minute movie)
Solution Approach 1:
The system enables automated audio mixing by having the computer automatically calculate loudness values, determine mixing parameters, and generate the mixed audio output without requiring manual audio engineer intervention for each mixing operation
Solution Approach 2:
The system automatically adjusts mixing parameters including gain values and ducking curves based on calculated loudness measurements, transforming the manual parameter adjustment process into an automated parameter optimization process
2Adaptability or versatility
If multiple audio formats and languages are processed, then versatility and adaptability of the mixing system is improved, but the time required multiplies significantly
Solution Approach 1:
The automated mixing system processes multiple audio formats (stereo, 5.1 surround, 7.1 surround, Ambisonics, Dolby Atmos) and multiple languages through a single unified algorithm that calculates loudness and determines mixing parameters independently of the specific format or language being processed
3Productivity
If automated mixing is implemented, then productivity is significantly improved (reducing mixing time from 16-24 hours to approximately 30 minutes), but device complexity increases due to loudness calculation and parameter generation requirements
Solution Approach 1:
The system replaces the mechanical manual mixing process with an automated computational process that uses algorithms to calculate loudness values and determine mixing parameters, substituting human auditory judgment and manual adjustment with automated signal processing
Data Source
Figure 1
Figure 2~5
Figure 4
AI summary
A computer-implemented method of audio processing, the method comprising: receiving audio object data and audio description data, wherein the audio object data includes a first plurality of audio objects; calculating a long-term loudness of the audio object data and a long- term loudness of the audio description data; calculating a plurality of short-term loudnesses of the audio object data and a plurality of short-term loudnesses of the audio description data; reading a first plurality of mixing parameters that correspond to the audio object data; generating a second plurality of mixing parameters based on the first plurality of mixing parameters, the long-term loudness of the audio object data, the long-term loudness of the audio description data, the plurality of short-term loudnesses of the audio object data, and the plurality of short-term loudnesses of the audio description data; generating a gain adjustment visualization corresponding to the second plurality of mixing parameters, the audio object data and the audio description data; and generating mixed audio object data by mixing the audio object data and the audio description data according to the second plurality of mixing parameters, wherein the mixed audio object data includes a second plurality of audio objects, wherein the second plurality of audio objects correspond to the first plurality of audio objects mixed with the audio description data according to the second plurality of mixing parameters.