Audio Description Mixing with Loudness-Adaptive Gain Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio mixing systems require significant time and effort from audio engineers to generate audio mixes with audio descriptions, especially when multiple formats and languages are involved, leading to inefficiencies in the process.
Innovation Solution
A computer-implemented method and apparatus for automatically generating audio mixes by receiving audio object and description data, calculating loudness, and applying gain adjustments based on mixing parameters to integrate audio descriptions into audio object data, reducing the need for manual intervention and speeding up the mixing process.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If manual mixing is performed by audio engineers, then the quality and consistency of the audio description mix is maintained, but the time required to generate the mix increases significantly
Solution Approach 1:
The system enables automated mixing by allowing the audio description data to self-adjust its gain levels based on the main audio loudness analysis. The computer automatically performs the mixing operation without human intervention, using algorithms to analyze loudness and apply appropriate gain adjustments, thereby eliminating the time-consuming manual process while maintaining consistent quality results.
Solution Approach 2:
The patent replaces the mechanical manual mixing process with an automated computational system. Instead of audio engineers manually adjusting levels, the system uses computer-based loudness analysis and automatic gain adjustment algorithms to perform the mixing, substituting human manual operations with automated electronic processing.
2Adaptability or versatility
If multiple audio formats and languages are processed, then the versatility and accessibility of the content is improved, but the total time required for mixing increases multiplicatively
Solution Approach 1:
The automated mixing system is designed to handle multiple audio formats (stereo, 5.1 surround, Dolby Atmos) and multiple languages through a single universal process. The system analyzes the main audio regardless of format or language and applies the same automated gain adjustment algorithm to the audio description, making the process versatile across different content types without requiring separate manual mixing for each combination.
Solution Approach 2:
The system automatically adapts to different audio formats by detecting and responding to format-specific parameters. The automated process adjusts to various channel configurations and spatial audio characteristics without manual intervention, changing its processing parameters automatically based on the input format while maintaining consistent quality across all formats and languages.
3Productivity
If automated mixing is implemented, then the processing time is reduced, but the complexity of the mixing system increases
Solution Approach 1:
The system introduces an automated mixing system as an intermediary between the main audio and audio description components. This intermediary automatically analyzes the main audio loudness and adjusts the audio description gain levels accordingly, serving as an automated mediator that eliminates the need for manual mixing while managing the complexity through standardized algorithms and consistent processing rules.
Data Source
AI summary
A computer-implemented method of audio processing, the method comprising: receiving audio object data and audio description data, wherein the audio object data includes a first plurality of audio objects; calculating a long-term loudness of the audio object data and a long- term loudness of the audio description data; calculating a plurality of short-term loudnesses of the audio object data and a plurality of short-term loudnesses of the audio description data; reading a first plurality of mixing parameters that correspond to the audio object data; generating a second plurality of mixing parameters based on the first plurality of mixing parameters, the long-term loudness of the audio object data, the long-term loudness of the audio description data, the plurality of short-term loudnesses of the audio object data, and the plurality of short-term loudnesses of the audio description data; generating a gain adjustment visualization corresponding to the second plurality of mixing parameters, the audio object data and the audio description data; and generating mixed audio object data by mixing the audio object data and the audio description data according to the second plurality of mixing parameters, wherein the mixed audio object data includes a second plurality of audio objects, wherein the second plurality of audio objects correspond to the first plurality of audio objects mixed with the audio description data according to the second plurality of mixing parameters.