Sound Editing Device for Ensemble Clarity via Transfer Functions
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In ensemble performances, musicians find it difficult to maintain balanced volume levels due to the challenge of hearing their own volume, leading to sound saturation in small performance halls.
Innovation Solution
A sound editing device and method that uses a trained model to estimate effect information from audio signals, enhancing clarity without increasing volume, allowing musicians to recognize their own output sound and adjust accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If effects are added to the audio signal to increase clarity of sound, then the performer will be able to recognize his/her own output sound, but the clarity of each performer's sound changes in accordance with the sounds of the surrounding performers making it complex
Solution Approach 1:
The system pre-calculates and stores transfer functions that represent the acoustic characteristics of the performance space before the actual performance. These transfer functions are obtained by measuring the impulse response between microphones positioned at performer locations and speakers. During performance, the clarity enhancement is achieved by applying these pre-computed transfer functions to each performer's audio signal, avoiding real-time complex calculations and enabling efficient clarity enhancement.
Solution Approach 2:
The system introduces transfer functions as an intermediary element that mediates between the raw audio signals and the final clarity-enhanced output. The transfer function acts as a filter that selectively enhances the target performer's sound while attenuating surrounding performers' sounds. This intermediary approach simplifies the processing by decoupling the complexity of real-time acoustic analysis from the real-time audio enhancement, achieving clarity improvement without excessive computational complexity.
2Measurement precision
If performers increase their own volume to hear themselves, then they can recognize their own output sound, but it becomes difficult to maintain a balanced volume among instruments
Solution Approach 1:
The system applies different audio processing characteristics to different performers based on their individual positions in the performance space. Each performer's audio signal is processed with a transfer function specific to their location, creating localized clarity enhancement for each performer without affecting others. This allows each performer to hear themselves clearly at their original volume level while maintaining overall volume balance among all instruments.
Solution Approach 2:
The system creates a feedback loop where each performer's audio signal is processed through a transfer function that represents the acoustic path from their instrument to their ears. This feedback mechanism allows performers to hear their own sound clearly mixed with the ensemble, enabling them to maintain appropriate volume levels without needing to increase their individual volume to compensate for poor self-monitoring.
Data Source
AI summary
A sound editing device includes at least one processor that is configured to execute a first receiving unit configured to receive a first audio signal, a second receiving unit configured to receive a second audio signal, and an estimation unit configured to estimate effect information that reflects an effect to be applied to the first audio signal, from the first and second audio signals, by using a trained model indicating an input-output relationship between first and second input audio signals and output effect information that reflects an effect to be applied to the first input audio signal.