Audio Signal Coherence Reduction via Virtual Channel Separation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Miniaturization of audio capturing devices increases signal coherence between input channels, leading to deteriorated audio reproduction performance and sound positioning issues, especially in headphone rendering, which requires long-tap filters increasing computational load.
Innovation Solution
The method involves generating virtual input channel signals and transmitting multi-channel audio signals with additional reproduction location information, allowing for channel separation based on coherence and real-time head position data to improve rendering performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Volume of moving object
If capturing devices are miniaturized, then device size is reduced and portability is improved, but signal coherence between input channels increases and audio reproduction performance deteriorates
Solution Approach 1:
The patent segments the audio signal processing into multiple independent channels, where each channel signal is processed separately through channel separation based on coherence analysis. This allows the system to handle high-coherence signals from miniaturized microphones by treating them as distinct separable entities rather than mixed signals, thereby maintaining audio reproduction quality despite device miniaturization.
Solution Approach 2:
The patent changes the processing parameters by introducing coherence-based channel separation and head position information integration. By dynamically adjusting the rendering parameters based on real-time head position data and signal coherence measurements, the system compensates for the degraded audio performance caused by miniaturized capturing devices.
2Length of moving object
If microphones are placed closer together for miniaturization, then device compactness is improved, but coherence between input channels increases and sound positioning performance deteriorates
Solution Approach 1:
The patent implements feedback by continuously acquiring head position information and using it to adjust the rendering process in real-time. The system measures the user's head position and feeds this information back to modify the channel separation and sound positioning calculations, thereby compensating for the reduced microphone spacing and maintaining accurate sound positioning performance.
Solution Approach 2:
The patent introduces dynamic adaptation by making the rendering process responsive to real-time head position changes. Instead of using fixed processing parameters, the system dynamically adjusts channel separation and sound positioning based on the user's head movements, which compensates for the static limitation of closely-spaced microphones.
3Reliability
If long-tap filters are used for headphone rendering to simulate echo, then audio realism is improved, but computational load increases
Solution Approach 1:
The patent applies preliminary action by pre-calculating and storing channel separation filters and rendering parameters based on coherence analysis. Instead of performing heavy real-time computations during audio playback, the system prepares the necessary processing filters in advance based on the input signal characteristics, thereby reducing the computational load during actual rendering while maintaining audio realism.
Data Source
AI summary
According to an aspect of an embodiment, an audio generation method includes: receiving an audio signal through at least one microphone; generating an input channel signal corresponding to each of the at least one microphone based on the received audio signal; generating a virtual input channel signal based on the input channel signal; generating additional information including reproduction locations of the input channel signal and the virtual input channel signal; and transmitting a multi-channel audio signal and the additional information, the multi-channel audio signal including the input channel signal and the virtual input channel signal.