Audio Signal Panned Source Extraction and Modification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio signal processing technologies lack the ability to effectively isolate and modify center-panned vocal components from other center-panned sources, and fail to efficiently upmix audio signals for surround sound systems, limiting user control over audio levels and source separation.
Innovation Solution
The method involves using a panning index and short-time Fourier transform to identify and extract panned sources, allowing for user-controlled modification and separation of center-panned signals, even in the absence of a corresponding playback channel, by applying a modification function based on panning index values and incorporating transient analysis to differentiate between vocal and percussion components.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional audio signal processing is used, then the overall audio signal is processed, but individual panned sources cannot be isolated and modified independently
Solution Approach 1:
The audio signal is segmented into multiple panned sources based on their panning positions. The method divides the stereo signal into center-panned and side-panned components, allowing independent processing of each source type. This segmentation enables precise isolation of vocal components from other audio elements without processing the entire signal as a single unit.
Solution Approach 2:
A panning index is introduced as an intermediary parameter to characterize the panning position of each frequency component. This intermediary measure enables the system to identify and separate sources based on their spatial position without requiring complex source separation algorithms, thus achieving precise isolation with manageable complexity.
2Measurement precision
If center-panned sources are processed together, then all center-panned signals are modified uniformly, but individual vocal components cannot be distinguished from other center-panned sources
Solution Approach 1:
The method applies different processing characteristics to different local regions of the frequency spectrum. By analyzing the panning index across frequency bands and time, the system identifies regions where vocal components dominate and applies enhancement selectively to those regions while leaving other center-panned sources unaffected. This local quality approach enables precise vocal isolation from other center-panned instruments.
Solution Approach 2:
The system dynamically changes the gain parameter for center-panned components based on their identification as vocal or non-vocal. By detecting transient characteristics and spectral features, the method adjusts the enhancement parameter selectively for vocal components, allowing users to modify vocal levels independently from other center-panned sources through simple parameter control.
3Adaptability or versatility
If audio signals are upmixed for surround sound systems, then the full capabilities of playback systems are utilized, but the ability to control individual source levels in generated channels is limited
Solution Approach 1:
The system provides a universal solution that works with multiple playback configurations (stereo, 5.1 surround, 7.1 surround). The same panning index-based extraction and modification methodology is applied regardless of the target playback system, enabling consistent source-level control across different channel configurations. Users can control individual source levels in generated surround channels with the same ease as in stereo, achieving both adaptability and operational simplicity.
Data Source
AI summary
Modifying a panned source in an audio signal comprising a plurality of channel signals is disclosed. Portions associated with the panned source are identified in at least selected ones of the channel signals. The identified portions are modified based at least in part on a user input.