Audio Source Separation for Flexible Remixing and Dubbing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio content is often mixed without preserving original audio sources, making it difficult to remix or upmix for devices with more channels or to adjust spatial position and loudness, and there is a need for improved audio personalization methods.
Innovation Solution
An electronic device with circuitry for audio source separation and dubbing, using techniques like blind source separation and neural networks to decompose audio signals into components, apply replacement conditions, and perform audio dubbing to create personalized outputs.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of manufacture
If audio content is mixed from original audio source signals without keeping original sources, then audio content production is simplified, but remixing and upmixing capabilities are lost
Solution Approach 1:
The system performs preliminary source separation on the mixed audio signal to decompose it into individual audio source signals before remixing or upmixing operations. This preliminary decomposition enables subsequent flexible manipulation of individual sources while maintaining production efficiency.
Solution Approach 2:
The patent introduces an intermediary processing stage that separates mixed audio into component sources using blind source separation techniques. This intermediary representation allows independent manipulation of each source for remixing, upmixing, and spatial positioning without requiring access to original unmixed recordings.
2Adaptability or versatility
If audio source separation techniques are applied to decompose mixed audio, then remixing and upmixing capabilities are enabled, but processing complexity increases
Solution Approach 1:
The patent replaces traditional mechanical audio routing systems with signal processing-based blind source separation. Instead of physically separating audio sources at recording time, the system uses computational algorithms to decompose mixed signals, reducing hardware complexity while enabling flexible source manipulation.
Solution Approach 2:
The system changes the parameter space by transforming the mixed audio signal into a separated source representation using blind source separation. This parameter transformation enables independent control of individual sources for remixing and upmixing operations without proportionally increasing overall system complexity.
3Measurement precision
If blind source separation and neural networks are used for audio decomposition, then source separation accuracy is improved, but computational requirements increase
Solution Approach 1:
The system applies partial processing by separating only the necessary audio sources required for the specific remixing or upmixing task rather than attempting to separate all possible sources. This selective approach maintains separation accuracy while reducing computational energy consumption by avoiding unnecessary processing of irrelevant audio components.
Data Source
AI summary
An electronic device having a circuitry configured to perform audio source separation on an audio input signal to obtain a separated source and configured to perform audio dubbing on the separated source based on replacement conditions to obtain a personalized separated source.