Voice Separation and Pitch Correction for Electroacoustic Audio
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing audio processing technologies lack the ability to efficiently separate and enhance voice and background sound components in audio data, limiting the flexibility and quality of electroacoustic effects in applications such as K-song works and small video productions.
Innovation Solution
A method involving neural networks for sound source separation, followed by electroacoustic processing of voice data, including fundamental frequency correction, quantization, and combination with background sound to create enhanced audio effects.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If audio processing technologies are used to separate and enhance voice and background sound components, then the flexibility and quality of electroacoustic effects are improved, but the device complexity and processing time increase
Solution Approach 1:
The audio data is segmented into multiple frequency bands using filter banks, allowing independent processing of different frequency components. This segmentation enables selective application of electroacoustic effects to specific voice components while preserving background sounds, thereby improving flexibility without requiring complete reprocessing of the entire audio signal.
Solution Approach 2:
The patent extracts the fundamental frequency component from the voice signal using spectral analysis and pitch detection algorithms. By isolating and manipulating only the fundamental frequency components rather than the entire spectrum, the system achieves high-quality electroacoustic effects with reduced processing complexity compared to full-signal processing approaches.
2Manufacturing precision
If neural networks are used for sound source separation, then the separation quality is improved, but the processing time and computational resources increase
Solution Approach 1:
The patent applies preliminary processing steps including filtering and feature extraction before neural network processing. By pre-processing the audio signal to enhance relevant features and reduce noise, the neural network requires fewer iterations and less computational power to achieve high separation quality, thereby reducing overall processing time.
Solution Approach 2:
The system applies neural network processing selectively to specific frequency bands and time segments where voice separation is most needed, rather than processing the entire audio signal uniformly. This partial processing approach maintains high separation quality in critical regions while significantly reducing total computational time and resource requirements.
Data Source
Figure 1~2
Figure 3
Figure 4
AI summary
A method (100) of processing audio data, relates to a field of speech synthesis technology. The method includes: decomposing (S110) original audio data to obtain voice audio data and background audio data; performing (S120) electroacoustic processing on the voice audio data to obtain electroacoustic voice data; and combining (S130) the electroacoustic voice data and the background audio data to obtain target audio data. An apparatus (500) of processing audio data, an electronic device (600), and a storage medium (608) are further provided.