Voice Synthesis Harmonic Amplitude Distribution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing voice synthesis techniques are complex and inefficient, particularly in converting a voice with neutral features to one with target features like gravelliness or huskiness, as they require multiple processing steps.
Innovation Solution
A method and apparatus that designate a target feature for voice synthesis by specifying harmonic frequencies and amplitude spectrum envelopes, and generate a frequency spectrum based on harmonic amplitude distributions for each harmonic component, simplifying the process by using predictive statistical models to adjust amplitude and phase distributions accordingly.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If sample concatenate-type voice synthesis is used to generate a voice signal with neutral voice features and then convert it to target features, then a voice with desired phonemes and target features can be generated, but the processing becomes complicated
Solution Approach 1:
The voice signal is segmented into multiple harmonic components, with each component's amplitude spectrum envelope independently adjusted according to target voice features. This allows direct synthesis of voiced signals with desired characteristics without complex post-processing conversion.
Solution Approach 2:
The invention changes the parameter adjustment approach by directly modifying the amplitude spectrum envelope parameters of individual harmonic components during synthesis, rather than generating a neutral voice and converting it later. This parameter-level control simplifies the overall processing while achieving accurate target voice features.
2Manufacturing precision
If multiple processing steps are used to convert voice from neutral features to target features, then voice quality can be improved, but processing efficiency decreases
Solution Approach 1:
The target voice features are incorporated into the amplitude spectrum envelope of each harmonic component during the initial synthesis stage. This preliminary integration of target features eliminates the need for subsequent conversion steps, thereby improving processing efficiency while maintaining voice quality.
Solution Approach 2:
The invention merges the voice synthesis process with target feature application into a single integrated process. By combining the generation of harmonic components and the application of target voice features into one step, processing efficiency is improved without compromising voice quality.
3Ease of operation
If harmonic amplitude distribution is specified for each harmonic component based on target feature, amplitude spectrum envelope, and harmonic frequency, then voice with target feature can be generated directly, but calculation complexity increases
Solution Approach 1:
The invention applies local quality by specifying the amplitude spectrum envelope for each individual harmonic component based on its specific frequency and the target voice features. This localized adjustment allows direct generation of voiced signals with target features while maintaining manageable calculation complexity through structured parameter specification.
Data Source
AI summary
A voice synthesis method designates a target feature of a voice to be synthesized; specifies harmonic frequencies for a plurality of respective harmonic components of the voice and an amplitude spectrum envelope of the voice; specifies a harmonic amplitude distribution of each of the plurality of respective harmonic components based on (i) the target feature, (ii) the amplitude spectrum envelope, and (iii) the harmonic frequency specified for the respective harmonic component, the harmonic amplitude distribution representing a distribution of amplitudes in a unit band with a peak amplitude corresponding to the respective harmonic component; and generates a frequency spectrum of the voice with the target feature based on harmonic amplitude distributions specified for each of the plurality of respective harmonic components and the amplitude spectrum envelope.