Speech enhancement techniques on the power spectrum

Abstract

The method provides a spectral speech description to be used for synthesis of a speech utterance, where at least one spectral envelope input representation is received. In one solution the improvement is made by manipulation an extremum, i.e. a peak or a valley, in the rapidly varying component of the spectral envelope representation. The rapidly varying component of the spectral envelope representation is manipulated to sharpen and / or accentuate extrema after which it is merged back with the slowly varying component or the spectral envelope input representation to create an enhanced spectral envelope final representation. In other solutions a complex spectrum envelope final representation is created with phase information derived from one of the group delay representation of a real spectral envelope input representation corresponding to a short-time speech signal and a transformed phase component of the discrete complex frequency domain input representation corresponding to the speech utterance.

Description

TECHNICAL FIELD[0001]The present invention generally relates to speech synthesis technology.BACKGROUND OF THE INVENTIONSpeech Analysis and Speech Synthesis[0002]Speech is an acoustic signal produced by the human vocal apparatus. Physically, speech is a longitudinal sound pressure wave. A microphone converts the sound pressure wave into an electrical signal. The electrical signal can be sampled and stored in digital format. For example, a sound CD contains a stereo sound signal sampled 44100 times per second, where each sample is a number stored with a precision of two bytes (16 bits).[0003]In many speech technologies, such as speech coding, speaker or speech recognition, and speech synthesis, the speech signal is represented by a sequence of speech parameter vectors. Speech analysis converts the speech waveform into a sequence of speech parameter vectors. Each parameter vector represents a subsequence of the speech waveform. This subsequence is often weighted by means of a window. T...

AI Technical Summary

Benefits of technology

[0037]In view of the foregoing, the need exists for an improved spectral magnitude and phase processing technique. More specifically, the object of the present invention is to improve at least one out of controllability, precision, signal quality, processing load, and computational complexity.

[0040]The processing of the spectral envelope is preferably done in the logarithmic domain. However the embodiments described below can also be used in other domains (e.g. linear domain, or any non-linear monotone transformation). The manipulation of the extrema directly on the spectral envelope as opposed another signal representation such as the time domain signal makes the solution simpler and facilitates controllability. It is a further advantage of this solution that only a rapidly varying component has to be derived.

[0055]Deriving from the at least one real spectral envelope input representation a group delay representation and from the group delay representation a phase representation allows a new and inventive creation of a complex spectrum envelope final representation. The phase information in this complex spectrum envelope final representation allows creation of a spectral speech description output vector with improved phase information. A synthesis of a speech utterance using the spectral speech description output vector with the phase information creates a speech utterance with a more natural sound.

[0074]The inventions related to the creation of phase information (second and third inventions) are especially advantageous when combined with the first invention pertaining to the manipulation of the rapidly varying component of the spectral envelope representation. The combination of the improved spectral extrema and the improved phase information allows the creation of natural and clear speech utterances.

Problems solved by technology

However, short-time speech representations can also have lossless representations (for example in the form of overlapping windowed sample sequences or complex spectra).

However, in most applications, the speech description vector is a lossy representation which does not allow for perfect reconstruction of the speech signal.

This technique does not allow for selective formant enhancement.

Low spectral contrast will often result in a voice quality that could be categorised as muffled or dull.

In a synthesis or coding framework, a lack of spectral contrast will often result in an increased perception of noise.

However, attention should be paid because an over-emphasis of formants may destroy the perceived naturalness.

Unfortunately, the decoded speech was often characterised by a loss of brightness because the enhancement filter affected the spectral tilt.

However spectral controllability is limited by criteria such as the size of the filter and the filter configuration, and the spectral tilt compensation filter does not neutralise all unwanted changes in the spectral tilt.

Parametric enhancement filters do not provide fine control and are not very flexible.

However, the techniques are computationally expensive and sensitive to errors.

Unfortunately this phase assumption is usually not valid because most speech signals are of a mixed phase nature (i.e. can be considered as a convolution of a minimum and a maximum phase signal).

Images