Hearing aid speech enhancement method based on depth domain adaptive network

Abstract

The invention discloses a hearing aid speech enhancement method based on a depth domain adaptive network. The method comprises the steps of extracting frame-level logarithm power spectrum features from noisy speech and clean speech respectively; constructing a deep learning model based on an encoder-decoder structure as a baseline speech enhancement model; on the basis of the baseline speech enhancement model, constructing a transfer learning speech enhancement model based on a depth domain adaptive network, wherein the transfer learning speech enhancement model introduces a domain adaptationlayer and a relative discriminator between a feature encoder and a reconstruction decoder; training the transfer learning speech enhancement model by using the domain adversarial loss; and in an enhancement stage, according to the trained depth domain adaptive transfer learning speech enhancement model, inputting frame-level LPS features of noisy speech in a target domain, and reconstructing an enhanced speech waveform. According to the method, the feature encoder is stimulated to generate domain invariance features through domain adversarial training, so that the adaptability of the speech enhancement model to unseen noise is improved.

Description

technical field [0001] The invention relates to the technical field of speech enhancement, in particular to a hearing aid speech enhancement method based on a deep domain adaptive network. Background technique [0002] In a complex environment, the target sound is usually submerged in the noise, and the results of the sound spectrum analysis are seriously affected, which makes the performance of the adaptive frequency reduction algorithm drop sharply. At the same time, some hearing-impaired characteristics of hearing-impaired patients, such as high hearing threshold, difficulty in identifying short-term features, and degenerated auditory periphery, make speech understanding in complex scenes a common problem and difficult problem that affects the usage rate. [0003] Classical single-channel noise suppressors are based on statistical signal processing methods, which focus on how to effectively estimate the noise spectrum from noisy speech to suppress it. Typical algorithms ...

AI Technical Summary

Problems solved by technology

This patent realizes the migration of unknown noise types and unknown signal-to-noise ratios through the migration learning algorithm, but only realizes the migration of one type of noise to another noise, and its applicable scenarios have limitations

Secondly, the algorithm has limited transfer effect when the noise type and signal-to-noise ratio do not match.

Images