The present application relates to a kind of laryngectomy post-voice
reconstruction method and
system based on hidden space editing, low-frequency
body surface vibration
signal and high-frequency air-conducted acoustic
signal produced simultaneously when patient vocalization is carried out, and dual-channel heterogeneous
signal acquisition and fusion are carried out;Based on soft
feature mapping and hidden space editing, the signal after fusion is reconstructed to output
correction text;Based on reference audio and
correction text, personalized waveform file is synthesized and played back.By retaining soft features and intervening in hidden space, the probability distribution is retained, the decision-making power is moved backward, real-
time error correction during
inference can be achieved, and high-fidelity intent reconstruction can be achieved.Through dual-channel sampling, the low-frequency
body surface vibration signal and high-frequency air-conducted acoustic signal collected are complementary in
frequency domain, and the complete acoustic information is reconstructed by combining them, which improves the
noise immunity.Based on reference audio, personalized speech files can be synthesized without samples,
noise immunity and
personalization can coexist, and important
technical support is provided for the development of intelligent
medical treatment.