Speech translation method, system and equipment fusing text semantic features

Abstract

The invention belongs to the field of machine translation, particularly relates to a speech translation method, a system and equipment fusing text semantic features, and aims to solve the problem that the existing speech translation method is difficult to fuse information between different modals and cannot fully utilize data in the fields of speech recognition and machine translation, so that the translation performance is poor. The method comprises the following steps: acquiring to-be-translated source language voice data; extracting a voice feature sequence corresponding to the source language voice data; obtaining acoustic representation corresponding to each voice feature; mapping the implicit vector of the acoustic representation to a source language word list, and obtaining the probability that the speech feature sequence is recognized as a word in the source language word list at each moment through a softmax function; filtering the acoustic features, and obtaining semantic features corresponding to the filtered acoustic features through a second encoder; and based on the semantic representation, obtaining a target language translation text corresponding to the source language voice data through a decoder. According to the method, the speech translation performance is improved.

Description

technical field [0001] The invention belongs to the field of machine translation, and in particular relates to a voice translation method, system, and equipment that integrate text semantic features. Background technique [0002] With the development of the global information society, people communicate more and more frequently in various fields such as economy, commerce, sports, culture, tourism, etc., and the information exchange between different languages ​​has become an important part of information exchange. Various language services, especially translation services, are in increasing demand. Due to the frequent use of spoken language and voice as the direct medium of information exchange in various fields such as international conferences, transnational business talks, cross-border e-commerce, and overseas travel, voice translation has become an urgently needed technology that has attracted much attention. Speech translation service refers to the service of translati...

AI Technical Summary

Problems solved by technology

[0005] In order to solve the above-mentioned problems in the prior art, that is, in order to solve the problem that the existing speech translation method is difficult to integrate information between different modalities, and cannot make full use of the data in the field of speech recognition and machine translation, resulting in poor translation performance, the present invention In the first aspect, a speech translation method that integrates text semantic features is proposed, which includes the following steps:

Images