Modification method and device of attention parameter in neural machine translation, and electronic equipment

Abstract

The invention discloses a modification method and device of an attention parameter in neural machine translation, and electronic equipment. The method comprises the following steps: acquiring a codingvector of a to-be-translated source-end word at the t-th moment, wherein t is the integer greater than or equal to 1; acquiring implicit state vector of the target end word acquired by translating atthe t-1-th moment, the coverage rate of the source end word at the t-1 moment, and the word alignment probability between the source end word and the target end word; based on the word alignment probability, modifying the coverage rate to obtain the modified coverage rate; computing to acquire the attention parameter in the neural machine translation based on the modified coverage rate, the coding vector and the implicit state vector; and performing neural machine translation based on the attention parameter. In the above technical scheme disclosed by the invention, the coverage rate in the neural machine translation is modified through the word alignment probability, thereby improving the accuracy of the attention parameter, the technical problem that over-translation and under-translation are easy to occur in the neural machine translation in the prior artis solved, and the translation accuracy is improved.

Description

technical field

[0001] The invention relates to the field of software technology, in particular to a method, device and electronic equipment for correcting attention parameters in neural machine translation. Background technique

[0002] With the development of economic globalization, the demand for cross-language translation is increasing, and the requirements for the accuracy of machine translation are getting higher and higher. Nowadays, machine translation with higher accuracy mainly includes Statistical Machine Translation (SMT) and Neural Machine Translation (NMT).

[0003] Statistical machine translation is to build a statistical translation model through statistical analysis of a large number of parallel corpora, and then use this model for translation. Neural machine translation is to vectorize sentences in one language, convert them into a representation form that computers can "understand", and then decode them into translations in another language through conduc...

Images