Machine translation method, device and storage medium
A technology of machine translation and translation probability, which is applied in the field of machine translation methods, devices and storage media, can solve problems affecting translation quality and inconsistency of attention, and achieve the goals of improving translation quality, better evaluation indicators, and ensuring decoding speed Effect
Active Publication Date: 2022-06-21
NANJING UNIV
View PDF14 Cites 0 Cited by
- Summary
- Abstract
- Description
- Claims
- Application Information
AI Technical Summary
Problems solved by technology
[0004] However, the above method relies on the soft alignment provided by the attention mechanism to copy. In the machine translation model based on the attention mechanism, the attention used in the encoder-decoder layer is multi-headed. Generally, the entire multi-headed attention is clipped. The attention obtained by the branch is used as the attention of the copy, which leads to the inconsistency between the attention used by the copy and the attention used by the generation, thus affecting the final translation quality
Method used
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View moreImage
Smart Image Click on the blue labels to locate them in the text.
Smart ImageViewing Examples
Examples
Experimental program
Comparison scheme
Effect test
Embodiment Construction
[0060] Various exemplary embodiments, features and aspects of the present disclosure will be described in detail below with reference to the accompanying drawings. The same reference numbers in the figures denote elements that have the same or similar functions. While various aspects of the embodiments are shown in the drawings, the drawings are not necessarily drawn to scale unless otherwise indicated.
[0061] The word "exemplary" is used exclusively herein to mean "serving as an example, embodiment, or illustration." Any embodiment described herein as "exemplary" is not necessarily to be construed as preferred or advantageous over other embodiments.
[0062] In addition, in order to better illustrate the present disclosure, numerous specific details are given in the following detailed description. It will be understood by those skilled in the art that the present disclosure may be practiced without certain specific details. In some instances, methods, means, components a...
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More PUM
Login to View More Abstract
The present disclosure relates to the field of machine translation, in particular to a machine translation method, device and storage medium. The method includes: according to the source text sequence to be translated, calling an encoder to encode to obtain an encoding vector; according to the encoding vector, calling a decoder to decode to obtain an intermediate result; according to the intermediate result, using a single-head attention to obtain the current The translation probability distribution corresponding to the words at the moment, the translation probability distribution is used to indicate the corresponding selection probability of multiple candidate words; according to the translation probability distribution of each word in the source text sequence, the target translation corresponding to the source text sequence is generated. The embodiment of the present disclosure avoids the use of multi-head attention pruning in the related art by adding a layer of summary layer to the machine translation model including the encoder and the decoder, and the obtained attention is used as the attention of the copy. , while ensuring the decoding speed, it improves the translation quality of the machine translation model.
Description
technical field [0001] The present disclosure relates to the field of machine translation, and in particular, to a machine translation method, device, and storage medium. Background technique [0002] Machine Translation (MT) is a translation method that translates sentences in one natural language into sentences in another natural language through computer equipment. [0003] In the related art, machine translation generally adopts a sequence-to-sequence (Sequence to sequence, seq2seq) structure model, which consists of an encoder (English: encoder) and a decoder (English: decoder). When the model receives a text sequence, the encoder encodes the text sequence into an encoded vector, which is fed into the decoder. The decoder decodes the corresponding translation word by word from the encoded vector. In order to alleviate the influence of certain insufficient training and unregistered words, a predefined bilingual dictionary can also be used to establish a relationship be...
Claims
the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More Application Information
Patent Timeline
Login to View More Patent Type & Authority Patents(China)
IPC IPC(8): G06F40/58G06F40/211G06F40/242
Inventor 黄书剑莫绪言何亮戴新宇张建兵陈家骏
Owner NANJING UNIV