Data processing method and device

A data processing and preprocessing technology, applied in the computer field, can solve the problems of affecting the translation effect and losing the effective use of low-level sub-layer information, and achieve the effect of ensuring the translation effect of the model

Pending Publication Date: 2019-08-27
BEIJING KINGSOFT DIGITAL ENTERTAINMENT CO LTD +1
View PDF16 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] Currently, by figure 1 It can be seen that the data flow of the Transformer translation model in each decoding layer is a serial flow, and the final output de...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Data processing method and device
  • Data processing method and device
  • Data processing method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the application. However, the present application can be implemented in many other ways different from those described here, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

[0042] Terms used in one or more embodiments of this specification are for the purpose of describing specific embodiments only, and are not intended to limit one or more embodiments of this specification. As used in one or more embodiments of this specification and the appended claims, the singular forms "a", "the", and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present sp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a data processing method and device, and the method and device are used for a decoder which comprises at least one decoding layer. For each decoding layer, the method comprisesthe following steps: carrying out self-attention calculation according to an input reference vector to be decoded to obtain a first sub-layer vector; performing multi-head attention calculation on thefirst sub-layer vector and the input coding vector to obtain a second sub-layer vector; fusing the reference vector to be decoded and the second sub-layer vector to obtain a fusion vector; carrying out linear transformation on the fusion vector to obtain an output decoding vector, so that vector fusion of the high-order sub-layer and the low-order sub-layer is realized, semantic information contained in the high-order sub-layer and grammatical information contained in the low-order sub-layer are effectively utilized, and therefore, effective improvement of a model translation effect is ensured.

Description

technical field [0001] The present application relates to the field of computer technology, and in particular to a data processing method and device, a computing device, a computer-readable storage medium, and a chip. Background technique [0002] The Transformer translation model is an encoder-decoder network structure, in which the encoder encodes the input information to obtain an encoding vector, and then the decoder receives the input reference vector to be decoded and the encoding vector of the encoder for decoding, and decodes The vector is input into the linear layer and the normalization layer in turn, and finally the corresponding translation result is obtained. [0003] see figure 1 , the encoder of the Transformer translation model is stacked by at least one isomorphic encoding layer, and the decoder is stacked by at least one isomorphic decoding layer. figure 1 The encoding layer and decoding layer in each are 6 layers. For the decoder, each decoding layer in...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/28G06N3/02G06N3/04
CPCG06N3/02G06F40/42G06N3/048
Inventor 李长亮王怡然郭馨泽唐剑波
Owner BEIJING KINGSOFT DIGITAL ENTERTAINMENT CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap