Unlock instant, AI-driven research and patent intelligence for your innovation.

Model training method and device and translation method and device

A technology for model training and translation models, which is applied in the field of model training and can solve problems such as the decline in the translation effect of NMT models

Active Publication Date: 2021-08-10
HUAWEI TECH CO LTD
View PDF9 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In low-resource scenarios, the translation effect of NMT models tends to decline significantly. Therefore, it is urgent to improve the translation effect of NMT models in low-resource scenarios.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Model training method and device and translation method and device
  • Model training method and device and translation method and device
  • Model training method and device and translation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0066] The embodiments of the present application will be described below with reference to the accompanying drawings, which is merely the embodiments of the present disclosure, not all of the embodiments. One of ordinary skill in the art can be seen that as the development of technology and the emergence of new scenes, the technical solutions provided in the present application are equally applicable to similar technical problems.

[0067] The present application provides a method of model training, a method of translation, and a device. The translation model obtained by a model training provided by this application can improve the translation effect under low resource scenarios, such as the translation effect of small language translation effects, specific areas (such as medical fields, law field).

[0068] In order to understand this program, first combined figure 1 For the translation system provided by the embodiment, please refer to figure 1 , figure 1 A system architecture ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to the field of artificial intelligence, and discloses a model training method and device and a translation method and device. The model training method comprises the steps: using a first monolingual corpus to train a model to obtain a first PLM, and using a second monolingual corpus to train the model to obtain a second PLM; obtaining word vector parameters of the first translation model based on the first PLM; and training the first translation model by using the high-resource parallel corpus to obtain a trained first translation model, obtaining a second translation model according to the trained first translation model and the second PLM, and training the second translation model by using the low-resource parallel corpus to obtain a trained second translation model. According to the scheme provided by the invention, in a model training stage, the high-resource parallel corpus, the low-resource parallel corpus, the first monolingual corpus and the second monolingual corpus are utilized at the same time, so that the trained model also has a good translation effect in a low-resource scene.

Description

Technical field [0001] The present application relates to the field of artificial intelligence, and in particular, a method of model training, a method of translation, and a device. Background technique [0002] Artificial Intelligence (AI) is the use of digital computer or digital computer-controlled machine simulation, extension, and extension of people's intelligence, perceived environments, access to knowledge, and use knowledge to achieve best results, methods, techniques, and application systems. In other words, artificial intelligence is a branch of computer science. It is attempt to understand the essence of intelligence and produce a new intelligent machine that can react in a manner similar way. Artificial intelligence is to study the design principles and implementation methods of a variety of intelligent machines, making machines with perception, reasoning and decision-making. [0003] With the development of AI technology, Neural Machine Translation, NMT models are w...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F40/58G06F40/30G06F40/289
CPCG06F40/58G06F40/30G06F40/289Y02D10/00
Inventor 张檬李良友
Owner HUAWEI TECH CO LTD