Translation model training method, text translation method, device and equipment

A technology of translation model and training method, applied in natural language translation, biological neural network model, character and pattern recognition, etc., can solve the problems of wrong name translation results, unaligned data, etc., to achieve high translation accuracy and reduce learning difficulty , the effect of improving translation accuracy

Pending Publication Date: 2022-07-29
BEIJING IQIYI TECH CO LTD
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, in related technologies, since there may be unaligned data between some training samples and la

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Translation model training method, text translation method, device and equipment
  • Translation model training method, text translation method, device and equipment
  • Translation model training method, text translation method, device and equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] The technical solutions in the embodiments of the present invention will be described below with reference to the accompanying drawings in the embodiments of the present invention.

[0059] In the field of machine translation, especially in the scenario of machine translation for lines, the source sentence lines containing human names often need to be correctly translated into the target language. For example, if the source sentence is "Hong Yugang went to school" and the target language is English, the source sentence needs to be correctly translated as "Hong Yugang go to school", that is, the translation result containing the correct person's name. At present, the translation model is usually trained with sample data so that the model can fit autonomously, so that the model can learn to recognize the name and translate it correctly.

[0060] In the related art, in the process of using sample data to train a translation model, a large number of source sentences contain...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention provides a translation model training method, a text translation method, a text translation device and text translation equipment, and relates to the technical field of machine learning. According to the specific implementation scheme, a training data set used for training a translation model is obtained; identifying each target training sample in the training data set, wherein the specified label of each target training sample accords with a predetermined condition; performing specified preprocessing on each target training sample to obtain each first training sample; translating the plurality of to-be-utilized samples by utilizing a to-be-trained translation model to obtain an output result of each to-be-utilized sample; determining a model loss value based on the output result of each to-be-utilized sample and the specified label of the to-be-utilized sample; based on the model loss value, whether the translation model converges is judged, if yes, training is ended, the trained translation model is obtained, and if not, the step of obtaining the training data set used for training the translation model is executed again. Therefore, through the scheme, the translation accuracy of the translation model can be improved.

Description

technical field [0001] The present invention relates to the technical field of machine learning, and in particular, to a translation model training method, text translation method, device and equipment. Background technique [0002] In the field of machine translation, a source sentence containing a person's name needs to be correctly translated into the target language. For example, if the source sentence is "Hong Yu just went to school" and the target language is English, the source sentence needs to be correctly translated as "Hong Yu has just gone to school". Yugang goto school", which translates to a translation that includes the correct person's name. [0003] In the related art, a large number of source sentences containing personal names are used as training samples, and the translation result belonging to the target language corresponding to each training sample is used as the label of the training sample, and the translation model pair is trained by using the train...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F40/58G06K9/62G06N3/02
CPCG06F40/58G06N3/02G06F18/214
Inventor 张轩玮
Owner BEIJING IQIYI TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products