Language processing method and device and training method and device of language processing system

A language processing and training method technology, applied in the computer field, can solve the problem that monolingual corpus cannot be effectively used, the effect is not as good as supervised learning, etc., to achieve the effect of improving the generalization effect and the output result.

Active Publication Date: 2019-06-07
成都金山互动娱乐科技有限公司 +1
View PDF3 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] At present, machine translation models only rely on available parallel corpus for supervised learning, and a large amount of monolingual corpus cannot be effectively utilized in supervised learning
Although monolingual corpus is used in unsupervised learning, the effect is far inferior to supervised learning that relies on parallel corpus.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Language processing method and device and training method and device of language processing system
  • Language processing method and device and training method and device of language processing system
  • Language processing method and device and training method and device of language processing system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0062] In the following description, numerous specific details are set forth in order to provide a thorough understanding of the application. However, the present application can be implemented in many other ways different from those described here, and those skilled in the art can make similar promotions without violating the connotation of the present application. Therefore, the present application is not limited by the specific implementation disclosed below.

[0063] Terms used in one or more embodiments of this specification are for the purpose of describing specific embodiments only, and are not intended to limit one or more embodiments of this specification. As used in one or more embodiments of this specification and the appended claims, the singular forms "a", "the", and "the" are also intended to include the plural forms unless the context clearly dictates otherwise. It should also be understood that the term "and / or" used in one or more embodiments of the present sp...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a language processing method and device and a training method and device of a language processing system. The language processing system comprises a language model and a machinetranslation model, the language model and the machine translation model comprise the same embedded layer, and the language processing method comprises the steps that a source statement and a reference result are input into the embedded layer, and a source statement vector and a reference result vector are generated respectively; the source statement vector and the reference result vector are input into the machine translation model to generate a target statement vector; and the source statement vector are input into the language model to generate a processing statement vector. As the machinetranslation model and the language model share the training result, compared with the prior art, the generalization effect of the language model and the machine translation model can be improved, anda better output result is obtained.

Description

technical field [0001] The present application relates to the field of computer technology, in particular to a language processing method and device, and a language processing system training method and device. Background technique [0002] The machine translation model uses the dictionary of the source language to encode the input source language sentence to obtain a semantic vector; then uses the target language dictionary to decode the semantic vector to obtain a sequence about the target language as the final translation. [0003] The main idea of ​​the machine translation model is to encode the sentence to be translated into an encoded vector through the encoding layer (encoder), and then use the decoding layer (decoder) to decode the encoded vector to obtain the decoded vector, and then translate the decoded vector into the corresponding translation statement. [0004] In the training phase of the machine translation model, it is optimized based on parallel corpus. A...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/28G06N3/04
Inventor 李长亮郭馨泽唐剑波李国良
Owner 成都金山互动娱乐科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap