Supercharge Your Innovation With Domain-Expert AI Agents!

Natural language generation model training method and device

A natural language and training method technology, applied in the computer field, can solve the problems of poor natural language generation effect, unstable model training, large gradient variance, etc., to achieve the effect of improving the generation effect, easy convergence, and stable training

Pending Publication Date: 2021-07-13
BEIJING WODONG TIANJUN INFORMATION TECH CO LTD +1
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The inventors of the present disclosure have discovered the following problems in the above-mentioned related technologies: the gradient variance of the natural language generation model training is too large, resulting in unstable or non-convergent model training, resulting in poor natural language generation effect

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Natural language generation model training method and device
  • Natural language generation model training method and device
  • Natural language generation model training method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0042] Various exemplary embodiments of the present disclosure will now be described in detail with reference to the accompanying drawings. It should be noted that relative arrangements of components and steps, numerical expressions and numerical values ​​set forth in these embodiments do not limit the scope of the present disclosure unless specifically stated otherwise.

[0043] At the same time, it should be understood that, for the convenience of description, the sizes of the various parts shown in the drawings are not drawn according to the actual proportional relationship.

[0044] The following description of at least one exemplary embodiment is merely illustrative in nature and in no way intended as any limitation of the disclosure, its application or uses.

[0045] Techniques, methods, and devices known to those of ordinary skill in the relevant art may not be discussed in detail, but where appropriate, techniques, methods, and devices should be considered part of the ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a natural language generation model training method and device, and relates to the technical field of computers. The training method comprises the following steps: taking a generated word at each historical moment as a state of the current moment, taking the output of the generated word at the current moment as an action, and modeling natural language generation processing into a reinforcement learning model; determining a first target function according to a dominant function of the generated word at each moment output by the reinforcement learning model; determining a second objective function according to the difference between the probability distribution of the labeling result at each moment and the probability distribution of the generated word at each moment; and training the reinforcement learning model according to the weighted average of the first objective function and the second objective function.

Description

technical field [0001] The present disclosure relates to the field of computer technology, and in particular to a training method for a natural language generation model, a training device for a natural language generation model, a method for generating natural language, a device for generating natural language, and a non-volatile computer-readable storage medium. Background technique [0002] In recent years, AI (Artificial Intelligence, artificial intelligence) technology has developed rapidly, and its application has spread all over various fields of human production and life. NLP (Natural Language Processing, Natural Language Processing) is an important application in the field of artificial intelligence, mainly divided into two branches of natural language understanding and NLG (Natural Language Generation, natural language generation). [0003] Natural language generation is an important scientific technology that combines artificial intelligence, computer science and ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F40/216G06F40/242G06F40/30G06K9/62G06N3/04G06N3/08G06N20/00
CPCG06F40/216G06F40/242G06F40/30G06N3/08G06N20/00G06N3/045G06F18/22G06F18/2415
Inventor 程维
Owner BEIJING WODONG TIANJUN INFORMATION TECH CO LTD
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic, Popular Technical Reports.

© 2025 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap|About US| Contact US: help@patsnap.com