Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Text sequence generation method and system

A text sequence and sequence technology, applied in the computer field, can solve the problems of weak feedback signal and poor convergence of the discriminator, and achieve the effect of improving the generation quality and convergence.

Active Publication Date: 2020-04-21
BEIJING UNIV OF POSTS & TELECOMM +2
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] In view of this, the embodiment of the present invention provides a text sequence generation method and its system to solve the problem in the prior art that the feedback signal of the discriminator in the generation confrontation network model is weak, causing the generator to receive scalar signals and cannot effectively guide The network is updated in the correct direction, resulting in poor convergence

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text sequence generation method and system
  • Text sequence generation method and system
  • Text sequence generation method and system

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without creative efforts fall within the protection scope of the present invention.

[0044] The text generation method is to generate a continuous text sequence with correct syntax and semantics in a specific situation. At present, most encoding and decoding methods and cyclic neural networks have certain limitations. For example, basic cyclic neural networks often face excessive dependence on training data. The problem. GAN agai...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The embodiment of the invention provides a text sequence generation method and system. A adversarial network model comprises a generator and a discriminator; the generator comprises a feature feedbacknetwork module and is used for calling high-order features from the discriminator so as to generate a guidance feature vector; the generator generates a next word of the pre-output text sequence based on the guidance feature vector; the discriminator updates the high-order features according to the newly constructed pre-output text sequence and the initial text sequence; the above steps are iteratively executed until the total number of words of the newly constructed pre-generated text sequence reaches a set threshold, the total number of words is input into a discriminator for discrimination, and an update gradient is calculated according to a classification discrimination result; parameters of the generator are updated according to the updating gradient; and the above steps are iteratively executed until the generator and the discriminator converge, and a target text sequence is output. According to the embodiment of the invention, the feature conversion feedback module is added, and the feature vector extracted by the discriminator is transmitted to the generator as a guide signal, so that the generation quality of the generator is improved.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a text sequence generation method and system thereof. Background technique [0002] In recent years, with the continuous development of artificial intelligence, natural language processing has also received extensive attention. Among them, text generation, as one of the medium and long-term research topics in the field of natural language processing, has been applied to various technologies, such as machine translation, text summarization, automatic question answering, intelligent customer service, etc. Text generation aims to predict and generate grammatically and semantically correct word sequences in continuous specific contexts, and is an integral part of interactive artificial intelligence systems. [0003] At present, many scholars have made extraordinary achievements in text generation. When implementing text generation tasks, we often use feedforward neural ne...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/35G06F40/205G06N3/04
CPCG06F16/35G06N3/049G06N3/045G06N3/044Y02D10/00
Inventor 杨杨丹晓东房超高志鹏邵苏杰杨会峰高丽芳王静于海涛赵倩张艺馨石晓丹
Owner BEIJING UNIV OF POSTS & TELECOMM
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products