Automatic text generation method and device

A technology of automatic text generation and text, applied in neural learning methods, biological neural network models, natural language data processing, etc., can solve problems such as single text and single text generation

Inactive Publication Date: 2018-07-27
BEIHANG UNIV
View PDF5 Cites 100 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Later, there was the problem of using reinforcement learning and confrontation network to generate text, which solved this problem. Although after improvement, it can generate relatively high-quality text, but the generated text is relatively simple.
In view of this, it is necessary to develop a new text generation method for the single problem of text generation

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic text generation method and device
  • Automatic text generation method and device
  • Automatic text generation method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0022] In order to make the object, technical solution and advantages of the present invention clearer, the specific implementation of the method and device for automatically generating text of the present invention will be further described in detail through the following examples and in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0023] Such as figure 1 Shown is a schematic flowchart of a method for automatically generating text in an embodiment. Specifically include the following steps:

[0024] Step 101, divide the acquired text data set based on the application stage of building the model.

[0025] Step 102, constructing a generative adversarial network model with latent variables according to the training target information, and defining a loss function in the generative adversarial network model.

[0026] Step 103,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automatic text generation method. The method comprises the following steps of: data obtaining; data preprocessing; model construction; loss definition; model pre-training; and model adversarial training model verification. According to the method and device, a concurrent neural network and a variational auto encoder are combined, and an adversarial network training modeis added, so that the quality of generated texts is prevented from becoming bad along with elongation of the lengths of the texts, and the problem of generating single texts is avoided. According to the method, the concurrent neural network commonly used in the field of natural language processing is applied as basis and the variational auto encoder is fused, so that text distribution can be better learnt. For later effect enhancement, a thought of a generative adversarial network is used, a convolutional neural network is used as a discriminator, reinforcement learning is used for carrying out training, and models are globally trained, so that better effect is achieved. The invention furthermore discloses an automatic text generation device.

Description

technical field [0001] The invention relates to the technical field of computer natural language processing, in particular to a method and device for automatically generating text. Background technique [0002] Automatic text generation is an important research direction in the field of natural language processing, and the realization of automatic text generation is also an important sign of the maturity of artificial intelligence. We look forward to the day when computers can write like humans and can write high-quality natural language texts. For the application of text generation, it is very extensive in life. First, it can be divided into supervised and unsupervised text generation. For supervised text generation, such as machine translation, intelligent question answering systems, dialogue systems, and text summarization. For unsupervised text generation, by learning the original distribution of the data, samples similar to the original data can be generated, such as ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F17/27G06N3/04G06N3/08
CPCG06N3/08G06F40/211G06F40/284G06N3/045
Inventor 秦曾昌万涛王恒
Owner BEIHANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products