Text generation method based on deep learning

A deep learning and text technology, applied in the field of text generation based on deep learning, can solve the problems of poor text quality and loss of historical information, and achieve the effect of increasing diversity and increasing long-term dependence ability.

Active Publication Date: 2020-10-30
HUAZHONG NORMAL UNIV
View PDF4 Cites 15 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

This type of method has an obvious shortcoming. The model compresses historical memory information into a state vector of the same length, and each word only considers the historical information passed by the previous word, which leads to a serious loss of historical information. Therefore, The quality of the text generated later will get worse and worse

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Text generation method based on deep learning
  • Text generation method based on deep learning
  • Text generation method based on deep learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0031] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention. In addition, the technical features involved in the various embodiments of the present invention described below can be combined with each other as long as they do not constitute a conflict with each other.

[0032] Such as figure 1 As shown, the text generation method based on deep learning in the embodiment of the present invention includes the following stages.

[0033] Phase 1: Data Preparation

[0034] In the data preparation stage, the required text data is first obtained from the web crawler, and the special symbols in the data are cleaned to obtain the required training data.

[0035] Seco...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a text generation method based on deep learning. The method comprises training and testing, and is characterized in that the training comprises the steps: constructing a training set, wherein the training set comprises a plurality of sample pairs composed of preprocessed topics and corresponding texts; defining a generator in advance, wherein the generator is used for generating a text according to an input topic, the training set is used for pre-training the generator, and an attention mechanism and a new historical memory information module are added to encoding and decoding of the generator; defining a classifier in advance, and inputting the text output by the generator and the text in the training set into the classifier for adversarial training; and performingreinforcement learning training on the generator according to the pre-trained loss function defined by the generator and the classifier. The method has a better text generation effect.

Description

technical field [0001] The invention belongs to the technical field of natural language processing, and more specifically, relates to a text generation method based on deep learning. Background technique [0002] The emergence of deep learning has brought the development of artificial intelligence to a new level, and has rapidly had a profound impact in academia and industry. The method based on deep learning has become a mainstream method in the fields of computer vision and natural language processing. In the field of natural processing, methods based on deep learning have also made great progress. For example, in the fields of machine translation, human-computer dialogue, and ancient poem generation, methods based on deep learning have completely surpassed or even replaced traditional machine learning methods. [0003] Automatic writing is an important artificial intelligence technology. The use of artificial intelligence for writing or assisted creation provides human b...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & AuthorityApplications(China)
IPC IPC(8): G06F16/35G06F40/216G06F40/289G06F40/284G06F40/242G06N3/04G06N3/08
CPCG06F16/355G06F40/216G06F40/289G06F40/284G06F40/242G06N3/049G06N3/08G06N3/044G06N3/045
Inventor廖盛斌余亚斌
OwnerHUAZHONG NORMAL UNIV