Automatic text abstracting method

An automatic text and abstract technology, applied in the fields of unstructured text data retrieval, text database clustering/classification, special data processing applications, etc., can solve the problems of a large number of labor and high training costs, improve performance and improve BLEU score , the effect of improving learning speed and accuracy

Active Publication Date: 2020-04-14
TROY INFORMATION TECHNOLOGY CO LTD
View PDF16 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The method of deep learning is closer to the artificial summary method: after understanding the content, generating a summary is currently the best effect, but it requires a large number of manually labeled samples, and the training cost is very high

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic text abstracting method
  • Automatic text abstracting method
  • Automatic text abstracting method

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] The technical solution of the present invention will be further described in detail below in conjunction with the accompanying drawings, but the protection scope of the present invention is not limited to the following description.

[0046] Such as figure 1 As shown, an automatic text summarization method, including text preprocessing, codec pre-training, generative adversarial network optimization encoder, decoder optimization;

[0047] The text preprocessing is used to establish a mapping from text characters to digital numbers, so that text characters can be converted into vector codes that can be used for calculation;

[0048] The codec pre-training is used to train a codec initialization network that can encode and decode long texts into short texts;

[0049] The generation confrontational network optimization is used to optimize the encoder parameters in the codec network;

[0050] The decoder optimization is used to train the encoding and decoding network again...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses an automatic text abstracting method which comprises the following steps: preprocessing a text, establishing mapping from a text character to a number, and converting the textcharacter into a vector code for calculation; pre-training a codec, and training a codec initialization network capable of encoding and decoding a long text into a short text; optimizing the generative adversarial network, and optimizing encoder parameters in the encoding and decoding network; and decoder optimization: after the encoder is optimized, repeatedly training the encoding and decoding network for multiple times to optimize the decoder, and improving the BLEU value of the generated text. The method can adapt to text abstract tasks in various language scenes and the generated abstracthas good readability.

Description

technical field [0001] The invention relates to natural language processing technology, in particular to an automatic text summarization method. Background technique [0002] Internet technology has made the collection and dissemination of information faster, bringing people into an era of information explosion. On the one hand, rich and diverse information resources bring great convenience to people's lives, but the massive amount of information also brings great troubles to people. How to quickly obtain the information you want from the trillions of information on the Internet has become A challenging thing to do. Generally speaking, there are too many redundant information in the unprocessed original text, which takes a long time to read, and the information that is really needed is covered by irrelevant information, making it difficult for users to obtain information. In this Internet era with rapid information growth, researching an automatic text summarization method...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06F16/35G06K9/62
CPCG06F16/35G06F18/214
Inventor花福军陆文斌周正斌廖文绪张应福
OwnerTROY INFORMATION TECHNOLOGY CO LTD