Method for generating abstract based on attention mechanism

Abstract

The invention discloses a method for generating an abstract based on an attention mechanism to generate a text abstract, which totally comprises two stages: the first stage is a sentence sorting process, the second stage is an abstract generation process, and the input of the abstract generation process is N sentences which are most relevant to an article theme and are obtained through the first stage. In the first stage, a supervised sorting method is provided for articles with titles, firstly, the similarity between each sentence and the title is calculated, then the articles are sorted according to the similarity, and finally N sentences with the highest similarity are selected. For the second stage, the invention proposes a new method for calculating the attention distribution betweenthe encoder and the decoder, i.e. the decoder should pay attention to different parts in the encoder at different times. Through the sorting method and the abstract generation method, the problem of article information attenuation caused by the fact that a part of text must be directly cut off to serve as input of the abstract generation model when the article is too long is relieved.

Description

technical field [0001] The invention belongs to the field of natural language processing, and more specifically relates to a method for generating abstracts based on an attention mechanism. Background technique [0002] With the development of the Internet, network information is growing explosively, how to quickly and effectively obtain network information has become an important research problem. Text summarization was developed under such a background. With the development of information retrieval and natural language processing technology, text summarization has become a research hotspot in recent years. [0003] The purpose of text summarization is to convert a text or a collection of texts into short texts containing key information. According to the input type, text summarization can be divided into single-document summarization and multi-document summarization, where single-document summarization generates summaries from a given document, and multi-document summariz...

AI Technical Summary

Problems solved by technology

[0005] Aiming at the above defects or improvement needs of the prior art, the present invention provides a method for generating summaries based on attention mechanism, the purpose of which is to solve the problems of slow training speed and training Difficult technical questions, and technical questions that would cause some important information to be missing from the article

Images