Text abstract generation system, method, device and computer readable storage medium

A generation system and abstraction technology, applied in text database browsing/visualization, unstructured text data retrieval, special data processing applications, etc. The effect of asymmetry

CN111639174APending Publication Date: 2020-09-08民生科技有限责任公司
0 Cites 4 Cited by

Patent Information

Authority / Receiving Office
CN · China
Current Assignee / Owner
Publication Date
2020-09-08

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention provides a text abstract generation system, a method, a device and a computer readable storage medium, and aims at forming training data through a seq2seq framework and text-abstract pairs to realize a system for generating abstracts for texts. A classic seq2seq framework is used for solving the problem from an uncertain length sequence to a sequence, a Bert Chinese pre-training model is used at an Encoder end to obtain text input information, a two-way decoding mechanism is introduced at a Decoder end, and the quality of a generated text is improved to a certain extent. When theabstract sequence is finally generated, top K results in the two directions are cached at the same time according to the beam-search thought, and finally the result with the highest probability is found and serves as output.
Need to check novelty before this filing date? Find Prior Art

Description

Technical field

[0001] The present invention relates to the technical field of computer word processing, and in particular to a text abstract generation system, method, device and computer-readable storage medium based on a sequence-to-sequence framework of a bidirectional decoding mechanism.

Background technique

[0002] Text summarization refers to refining and summarizing the content, and summarizes the main content that users are concerned about with a concise and intuitive summary, which is convenient for users to quickly understand and browse massive content.

[0003] With the advent of the Internet age, text summarization is becoming more and more important. First, there are more and more information explosion texts, and how to receive more information in a limited time has become a thorny issue; second, there is too much relevant information, redundant, one-sided, and impurity information leads to information overload; Finally, the popularization and use of mobi...

Examples

Embodiment 1

[0084] In the process of generating text summaries described in the present invention, it is especially applicable to the generation of news text summaries, and when used for generating news summaries, its relative accuracy rate is the highest. The generation of news summaries is used as a specific case below to illustrate:

[0085] The present invention uses a seq2seq framework to form training data with "news-abstract" pairs, and realizes a system for generating abstracts for news. The classic seq2seq framework is used for the variable-length sequence-to-sequence problem, the Bert Chinese pre-training model is used on the Encoder side to obtain news input information, and the two-way decoding mechanism is introduced on the Decoder side, which improves the quality of generated news to a certain extent. When generating the summary sequence at the end, according to the idea of ​​beam-search, the topK results in both directions are cached at the same time, and finally the one wit...