Multi-document summarization method based on text segmentation

Abstract

The invention belongs to the technical field of multi-document summarization and provides a multi-document summarization method based on text segmentation, which comprises the following steps of: using HowNet to obtain a concept, building a concept vector space model, conducting text segmentation by adopting an improved DotPlotting model and a sentence concept vector space, calculating sentence weight by using the built concept vector space model, generating a summary according to the sentence weight, the text segmentation and the similarity situation, and evaluating the generated summary by using the ROUGE-N evaluation method and using F_Score as an evaluation index. According to the result, the multi-document summarization by using a text segmentation technique is effective, relevant documents provided by users can be gathered to form a summary by adopting the multi-document summarization method, the summary is displayed to the users in a proper way, the information acquisition efficiency is greatly improved, the practicability is high and the popularization and application values are greater.

Description

technical field [0001] The invention belongs to the technical field of multi-document summarization, in particular to a multi-document summarization method based on text segmentation technology. Background technique [0002] In the Internet age, various types of electronic text information emerge in large quantities. How to help users quickly and accurately obtain the information that users are interested in from the information ocean in less time has become a research hotspot in the field of natural language understanding. Multi-document summarization is a technology that removes redundant information from multiple texts on the same topic and organically fuses them together according to a certain compression ratio. This technology will form a collection of related documents provided by users into an abstract and present them to users in an appropriate form , improving the efficiency of information acquisition, and with the continuous holding of various large-scale internati...

AI Technical Summary

Problems solved by technology

[0005] The present invention provides a multi-document summarization method based on text segmentation technology, aiming at solving the problem that the traditional text processing technology takes chapters as the basic processing unit, considers that an article only discusses one topic, and extracts several summarization sentences based on the importance of sentences, which is easy Causes the omission or neglect of less important topics, and the problem that some information may be ignored when the granularity of processing is completely in sentences

Images