Superficial layer analyzing and auto document summary method based on abstraction degree of concept

Abstract

The invention relates to a method for superficially analyzing automatic document summarization on the consideration of conceptual abstract degree, pertains to the field of information retrieval and information science, and is characterized in that: first, a document is pre-treated and an abstract value is set; second, sentences in the document are represented by a conceptual vector model via polyseme disambiguation processing; third, the sentences are clustered into a plurality of clusters with similar subjects; forth, compression ratio of a summarization is determined according to the number of key words extracted from a collected works; fifth, the abstract degree of the sentences is determined; sixth, a plurality of abstract sentences required by the compression ratio is picked up from the clusters in sequence according to IMMRA value; and seventh, sequencing is carried out to the abstract sentences extracted and a summarization document is output. The beneficial results include: the automatic document summarization on consideration of abstract degree is realized and information redundancy and lack of the automatic summarization abstract due to conception inclusion relation are reduced; and the method can adjust the length of the abstract in a self-adaptation way according to the number of the subjects and adjust the induction degree of the summarization according to the needs of abstract degree of a user, thereby being characterized by good adaptability.

Description

technical field [0001] The invention relates to an automatic document summarization method for shallow analysis in consideration of conceptual abstraction, and belongs to the fields of information retrieval and information science. Background technique [0002] Automatic document summary is a technology that uses computers to compile abstracts for multiple documents. It removes redundant information from multiple documents on the same topic, and organically integrates the main content into a short summary document according to a certain compression ratio. Quickly and accurately understand the content of the anthology to facilitate. With the development and popularization of the Internet, automatic document summarization is used as post-processing of search engines. It can generate a large number of retrieval results returned by search engines as summaries and submit them to users, which can significantly improve the efficiency of user information acquisition. Automatic docu...

AI Technical Summary

Problems solved by technology

However, existing automated summaries of shallow analyzes do not have such moderation capabilities either.

[0004] From the above background introduction, it can be seen that the existing shallow analysis automatic document summarization is unable to inductively process concepts with containment relations, and does not have the ability to adjust the degree of concept inductiveness. The information is missing, and the algorithm has no inductive adjustment function

Images