Automatic document summarization extraction method based on term vectors

A document summary and automatic extraction technology, applied in special data processing applications, instruments, electrical digital data processing, etc., can solve problems such as reducing the accuracy of node weights, affecting the performance of summarization, and ignoring the semantic similarity between sentences

Active Publication Date: 2015-08-12
DALIAN UNIV OF TECH
View PDF3 Cites 77 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The value in the sentence similarity matrix represents the jump probability from a sentence to other sentences, so the calculation of node weights is very important, but when the traditional graph method calculates the similarity between senten

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic document summarization extraction method based on term vectors
  • Automatic document summarization extraction method based on term vectors
  • Automatic document summarization extraction method based on term vectors

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0084] Examples:

[0085] In order to make the objectives, technical solutions and beneficial effects of the present invention clearer and easier to implement, the present invention will be further described in detail in conjunction with the following specific embodiments and with reference to the accompanying drawings. In this embodiment, the length of the generated abstract is preset to 150 words.

[0086] S1. Use the deep neural network model training corpus to obtain the word vector representation of the feature words:

[0087] In order to obtain the vector representation form of the feature words, the embodiment adopts the corpus for collecting experimental corpus from the biomedical literature database MEDLINE maintained by the National Medical Library of the United States. Specifically, it queries all the literature citations on MEDLINE from 2011 to 2012 as the corpus. Preprocessing the sentences in the quotation, that is, removing the stop words, special characters and punct...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

Provided is an automatic document summarization extraction method based on term vectors. The method includes the steps that S1, a deep neural network model is used for training linguistic data to obtain term vector representation of feature terms; S2, a sentence graph model is constructed; S3, the weights of sentences are calculated; S4, a maximum marginal relevance algorithm is used for generating a summarization. According to the method, a linguistic data set is collected and preprocessed to obtain a training feature linguistic data set, the deep neural network model is used for training the constructed training feature linguistic data set to obtain the term vectors of the feature terms, a candidate document set and a candidate sentence set are obtained from the linguistic data set through preset search terms, the semantic similarity between the senesces is obtained according to the term vectors of the feature terms, and then the semantic relation between every two sentences is obtained. The problem that in a traditional calculation method based on term co-occurrence, calculation errors are caused under the condition that semantic meaning is identical but terms are different is avoided, and therefore the accuracy of similarity calculation and the performance of the summarization are improved.

Description

technical field [0001] The invention relates to the fields of computer information retrieval and text mining, in particular to a method for automatically extracting document summaries based on word vectors. Background technique [0002] Text summarization technology is an important part of the text mining research field. This technology can find out the most important information in a document or document set and express it in a concise and coherent short text. With the advancement of science and technology and the development of network technology, there is a large amount of available information on the Internet. Faced with a large amount of data, this research can assist users to quickly understand the required information, save users' reading time, and improve work efficiency. [0003] The current text summarization technology is mainly extractive summarization, that is, extracting the most important sentences from the original text to form a summarization. The generation...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F17/30
CPCG06F16/345
Inventor 林鸿飞郝辉辉
Owner DALIAN UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap