Method and device for extracting subject term from simple sentence

Abstract

The invention discloses a method and a device for extracting the subject term from a simple sentence, which belongs to the technical field of subject term extraction. The method comprises the following steps: counting a plurality of key words and a plurality of multielement combinations in a language material, working out the characteristic value of each key word, and determining the sequence of each multielement combination; taking each key word of a simple sentence as the current key word respectively, extracting the multielement combination containing the current key word, calculating the grade of the current key word according to the sequence of the extracted multielement combination, and working out the metric of the current key word according to the characteristic value and the grade of the current key word; and picking out the subject term of the simple sentence from all key words according to the metrics after the metrics of all the key words of the single sentence are obtained. The device comprises a counting module, a characteristic value calculation module, a sequence calculation module, an extraction module, a grade calculation module, a metric calculation module and a subject term selection module. The invention has the advantage that the text message of a simple sentence is fully utilized, so that the accuracy and the efficiency of extracting the subject term from a simple sentence can be improved.

Description

technical field [0001] The present invention relates to the technical field of subject heading extraction, in particular to a single-sentence subject heading extraction method and device. Background technique [0002] Corpus refers to language material, that is, text information. Usually, with the objective and detailed language evidence provided by large-scale corpora, it is possible to engage in linguistic research and guide the development of natural language information processing systems. A single sentence refers to a sentence composed of phrases or single words. Key words refer to the key words in the text that represent the characteristics of its content, can best explain the problem, and play a key role. Existing keyword extraction usually adopts the following two methods: dependency analysis method and TFIDF (Term Frequency Inverse Document Frequency, term frequency inverse document frequency) method. [0003] The dependency analysis method is a method for analyz...

AI Technical Summary

Problems solved by technology

However, the dependency analysis method has two disadvantages: one is that the technology is not stable enough in the case of complex realistic sentences, and often fails to achieve the expected results; Sometimes it's a modifier, sometimes it's a modified word

However, when extracting the subject words for a single sentence, this method has great defects, because the value of TF in a single sentence is often close to 1, and it is impossible to distinguish the words statistically, so TF loses the accuracy of judging the importance of words sex

Images