Method for extracting feature word of text

Abstract

The embodiment of the invention discloses a method for extracting subject headings of a text. The method comprises the following steps: a text to be processed is divided into combination sequences of the existing words; for each text to be processed, candidate character strings with a frequency of occurrence greater than a preset frequency in the text to be processed are found and extracted, and new words are filtered from the candidate character strings according to the lexicalization probability of the prefixes and / or suffixes of the candidate character strings; and subject headings of the text to be processed are extracted from the existing words and the new words according to the frequency of occurrences of the existing words and the new words. The invention ensures that the comprehensiveness of extracting subject headings from the text to be processed is improved.

Description

technical field [0001] The invention relates to the technical field of Internet information processing, in particular to a method for extracting text keywords. Background technique [0002] Extracting text keywords is a technical problem that many network applications need to face. For example, in a content-based online advertising application, it is necessary to extract the keywords of the web page content currently browsed by the user, and then send advertisements related to the keywords to the user; The subject words of each text, and then build the index of each text according to the subject words extracted from each text, so as to improve the retrieval efficiency; in content-based text classification, it is also necessary to extract the subject words that can reflect the text content, and then according to the extracted subject words for text classification. [0003] At present, the general method of extracting text keywords is: firstly, establish a large-scale corpus...

AI Technical Summary

Problems solved by technology

[0005] However, in actual network applications, there are often many new words that are not included in the existing language databases, such as "Bawangmian", "Bei Piao Family", "Nian Lao", etc., and these new words are used as the theme of the text. word probability is high

[0006] It can be seen that once the words that can express the subject of the text to be processed (hereinafter referred to as the subject words of the text to be processed) are not in the existing language database, since the subject words cannot be separated from the text to be processed according to the existing language database, therefore, It is also impossible to extract the inscription from the text to be processed, resulting in incomplete subject headings

Images