Keyword extraction method and device, equipment and storage medium

Abstract

The invention relates to a keyword extraction method and device, equipment and a storage medium. The keyword extraction method comprises the following steps: acquiring an input sample; obtaining a first score of each candidate word in the input sample according to a first preset algorithm; obtaining a second score of each candidate word in the input sample according to a second preset algorithm; performing setting operation on the first score of each candidate word and the second score of each candidate word to obtain a third score of each candidate word; and determining the keyword of the input sample according to the sorting result of the third score of each candidate word. According to the scheme provided by the invention, the accuracy rate and the recall rate of keyword extraction can be improved, so that the extracted keywords can better reflect the meaning of the text content.

Description

technical field

[0001] The present application relates to the technical field of data processing, in particular to a keyword extraction method, device, equipment and storage medium. Background technique

[0002] Keyword extraction is the key to technologies such as information retrieval, text classification and clustering, and automatic abstract generation, and is an important means to quickly obtain document topics. The extraction of text keywords is to extract the words most related to the meaning of the text from the whole text, so that the viewer can quickly understand the text content through the text keywords.

[0003] There are many text keyword extraction algorithms in related technologies, such as open-source general algorithms such as TextRank algorithm, and text keyword extraction algorithms based on machine learning models, probability models, and deep learning models.

[0004] However, the above algorithms all have the problems of low precision and low recall o...

Examples

Embodiment Construction

[0055] Embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the scope of this application to those skilled in the art.

[0056]The terminology used in this application is for the purpose of describing particular embodiments only, and is not intended to limit the application. As used in this application and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any and all possible c...

technical field

[0001] The present application relates to the technical field of data processing, in particular to a keyword extraction method, device, equipment and storage medium. Background technique

[0002] Keyword extraction is the key to technologies such as information retrieval, text classification and clustering, and automatic abstract generation, and is an important means to quickly obtain document topics. The extraction of text keywords is to extract the words most related to the meaning of the text from the whole text, so that the viewer can quickly understand the text content through the text keywords.

[0003] There are many text keyword extraction algorithms in related technologies, such as open-source general algorithms such as TextRank algorithm, and text keyword extraction algorithms based on machine learning models, probability models, and deep learning models.

[0004] However, the above algorithms all have the problems of low precision and low recall o...

Examples

Embodiment Construction

[0055] Embodiments of the present application will be described in more detail below with reference to the accompanying drawings. Although embodiments of the present application are shown in the drawings, it should be understood that the present application may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided so that this application will be thorough and complete, and will fully convey the scope of this application to those skilled in the art.

[0056]The terminology used in this application is for the purpose of describing particular embodiments only, and is not intended to limit the application. As used in this application and the appended claims, the singular forms "a", "the", and "the" are intended to include the plural forms as well, unless the context clearly dictates otherwise. It should also be understood that the term "and / or" as used herein refers to and includes any and all possible c...

Images