Text intelligence association clustering collection processing method based on domain knowledge model

Abstract

The invention provides a text information associating and clustering collecting processing method based on a domain knowledge model. The method comprises the following steps that a text information training set is searched, stemming preprocessing is conducted, and feature word vectors of a text participle sequence of the information training set are extracted through Chinese named entity identification and domain dictionary query modes; representative feature words of a target event are extracted through topic graph model learning training, and a weighted value of topic associating affiliation is calculated; a feature word set is built according to the topic associating affiliation weighted value, calculated through training, of the feature words, and an event topic word template is built; feature word vectors of a participle sequence accessed to text in real time are extracted through the Chinese named entity identification and domain dictionary query modes; the similarity distance of the feature word vectors and all the target event knowledge templates is calculated; the association relationship of multiple texts to the same topic target event is determined according to the similarity threshold, and classification reorganization is conducted by means of a similarity distance ordering rule.

Description

technical field [0001] The invention relates to the field of text association and classification of subject content, that is, automatic text association analysis and clustering collection processing are realized by using computer processing technology. Background technique [0002] Text intelligence information analysis is an important part of the comprehensive information platform. With the current collection of intelligence text information in many ways, the sources of text intelligence are becoming more and more diverse, and the amount of information data is gradually increasing, which brings more and more difficulties to text intelligence analysis. One of the ways to realize the efficient analysis and effective analysis of text intelligence is to first correlate and classify text intelligence, and aggregate and analyze text intelligence with high correlation and close relationship. At present, the general steps of text intelligence analysis are as follows: (1) Transform ...

AI Technical Summary

Problems solved by technology

[0007] The purpose of the present invention is to solve the problem that the traditional method does not consider the guiding role of domain knowledge in the text information association process, resulting in relatively large deviations and weak pertinence of the associated information; it provides a text that introduces intelligence domain knowledge and prior information. Correlation analysis of intelligence content, realize the correlation and integration of intelligence according to the subject type of the target event, and improve the correct correlation rate of the subject category of the text intelligence

Images