The invention provides an unstructured text data calculation method and
system, and relates to the technical field of
natural language processing, and the method comprises the steps: carrying out the multi-level
processing of input unstructured text data, dynamically adjusting the word segmentation
granularity according to the word frequency distribution, constructing a part-of-speech co-occurrence matrix in combination with context
semantic information, and extracting entity information. And fusing the part-of-speech co-occurrence matrix and the entity information to generate a hierarchical semantic tag sequence.
Feature extraction units with different
convolution kernel sizes are adopted to extract feature representation, and
cosine similarity between different semantic hierarchies is calculated to establish an association weight matrix. A
semantic enhancement vector is constructed based on entity information, and adversarial training is carried out to obtain a multi-
modal semantic feature matrix. And calculating the
semantic similarity between the fusion feature vectors for clustering, setting difficulty weight sorting according to the complexity, consistency and
ambiguity of class clusters, then inputting the class clusters into a classifier, and iteratively optimizing a
classification result to obtain a calculation result.