Corpus generalization method and man-machine conversation sentiment analysis method used in industrial field

Abstract

The invention provides a corpus generalization method and a man-machine conversation sentiment analysis method used in the industrial field. The corpus generalization method comprises the following steps: acquiring an initial text corpus in the industrial field, and replacing entity words in the initial text corpus to obtain a first type of text corpus; performing word segmentation processing on the initial text corpus and / or the first type of text corpus, and based on synonyms of words obtained by the word segmentation processing, replacing the words obtained by the word segmentation processing to obtain a second type of text corpus; performing dependency syntactic analysis on at least one of the initial text corpus, the first type of text corpus and the second type of text corpus, and performing sentence pattern transformation on the at least one based on an analysis result to obtain a third type of text corpus; and generalizing the initial text corpus based on at least two of the first type of text corpus, the second type of text corpus and the third type of text corpus. By means of the method, expansion of text corpora needed by functions such as man-machine conversation in the industrial field can be completed.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a corpus generalization method and a man-machine dialogue emotion analysis method used in the industrial field. Background technique [0002] The realization of human-computer interaction, chat dialogue and other functions in related professional fields such as industry requires a large amount of corpus data as support for model training and effect evaluation, and it is often difficult to accumulate relevant corpus in these scenarios. Therefore, corpus generalization is needed to increase the corpus for model training and effect evaluation. [0003] Corpus generalization refers to expanding a specific sentence into a type of sentence with the same meaning or in similar scenarios. At present, corpus generalization is usually performed by manually defining sentence templates for fixed application scenarios. This method of manually defining sentence templates has great limi...

AI Technical Summary

Problems solved by technology

[0004] The present invention provides a corpus generalization method and a human-computer dialogue emotion analysis method used in the industrial field, which is used to solve the defect that the generalization of the corpus by manually defining sentence templates in the prior art has great limitations, and realize the industrial field Corpus Generalization in Human-Computer Dialogue

Images