Text similarity calculation method and device

Abstract

The embodiment of the invention provides a text similarity calculation method and device. According to the embodiment of the invention, vocabularies in two texts are trained by using a first vocabulary vector training model to obtain a vocabulary vector corresponding to each vocabulary, then the cosine similarity of two vocabulary vectors is calculated, and finally the similarity of the two textsis calculated by using the maximum cosine similarity of the word vocabularies. The vocabulary vector comprises context information of the corresponding vocabulary, so that the cosine similarity of thevocabulary vectors can reflect the meaning similarity of the corresponding vocabularies, thus the similarity, which is calculated by using the cosine similarity, of the two texts can accurately reflect the meaning similarity of the two texts, that is, the accuracy of calculation for the text similarity can be improved by using the cosine similarity, and thus the limitations brought about by a circumstance that the similarity of two texts can only be determined by using the same vocabularies in the prior art are overcome.

Description

technical field [0001] The embodiments of the present invention relate to the technical fields of text processing and man-machine conversation, and more specifically, relate to a method and device for calculating text similarity. Background technique [0002] At present, the automatic business question answering system has been widely used in many aspects such as bank customer service systems, online shopping customer service systems, and communication industry customer service systems. It can automatically provide answers to business questions raised by customers, improve service efficiency, and can Avoid manually answering business questions raised by customers, effectively saving human resources and labor costs. [0003] The automatic question answering system for business questions will divide the business questions raised by customers into corresponding categories, and then automatically give a unified standard answer according to the categories of business questions. T...

AI Technical Summary

Problems solved by technology

Different individuals have different ways of expressing, and the same meaning can be expressed with different words, so there may be various ways of expressing the text with the same meaning. Only the same words are used to determine the similarity between two texts. degree will seriously reduce the accuracy of text similarity calculation, and when the text similarity calculation method is used to classify the business problems raised by customers, it will seriously affect the accuracy of classification

Images