Method and apparatus for measuring similarity of documents

Abstract

The invention provides a method and apparatus for measuring a similarity of documents. The method comprises the steps of acquiring a target document and at least one comparison document; carrying out word segmentation on the target document and the at least one comparison document to acquire words to be processed of each comparison document and words to be processed of the target document; according to an occurrence frequency of each word to be processed in each comparison document, generating a comparison semantic vector of each comparison document, and according to an occurrence frequency of each word to be processed of the target document, generating a target semantic vector of the target document; and according to the target semantic vector and each comparison semantic vector, determining the similarity of the target document and each comparison document. According to the method and apparatus for measuring the similarity of the documents, which are provided by the invention, the similarity between the documents can be more accurately determined.

Description

technical field [0001] The invention relates to the field of computer technology, in particular to a method and device for measuring the similarity of documents. Background technique [0002] As people pay more and more attention to science, technology and social development, in real life production, people rely more and more on retrieval tools. How to provide retrieval tools efficiently and accurately, text deduplication is a key part. item processing technology. To achieve text deduplication, it is necessary to determine the similarity between documents. [0003] In the prior art, when calculating the similarity between two documents, some keywords are generally extracted from each document, and the similarity between the two documents is determined by comparing these keywords. [0004] It can be seen from the above description that the solutions in the prior art only use some keywords to represent documents, but cannot accurately summarize the contents of the documents,...

AI Technical Summary

Problems solved by technology

[0004] It can be seen from the above description that the solutions in the prior art only use some keywords to represent documents, and cannot accurately summarize the contents of the documents, and the accuracy of the obtained similarity is not high.

Images