Fine-granularity dependence relationship-based method for calculating Chinese long sentence similarity

Abstract

The invention discloses a fine-granularity dependence relationship-based method for calculating Chinese long sentence similarity. The method comprises the steps of calculating a dependence relationship pair set of two sentences based on dependence relationship pairs; selecting a corresponding relationship which enables a relationship pair similarity sum to be maximal; and based on the corresponding relationship, calculating an average value of relationship pair similarity sums as syntactic structure similarity of the two sentences. According to the method, five characteristic variables such as concepts, word properties, relationship types and the like of two vocabularies in a dependence relationship are compared and a syntactic structure similarity relationship of the sentences are measured; an experimental result already prominently shows the advantages of semantic analysis in sentence similarity calculation; compared with similarity calculation in the prior art, the correct rate is increased to a certain extent, key information reflected around a non central word is considered, and two layers of root node-predicate head and a direct domination part in a dependence syntactic tree are mainly considered in the prior art; and the correct rate is exchanged with the time in the method.

Description

technical field [0001] The invention belongs to the technical field of natural language processing, and in particular relates to a method for calculating the similarity of long Chinese sentences based on fine-grained dependencies. Background technique [0002] In the research of Chinese information processing, the calculation of sentence similarity is an important part, and it has a wide range of applications in automatic summarization, machine translation, information retrieval, automatic question answering system, etc. At present, the research on sentence similarity calculation can be roughly divided into word-based similarity, word meaning-based similarity, syntactic structure-based similarity, edit distance-based, dynamic programming-based similarity, etc. These methods can be classified into two categories: one does not need or only needs shallow grammatical structure relations, and the other requires deep grammatical structure and semantic analysis. In case-based mach...

AI Technical Summary

Problems solved by technology

[0004] The purpose of the present invention is to provide a Chinese long sentence similarity calculation method based on fine-grained dependencies, aiming to solve the problem that the current sentence similarity method based on dependency syntax does not fully consider the role importance of each element inside the dependency relationship, but only The problem of labeling dependencies as a whole

Images