Word semantic similarity solution method based on context window

Abstract

A word semantic similarity solution method based on a context window comprises the steps of inputting words to be compared in a statistical method module; determining a context range of the words to be compared; finding out two sentences with maximum weight in the range; calculating similarity between the two sentences; and finally, solving the similarity between the words to be compared according to the similarity of the sentences. By the word semantic similarity solution method, very valuable quantitative description is provided for determination of an effective range of the context, and the defect of previous subjective description is overcome; the position of description capability of the context to the key word is gradually reduced from the near to the distant, and the word semantic similarity solution method conforms to ordinary knowledge of people; the linearity and the signal-to-noise ratio of a weight contribution value are better, and simple subsequent calculation is facilitated; the normalization curve accuracy of the weight contribution value is higher; the influence of a sentence constituent relation in a left window and a right window of a key word on defining of an effective window in the context is considered; and the solution of word semantic similarity by applying a context window technology is achieved, and calculation precision and accuracy are higher.

Description

technical field [0001] The invention relates to the technical field of semantic network, in particular to a method for solving word semantic similarity based on a context window. Background technique [0002] Since entering the 21st century, the global Internet industry has entered a new period of rapid development, and various new technologies have emerged continuously. Natural language processing, an important technology connecting computers and people, has also made great progress. The calculation methods of semantic similarity of words at home and abroad can be roughly divided into two categories: first, the calculation method of semantic similarity of words based on semantic dictionary, this method is simple, effective and easy to understand, but it relies on a relatively complete A large-scale semantic dictionary organized by structural hierarchy; second, a corpus-based word semantic similarity calculation method, which uses a large-scale corpus and uses the context i...

AI Technical Summary

Problems solved by technology

The context of words is the resource and basis for acquiring natural language knowledge in corpus linguistics and solving various practical application problems in natural language processing. In specific application problems, the correctness of the final result limits the insufficiency of the effective range of the context, and realizes the quantitative calculation of the semantic similarity of words. The present invention provides a method for solving the semantic similarity of words based on the context window.

Images