Chinese query expansion method based on pattern mining and word vector similarity calculation

Abstract

The invention provides a Chinese query expansion method based on pattern mining and word vector similarity calculation, which. The method comprises the following steps: firstly, retrieving a Chinese document set through user query to obtain an initial retrieval document, and performing word vector semantic learning training on the initial retrieval document set to obtain a word vector set comprising query word items and non-query word items; then mining extension words for the pseudo-correlation feedback document set by adopting a Copulas-function-based associated extension word mining method,and establishing an associated extension word set; and performing cosine similarity operation of two vectors in the word vector set to obtain a word embedding extension word set and a word vector association extension word set, finally fusing the word embedding extension word set and the word vector association extension word set to obtain a final extension word, combining the final extension words with the original query to form a new query, and retrieving the document set again to realize query extension. According to the method, association mode mining and word vector learning are fused, high-quality extension words can be mined, the information retrieval performance is improved, and the method has good application value and popularization prospects.

Description

technical field [0001] The invention relates to a Chinese query expansion method based on pattern mining and word vector similarity calculation, belonging to the technical field of information retrieval. Background technique [0002] Query expansion refers to modifying the original query weight or adding words related to the original query to make up for the lack of user query information and improve the recall and precision of the information retrieval system. Query expansion is to solve the problem of query topic drift and One of the core techniques for the word mismatch problem. [0003] In the past ten years, with the development of network technology and the advent of the era of big data, how to accurately retrieve the information needed by users from massive big data resources has become the focus of attention of academic and industrial circles at home and abroad, making query expansion Technology has been greatly developed, and some new query expansion methods have b...

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to propose a Chinese query expansion method based on pattern mining and word vector similarity calculation, the method is used in the field of information retrieval, such as actua

Images