Microblog query expansion method based on multiple layers

Abstract

The invention discloses a microblog query expansion method based on multiple layers. The microblog query expansion method based on the multiple layers is characterized in that keywords are extracted from a PRF (Pseudo Relevance Feedback) layer of a corpus corresponding to original microblog query words and a web layer of an external source to serve as candidate query expansion words, the candidate query expansion words and original microblog query sentences are merged as a label set for labeling documents in the PRF layer, moreover, Labeled LDA is utilized to semantically model for the labeled PRF documents, the candidate query expansion words and the microblog query words coming from the different sources are then mapped to a unified semantic layer, the potential semantics of the candidate query expansion words and the microblog query words are mined, and according to the semantic similarity between the candidate query expansion words and the microblog query words, the candidate query expansion words which are irrelevant to the semantics of the microblog query words are filtered out, so that a new microblog query word is formed for more accurate query and retrieval. Compared with the prior art, the microblog query expansion method based on the multiple layers has the advantages of less query drifts, high retrieval efficiency and high accuracy, and in particular, the microblog query expansion method based on the multiple layers effectively integrates expansion words to achieve an optimal expansion effect, so that query results can meet the real information requirement of users.

Description

technical field [0001] The invention relates to the technical field of Internet information search, in particular to a multi-level microblog query expansion method. Background technique [0002] With the rise of social networks, Weibo has become an important platform for people to share real-time information. Faced with a large number of microblogs published every day involving various aspects, users usually use the method of retrieval if they want to find the content they are interested in. However, on the one hand, the query words entered by the user are few and not accurate enough; on the other hand, the microblog itself has a character limit and the text is short, so the query results often do not meet the real information needs of the user. In order to solve this problem, the user query is usually expanded during the retrieval process. The expansion of user query is mainly divided into two categories: the expansion based on the query corpus itself and the expansion bas...

AI Technical Summary

Problems solved by technology

[0003] However, the query expansion of the existing technology brings a large number of words irrelevant to the original query, which not only reduces the retrieval efficiency, but also causes query drift and damages the accuracy of the retrieval results. Words are effectively integrated to achieve the optimal expansion effect, so that the query results can meet the real information needs of users

Images