Method and device for finding hot videos based on user query logs in real time

Abstract

The invention relates to a method and a device for finding hot videos based on user query logs in real time. The method comprises the steps of: firstly, carrying out word segmentation on user video query logs in a certain period of time to obtain atomic words; then, counting the occurrence number of each atomic word in the user video query logs in the certain period of time and the occurrence number of any two atomic words presenting in the same user query simultaneously; calculating the association degree of any two atomic words in the user video query logs by adopting a pointwise mutual information (PMI) method according to the obtained values of the occurrence number, merging any two atomic words with the association degree exceeding a certain threshold value into a compound word and placing the compound word into a compound word list; and finally, sorting the compound words in a descending manner, wherein the compound words ranking in the front are taken as keywords for finding the hot videos in real time according to a certain proportion finally.

Description

technical field [0001] The invention belongs to the technical field of statistical analysis of Internet data, in particular to a method and device for real-time discovery of hot videos based on user query logs. Background technique [0002] With the rapid development of the Internet, users have put forward higher requirements for video search results, which not only need to be relevant, but also have high real-time performance, which makes real-time search more and more important. Real-time video search refers to the instant and fast search of information in the video library to achieve the effect of instant search. Through real-time search, users can obtain first-hand information on hot events in the first time. However, compared with traditional search, real-time search also brings great challenges. For hot events, due to their suddenness and unpredictability, it is likely that the number of relevant videos and the number of clicks are relatively small, resulting in thei...

AI Technical Summary

Problems solved by technology

One of the difficulties encountered when analyzing user logs is that new terms and hotspots will continuously emerge in the daily user query logs, such as "European Cup", "Corridor Faye Wong and Liu Meilin", etc., but the original word segmentation program cannot reflect Semantic associations of these new words, that is, it is possible to split the strings that should be semantically connected together to form a word into multiple words

The word cutting program generally adopts a vocabulary-based method, that is, scans a string according to a predetermined vocabulary, and finds a most suitable word cutting method through a certain matching method (forward maximum, reverse maximum, two-way matching, etc.). The disadvantage of this method is that it is impossible to segment words that are not included in the original vocabulary, that is, new words

This defect may lead to unsatisfactory results of fuzzy matching (that is, only matching part of the query words when searching)

Images