Method for applying phrase index technology into internet search engine

Abstract

The invention applies phrase index technology to Internet search engine, decomposes the sentences in page documents into words and expressions, adds a plurality of other phrases to compose index phrase set in front of and behind key words which are taken as head words and generates index documents of web contents with phrases as unit; extracts the content words in query information submitted by user through word segmentation procedure and performs reasonable and possible combination of the words to gain the phrase set for search; precisely matches the phrases in the phrase set for search with the phrases in the index document in turn to gain search results; the phrase emphasizes single words in the aspect of expressing semantics, which facilitates the search result embody the possible intention of query more precisely.

Description

technical field [0001] The present invention mainly relates to the innovation of "text index" mode, which is the bottom key technology of Internet search engine, and some innovations of front-end processing required to perfect this technology. The present invention is to apply the theory of phrase index to the index construction of Internet search engine. Since the phrase index can greatly improve the semantic correlation between the retrieved content and the retrieved content, it can also be said to be an intelligent retrieval method provided for Internet search engines. Background technique [0002] Internet search engine (hereinafter referred to as search engine) is a tool for searching web pages and websites. The basic principle of the current search engine is to automatically collect webpage addresses and texts from the Internet through the collection program of websites or webpages, and then hand over the collected webpage texts to the index and retrieval system, and ...

AI Technical Summary

Problems solved by technology

[0005] Second, the query method of this search engine is essentially based on keywords, and the effect of entering a complete sentence for query is very unsatisfactory. In the case of input sentence query, it cannot reflect the correlation between the search sentence and the text content well, see figure 1

[0006] Third, the existing search engines are fuzzy about the keyword matching of the query, which is conducive to getting more results, but it leads to a lot of useless results, and even interferes with the appearance of better results, and these search engines There is no special treatment for questions, and the effect is relatively bad. See figure 2

[0007] Fourth, the existing search engines do not limit the scope of multiple keywords appearing at the same time. All phrase generation work is not limited to the current sentence, and it is possible to combine keywords contained in different sentences. For example: we Searching for the phrase "Chinese Valentine's Day gifts", using the current popular search engines, the results are likely to be like this:

Images