Distributed searching method based on cloud computing

Abstract

The invention discloses a distributed searching method based on cloud computing. The method includes the steps that network files of various formats are crawled through a distributed web crawler; a document table format with a user-defined format is extracted through the files crawled by the distributed parallel extraction analysis crawler; the extracted document content is stored into a distributed database, and a document table database is established; an index table is established through the document table database, and a parallel computing technology is also adopted; an index table format is also of a user-defined format; index files are imported to an index database, and index data are provided for a searcher; a PageRank and optimized on-line sorting algorithm is adopted in search results. The distributed searching method based on cloud computing has the advantages that the distributed storage and computing characteristic is adopted, by the aid of the improved and optimized sorting algorithm, the search results are more accurate, and due to the fact that the semantic extension keyword technology is used, and the search results are richer.

Description

technical field [0001] The invention relates to a distributed search method, in particular to a distributed search method based on cloud computing for fast retrieval under processing large data. Background technique [0002] With the rapid development of Internet, WWW (World Wide Web referred to as WWW) has become a huge information space, providing users with valuable information resources. In the face of a large number of information resources, it is very inconvenient to browse step by step through a browser. How to quickly and accurately obtain the required information from the WWW has become a crucial issue. The emergence of search engines has greatly improved people's ability to collect information. However, the existing search engines still have problems and difficulties in terms of search efficiency, information maintenance, information repetition, network and sites, and load. [0003] At present, most search engines are centralized in terms of architecture. That i...

AI Technical Summary

Problems solved by technology

[0006] (1) Massive network data: the amount of network information is large and the coverage is wide, and the calculation and storage of these data need to consume a lot of time and storage space

[0007] (2) User differences: users have different background knowledge, and their understanding of word meanings is also different. Different users have different tendencies for the same search term

[0008] (3) Retrieval is related to time: the same retrieval request by the user in different periods or stages still obtains exactly the same retrieval results, which does not have adaptive ability for users

[0009] (4) Expression of search terms: Due to the lack of domain knowledge of users and the limitations of the query interface of search engines, it is impossible to accurately realize the user's search intent

Images