A Fast Information Retrieval System Based on Distributed Index

Abstract

The invention discloses a fast information retrieval system based on distributed index, comprising: a distributed database, a retrieval control module, a node information extraction module, a time series index model, a distributed computing engine module, a data interaction module and a data retrieval point. The retrieval control module is respectively connected with the distributed database, the node information extraction module, the time series index model, the distributed computing engine module, the data interaction module and the data retrieval point, wherein the output end of the distributed database is connected with the time series index model. The input end is connected, the output end of the time series index model is connected with the input end of the distributed computing engine module, the time series index model also realizes retrieval output through the data interaction module, and the output end of the distributed database is connected to the distributed computing engine module. The node input ends are connected, and the present invention greatly improves the information indexing capability.

Description

technical field [0001] The invention relates to the field of electrical digital data processing, and more specifically to a fast information retrieval system based on distributed indexes. Background technique [0002] The rapid development of information technology and the popularization of computer Internet have brought unprecedented changes to people's lives, especially the way people obtain information has been enriched. In this process, search engines are playing an increasingly important role. When people demand the recall and precision of search, they also demand the performance of search. The development of distributed systems and parallel computing technology is the premise for people to improve the performance of search engines. How to improve the retrieval ability and information processing ability of digital data information is the key point based on distributed index at present. [0003] In the process of distributed indexing, in order to improve the ability o...

AI Technical Summary

Problems solved by technology

In the distributed information retrieval system, the index files are distributed on different Client nodes, and the Server node manages the indexing process and the survival status of the Cliem nodes in a unified manner, so as to achieve parallelization of indexing and improve the efficiency of indexing; During the retrieval process, the Proxy node is responsible for receiving the user's query request, and encapsulates the query and global data together, and distributes it to the Client node responsible for the specific query work, and then merges the results returned by the Client node and returns them to the user. Parallelization of retrieval has been realized, and retrieval efficiency has been improved. Although this application method has certain technical advantages, it is not suitable for cases where the number of data in the retrieval system is greater than 1000, or there are many nodes in the fast information retrieval of the distributed index. In this case, the retrieval efficiency is still low

Images