Method and system for updating index of distributed full-text search in real time

Abstract

The invention provides a method and a system for updating the index of distributed full-text search in real time. The method comprises the following steps: sending update requests comprising data of index classified information by an information issue server to a notification server when index information updates; distributing the update requests to corresponding message theme queues by the notification server, and sending the update requests to a request distributor which subscribes corresponding message themes; sending the update requests to an index server which corresponds to index classification by the request distributor according to a routing information list which records the relation of the index classification and the index server; receiving the index update requests sent by therequest distributor by the index server, and reading index update information and operation types; standardizing the fields of the read index update information according to an index structure, and increasing the quantity of the standardized index update information according to the operation types. The invention ensures that the update operation of index information can be reflected in the indexin real time.

Description

technical field [0001] The invention belongs to the technical field of search engine information indexing, in particular to a method and system for real-time updating of distributed full-text indexing. Background technique [0002] Search engines have become an important means for people to query and obtain information. More and more websites are beginning to use search engine-based searches to replace traditional database searches. Different from traditional database query methods, information needs to be indexed first before being retrieved by search engines. The search engine has the advantages of fast search speed, high search accuracy, and support for multilingual word segmentation. [0003] However, real-time updating of information is a difficult point for search engines. In response to this problem, the industry has studied several feasible solutions: [0004] First, the way search engines actively poll the database [0005] The search engine starts a polling pr...

AI Technical Summary

Problems solved by technology

[0007] (2) The deleted records need to be stored in the database for a period of time before they can be physically deleted, which increases the storage space requirements

The service interface generally adopts a synchronous communication method. Therefore, once the amount of update requests is relatively large, the system performance will be significantly reduced, and it cannot support real-time updates of large batches of requests.

Images