Implementation method of distributed real-time search engine

A distributed real-time search engine technology, applied in the field of distributed real-time search engine, can solve problems such as time delay, long index construction and maintenance time, and real-time performance cannot be guaranteed, so as to improve real-time performance, enhance fault tolerance, Highly fault-tolerant effects

CN102169507BActive Publication Date: 2013-03-20XIAMEN YAXON NETWORKS CO LTD
0 Cites 1 Cited by

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Publication Date
2013-03-20

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention relates to the technical field of search engines, specifically relating to a distributed real-time search engine. A system construction and operation method of the search engine at least comprises the following steps: A, designing a functional structure of a system; B, designing a data index structure of the system; C, creating an index; D, updating the index; and E, searching the index. The distributed real-time search engine can construct an updating index and a combining index simultaneously in the memory of the system, and can access the updating index and the combining index simultaneously while searching the index; when the number of the documents of the updating index is accumulated to a threshold value, the updating index is submitted to a disk index and changed as a combining index, and the original combining index is changed as a new updating index; and therefore, the updating data can be searched, and the real time property of the retrieval data of the search engine can be improved.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of search engines, in particular to a method for realizing a distributed real-time search engine. Background technique

[0002] With the advent of the era of knowledge economy, the information on the Internet is growing explosively. At this stage, what people are facing is not the lack of information, but the flood of information, and there is no way to filter it. Therefore, how to obtain the required information accurately, quickly and in time is a must Problems that search engines need to solve.

[0003] A search engine refers to a system that uses specific computer programs to collect information from a specific network, such as the Internet, according to a certain strategy. After organizing and processing the information, it provides users with retrieval services and displays relevant information to users.

[0004] Traditional search engines, such as Google, Baidu, Yahoo, etc., although the amount of da...

Examples

Embodiment Construction

[0041] The present invention will be further described in conjunction with the accompanying drawings and specific embodiments.

[0042] A method for realizing a distributed real-time search engine, its system construction and operation is composed of the following steps:

[0043] Step A: Design the functional structure of the system, see appendix figure 1 As shown, the functional structure is created in a cluster system based on Master / Slave, including the following functional nodes: central control node, index data storage node and external service node, wherein the central control node is created in the Master system In the above, the index data storage node and the external service node are created in the Slave system, and the central control node is the master node in the system, which is used for the storage and maintenance of the attribute information indexed in the data index structure, and the index data Storage and maintenance of attribute information of storage node...