Distributed vector retrieval system and method

Abstract

The embodiment of the invention discloses a distributed vector retrieval system, which comprises a main node group, which comprises a plurality of main nodes, one is a leader node, the leader node distributes an index table fragment to a specified vector node group, and the leader node synchronizes data of the index table to other main nodes; a plurality of vector node groups, each vector node group comprising a plurality of vector nodes, each vector node storing vector data and index table fragments, each vector node responding to a request from the routing node and retrieving data or synchronizing data; a routing node group which comprises a plurality of routing nodes, wherein each routing node sends the request to the corresponding vector node group and merges and returns retrieval results; and an index data maintenance tool which writes the index vector data into the index message queue according to the request and calls the routing node according to the message type. The embodiment of the invention further discloses a distributed vector retrieval method. Under the condition of high concurrent access, consistent updating of the offline index data and the online index data can be ensured.

Description

technical field [0001] The present invention relates to the field of computer technology, in particular to a distributed vector retrieval system and method. Background technique [0002] The distributed vector retrieval system in the prior art, in the case of high concurrent access, the response time is relatively slow, or there is a downtime, and the online real-time index vector data and the offline batch index vector data cannot be updated consistently, resulting in The index vector data is inconsistent, affecting the reliability of the retrieval system. Contents of the invention [0003] In order to solve the above problems, the object of the present invention is to provide a distributed vector retrieval system and method, which can ensure consistent update of offline and online index vector data under high concurrent access conditions. [0004] An embodiment of the present invention provides a distributed vector retrieval system, the system comprising: [0005] The ...

AI Technical Summary

Problems solved by technology

[0002] The distributed vector retrieval system in the prior art, in the case of high concurrent access, the response time is relatively slow, or there is a downtime, and the online real-time index vector data and the offline batch index vector data cannot be updated consistently, resulting in Index vector data is inconsistent, affecting the reliability of the retrieval system

Images