Distributed data processing method and system

Abstract

The embodiment of the invention discloses a distributed data processing method and system, and the method comprises the steps: enabling a metadata node to receive a retrieval instruction sent by a client, and enabling the metadata node to belong to a metadata cluster; enabling the metadata node to feed back all stored metadata to the client according to the retrieval instruction; enabling the client to select a first target data node according to the metadata and send a retrieval request to the first target data node, wherein one group of metadata corresponds to one data node, a plurality of data nodes form a data node group, all the data node groups form a characteristic index server cluster, each data node group has a first target data node, and data in the data node groups are synchronous; enabling the first target data node to receive the retrieval request and obtain a feature index in the retrieval request; and enabling the first target data node to determine retrieval data according to the feature index and feed the retrieval data back to the client, so that the client determines a retrieval result according to the retrieval data. According to the method and the device, quick retrieval is realized under the condition that the client does not store metadata.

Description

technical field [0001] The embodiments of the present invention relate to the field of computer technology, and in particular to a distributed data processing method and system. Background technique [0002] With the development of computer technology, various fields are increasingly dependent on computer technology. For example, in the field of intelligent security, various electronic devices are usually used to form a security system in a networked manner. Among them, the camera is an indispensable part in the security field. In order to facilitate subsequent evidence collection, it is usually set that the processor-level electronic device in the security system stores the images captured by the camera, and stores the corresponding metadata in the client used by the user, so that the user can retrieve through the metadata. At this time, the stored data can only achieve disk-level fault tolerance. When the client is abnormal or damaged, the user will not be able to retrie...

AI Technical Summary

Problems solved by technology

At this time, the stored data can only achieve disk-level fault tolerance. When the client is abnormal or damaged, the user will not be able to retrieve the saved data, which will cause irreparable losses to the user

Images