Data matching method and device, electronic equipment and storage medium

Abstract

The embodiment of the invention provides a data matching method and device, electronic equipment and a storage medium, and relates to the technical field of data processing, and the method comprises the steps: obtaining a first quantity and a second quantity which are determined based on input resources and computing resources of the electronic equipment, wherein the inputted resources include the total amount of data for the library data to be allocated, the first quantity is the number of to-be-started computing nodes, and the second quantity is the number of to-be-created threads in each computing node; starting the firstquantity of computing nodes, and creating the second quantity of threads for each computing node; allocating library data to each opened computing node; and under the condition that a data matching request is received, based on the data matching request, using the threads in the computing nodes for matching data to be matched with the library data distributed to the computing nodes to obtain a matching result between the data to be matched and the library data distributed to the computing nodes is obtained. By applying the scheme provided by the embodiment of the invention, the data matching efficiency can be improved.

Description

technical field [0001] The present application relates to the technical field of data processing, in particular to a data matching method, device, electronic equipment and storage medium. Background technique [0002] In the field of data processing, it is usually necessary to match the data to be matched with each data in the library data. For example, in a face recognition scenario, it is necessary to match the collected face data with each registered face data in the face data database. In order to improve the efficiency of data matching, a distributed data matching system can be used to perform distributed matching on the data to be matched. [0003] In related technologies, the distributed data matching system can include multiple physical machines, each physical machine can have a fixed number of computing nodes, and each node can create a specified number of threads, and then the above-mentioned library data can be evenly distributed to each computing node, Each com...

AI Technical Summary

Problems solved by technology

[0004] Although the application of the above scheme can realize distributed matching of the data to be matched, the number of computing nodes and the number of threads opened by each physical machine are fixed, and the computing capabilities of different physical machines are not the same, which may lead to overloading of the physical machine or Under load, the computing resources of the physical machine cannot be effectively used, thereby reducing the efficiency of data matching

Images