Method, system and device for recognizing speckle pattern through RGB face recognition model and storage medium

Abstract

A method, system and device for recognizing a speckle pattern by using an RGB face recognition model, and a storage medium, the method comprising: step S1, performing feature extraction on the speckle pattern by using the RGB face recognition model to obtain a first feature; s2, processing the first feature through a converter to obtain a second feature; wherein the converter is obtained by training a speckle pattern and an RGB (Red, Green and Blue) pattern which are paired; and S3, comparing the second features to obtain a comparison result. According to the invention, the speckle pattern can be quickly and effectively recognized by using the existing RGB face recognition model.

Description

[0001] Technology Neighborhood

[0002] The present invention relates to the field of image recognition technology, and in particular to a method, system, device and storage medium for recognizing a speckle pattern using an RGB face recognition model. Background Art

[0003] The principle of image recognition technology is based on computer vision and machine learning algorithms. It extracts key features from images to exclude redundant information, thereby realizing automatic recognition of targets and objects of different modes. These features usually include color, texture, shape, etc., which are used for subsequent classification, recognition and other tasks.

[0004] The implementation process of image recognition technology usually includes the following steps:

[0005] Data preprocessing: The computer obtains image information through the sensor and converts it into digital signals. Then preprocessing operations such as denoising and smoothing are performed to highlight the important features in the image.

[0006] Feature extraction: Extract key features from the processed images, which will be used for subsequent classification and comparison.

[0007] Classifier design: Design a classifier based on the extracted features and obtain recognition rules through training.

[0008] Classification decision: Classify the identified objects in the feature space, and ultimately achieve accurate recognition of the target in the image.

[0009] For a specific neighborhood, the classifier and decision are relatively certain. The difference between different image models lies mainly in the feature extraction part, that is, extracting key features from the image.

[0010] Due to the huge number of RGB images, the existing RGB face recognition model is very mature and can accurately identify various target objects. However, the number of speckle patterns is small, and the cost of training a speckle image model with similar accuracy to the RGB face recognition model is very high.

[0011] The disclosure of the above background technology content is only used to assist in understanding the inventive concept and technical solution of the present invention. It does not necessarily belong to the prior art of this patent application. In the absence of clear evidence that the above content has been disclosed on the filing date of this patent application, the above background technology should not be used to evaluate the novelty and creativity of the present application. Summary of the invention

[0012] To this end, the present invention provides a method for identifying a speckle pattern using an existing RGB face recognition model, which can quickly and effectively identify the speckle pattern.

[0013] In a first aspect, the present invention provides a method for recognizing a speckle pattern using an RGB face recognition model, characterized by comprising:

[0014] Step S1: extracting facial features from the speckle image through an RGB face recognition model to obtain a first feature;

[0015] Step S2: Processing the first feature through a converter to obtain a second feature; wherein the converter is trained by a pair of speckle images and RGB images;

[0016] Step S3: Compare the second feature to obtain a comparison result.

[0017] Optionally, the method for recognizing a speckle pattern using an RGB face recognition model is characterized in that step S1 comprises:

[0018] Step S11: performing brightness processing on the speckle pattern to make the brightness of the speckle pattern continuous;

[0019] Step S12: converting the speckle pattern into a three-channel image;

[0020] Step S13: extracting features from the three-channel image to obtain a first feature.

[0021] Optionally, the method for recognizing a speckle pattern using an RGB face recognition model is characterized in that step S11 comprises:

[0022] Step S111: dividing the speckle pattern into a dark area and a plurality of independent bright areas according to brightness;

[0023] Step S112: for each pixel point in the dark area, a weighted average value is calculated based on the distances of a plurality of points on the bright area that are closest to each other within a radius r, so as to obtain a new value of each pixel point in the dark area.

[0024] Optionally, the method for recognizing a speckle pattern using an RGB face recognition model is characterized in that the converter comprises:

[0025] Step S21: obtaining a pair of training speckle images and training RGB images;

[0026] Step S22: extracting features from the training speckle image through the RGB face recognition model to obtain a first training feature; extracting features from the training RGB image through the RGB face recognition model to obtain a second training feature;

[0027] Step S23: using the first training feature as an input value of a converter and using the second training feature as a target value of the converter for training until the converter converges.

[0028] Optionally, the method for recognizing a speckle pattern using an RGB face recognition model is characterized in that step S22 comprises:

[0029] Step S221: performing brightness processing on the training speckle pattern to make the brightness of the training speckle pattern continuous, and converting the training speckle pattern into a three-channel image;

[0030] Step S222: extracting features from the three-channel image using the RGB face recognition model to obtain a first training feature;

[0031] Step S223: extracting features from the training RGB image using the RGB face recognition model to obtain second training features.

[0032] Optionally, the method for recognizing a speckle pattern using an RGB face recognition model is characterized in that step S23 comprises:

[0033] Step S231: Select a machine learning model and determine initial parameters;

[0034] Step S232: setting the first training feature as an input value of the machine learning model, and setting the second training feature as a target value of the machine learning model;

[0035] Step S233: training the machine learning model using the paired training speckle images and the training RGB images;

[0036] Step S234: When the performance of the machine learning model reaches a certain threshold or no longer improves significantly, stop training.

[0037] Optionally, the method for recognizing a speckle pattern using an RGB face recognition model is characterized in that step S3 comprises:

[0038] Step S31: comparing the second feature with features in a database;

[0039] Step S32: Calculate the similarity between the second feature and each feature in the database;

[0040] Step S33: determining the comparison result between the second feature and the database according to the calculation result of the similarity.

[0041] In a second aspect, the present invention provides a system for recognizing speckle patterns using an RGB face recognition model, which is used to implement any of the aforementioned methods for recognizing speckle patterns using an RGB face recognition model, and is characterized by comprising:

[0042] An extraction module, used for extracting features from the speckle pattern through an RGB face recognition model to obtain a first feature;

[0043] A conversion module, configured to process the first feature through a converter to obtain a second feature; wherein the converter is trained by a pair of speckle images and RGB images;

[0044] The comparison module is used to compare the second feature to obtain a comparison result.

[0045] In a third aspect, the present invention provides a device for recognizing a speckle pattern using an RGB face recognition model, characterized in that it comprises:

[0046] processor;

[0047] a memory storing executable instructions of the processor;

[0048] Wherein, the processor is configured to execute the steps of any of the aforementioned methods for recognizing speckle patterns using an RGB face recognition model by executing the executable instructions.

[0049] In a fourth aspect, the present invention provides a computer-readable storage medium for storing a program, characterized in that when the program is executed, the steps of the method for recognizing a speckle pattern using an RGB face recognition model as described in any of the above items are implemented.

[0050] Compared with the prior art, the present invention has the following beneficial effects:

[0051] The present invention converts the feature of the speckle pattern into a second feature that can be processed through a converter, so that the RGB face recognition model can process the speckle pattern with high quality, so that the high-quality RGB face recognition model trained based on a large number of RGB images can recognize and process the speckle pattern, solving the problem that the speckle pattern samples are few and it is difficult to train a high-quality speckle pattern face recognition model.

[0052] The present invention processes image features through a converter. Compared with RGB images and speckle patterns, the amount of data is greatly reduced, so that the data for training a stable converter is also greatly reduced. Only a small number of samples are needed to train the converter. When the number of speckle patterns is insufficient to train a speckle pattern face recognition model, the converter can also be trained to effectively recognize the speckle pattern. BRIEF DESCRIPTION OF THE DRAWINGS

[0053] In order to more clearly illustrate the technical solutions in the embodiments of the present invention or the prior art, the drawings required for use in the embodiments or the prior art descriptions are briefly introduced below. Obviously, the drawings described below are only embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on the provided drawings without creative work. Other features, purposes and advantages of the present invention will become more obvious by reading the detailed description of the non-limiting embodiments with reference to the following drawings:

[0054] Figure 1 This is a flowchart of the steps of a method for recognizing a speckle pattern using an RGB face recognition model in an embodiment of the present invention;

[0055] Figure 2 A flowchart of steps for obtaining a first feature in an embodiment of the present invention;

[0056] Figure 3 This is a flow chart of the steps of performing brightness processing on a speckle pattern in an embodiment of the present invention;

[0057] Figure 4 A flowchart of the steps of converter training in an embodiment of the present invention;

[0058] Figure 5 is a flow chart of steps for obtaining a second training feature in an embodiment of the present invention;

[0059] Figure 6 A flowchart of the steps of training a converter to convergence in an embodiment of the present invention;

[0060] Figure 7 A flowchart of steps for obtaining a comparison result in an embodiment of the present invention;

[0061] Figure 8 This is a schematic diagram of the structure of a system for recognizing speckle patterns using an RGB face recognition model in an embodiment of the present invention;

[0062] Fig. 9 A schematic diagram of the structure of a device for recognizing speckle patterns using an RGB face recognition model according to an embodiment of the present invention; and

[0063] Fig.10 Schematic diagram of the structure of a computer-readable storage medium in an embodiment of the present invention. DETAILED DESCRIPTION

[0064] The present invention is described in detail below in conjunction with specific embodiments. The following embodiments will help those skilled in the art to further understand the present invention, but are not intended to limit the present invention in any form. It should be noted that, for those of ordinary skill in the art, several variations and improvements may be made without departing from the concept of the present invention. These all belong to the protection scope of the present invention.

[0065] The terms "first", "second", "third", "fourth", etc. (if any) in the specification and claims of the present invention and the above-mentioned drawings are used to distinguish similar objects, and are not necessarily used to describe a specific order or sequence. It should be understood that the data used in this way can be interchanged where appropriate, so that the embodiments of the present invention described herein, for example, can be implemented in an order other than those illustrated or described herein. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusions, for example, a process, method, system, product or device that includes a series of steps or units is not necessarily limited to those steps or units that are clearly listed, but may include other steps or units that are not clearly listed or inherent to these processes, methods, products or devices.

[0066] The embodiment of the present invention provides a method for recognizing a speckle pattern using an RGB face recognition model, aiming to solve the problems existing in the prior art.

[0067] The following specific embodiments are used to describe in detail the technical solutions of the present invention and how the technical solutions of the present application solve the above-mentioned technical problems. The following specific embodiments can be combined with each other, and the same or similar concepts or processes may not be repeated in some embodiments. The embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0068] The present invention converts the feature of the speckle pattern into a second feature that can be processed through a converter, so that the RGB face recognition model can process the speckle pattern with high quality, so that the high-quality RGB face recognition model trained based on a large number of RGB images can recognize and process the speckle pattern, solving the problem that the speckle pattern samples are few and it is difficult to train a high-quality speckle pattern face recognition model.

[0069] Figure 1 The present invention is a flowchart of a method for recognizing a speckle pattern using an RGB face recognition model according to an embodiment of the present invention.

[0070] like Figure 1 As shown, the steps of a method for recognizing a speckle pattern using an RGB face recognition model in an embodiment of the present invention include:

[0071] Step S1: extracting features from the speckle pattern using an RGB face recognition model to obtain a first feature.

[0072] In this step, the key features are extracted from the speckle image using the RGB face recognition model. Although the imaging principles of speckle images and RGB images are different (speckle images capture the infrared radiation of objects, while RGB images capture visible light), speckle images can be converted into a form suitable for processing by the RGB face recognition model through specific algorithms or technologies, or information corresponding to the features of the RGB image can be extracted from the speckle image.

[0073] For example, the speckle image is converted into a grayscale image, and then the relevant algorithm of the RGB face recognition model is applied to extract features. These features can reflect the key information of the face in the speckle image.

[0074] Step S2: Process the first feature through a converter to obtain a second feature.

[0075] In this step, the converter is trained by paired speckle images and RGB images. The converter is a machine learning model or deep learning network, which is trained by learning the mapping relationship between paired speckle images and RGB images. During the training process, the model receives a large number of speckle images and corresponding RGB images as input, and learns how to convert the features of the speckle images into representations corresponding to the features of the RGB images. Once the converter is trained, it can be used to process the first features extracted from the speckle images. The converter converts, maps or encodes these features to generate second features that are closer or similar to the RGB image features. Since the converter only processes image features, the number of data pairs required to train the converter is very small. For example, the size of an RGB image is 512*512, and its features can be only 25*25, which greatly reduces the data required for training, so that a stable converter can still be trained when the number of speckle images is small.

[0076] Step S3: Compare the second feature to obtain a comparison result.

[0077] In this step, after obtaining the second feature, it can be compared with the known RGB image feature library. The comparison method may include feature matching, similarity calculation, classification recognition, etc. By calculating the similarity or distance between the second feature and each feature in the feature library, the RGB image or feature category that best matches the speckle image can be determined. The comparison result may be a similarity score, a classification label, or a sorted list, depending on the comparison method and application scenario. These results can be used for subsequent decision-making, recognition, or classification tasks.

[0078] This embodiment combines the RGB face recognition model with machine learning technology to achieve effective recognition and feature extraction of speckle images, and has broad application prospects in the fields of image processing, computer vision, and pattern recognition.

[0079] Figure 2 FIG. 1 is a flow chart of steps for obtaining the first feature in an embodiment of the present invention. Figure 2 As shown, in an embodiment of the present invention, a step of obtaining a first feature includes:

[0080] Step S11: performing brightness processing on the speckle pattern to make the brightness of the speckle pattern continuous.

[0081] In this step, the input speckle pattern is subjected to brightness processing, the purpose of which is to make the brightness of the speckle pattern continuous and uniform. Since speckle patterns usually contain randomly distributed bright spots and dark spots, these uneven brightness may affect the subsequent facial feature extraction. Therefore, in this step, image enhancement techniques (such as histogram equalization, adaptive brightness adjustment, etc.) can be used to improve the brightness distribution of the speckle pattern to make it more suitable for subsequent processing.

[0082] Step S12: converting the speckle pattern into a three-channel image.

[0083] In this step, since the speckle image is usually a single-channel (grayscale image) and the RGB image is a three-channel (red, green, blue) image, the speckle image needs to be converted into a three-channel form to match the RGB model. During the conversion, at least one of the following methods can be used:

[0084] Copy channel: copy the gray value of the speckle image into three channels to form a pseudo-color image. Although this method is simple, it may not make full use of the full information of the speckle image.

[0085] Pseudo-color mapping: Use a specific mapping function to convert the grayscale values ​​of the speckle image into RGB values. This method can be customized according to the specific application requirements of the speckle image.

[0086] Other methods: Deep learning techniques can also be considered to generate RGB images corresponding to the speckle images, but this usually requires a lot of training data and computing resources.

[0087] Step S13: extracting features from the three-channel image to obtain a first feature.

[0088] In this step, the RGB face recognition model is used to extract key features from the converted three-channel image for subsequent classification, recognition or comparison tasks. The RGB face recognition model is an existing model. Since the image in this embodiment is converted from a speckle pattern, the first feature obtained by the RGB face recognition model has poor quality and is difficult to apply directly.

[0089] Figure 3 FIG. 1 is a flow chart of the steps of performing brightness processing on a speckle pattern in an embodiment of the present invention. Figure 3 As shown, in an embodiment of the present invention, a step of performing brightness processing on a speckle pattern includes:

[0090] Step S111: dividing the speckle pattern into a dark area and a plurality of independent bright areas according to brightness.

[0091] In this step, the speckle pattern is divided into a dark area and multiple independent bright areas according to the brightness value of each pixel in the speckle pattern. The brightness division standard can be determined according to the specific application scenario and image characteristics. Usually, a threshold can be used to distinguish between dark and bright areas. The bright area refers to the set of pixels whose brightness values ​​are higher than the threshold, while the dark area refers to the set of pixels whose brightness values ​​are lower than the threshold. For the speckle pattern, the bright area is the area where the speckle is located, and the dark area is the area without speckle. The bright area represents the reflection signal of the speckle, and the dark area represents the signal of the ambient light. Since the speckle is independent, the bright area appears as multiple independent areas on the image.

[0092] Step S112: for each pixel point in the dark area, a weighted average value is calculated based on the distances of a plurality of points on the bright area that are closest to each other within a radius r, so as to obtain a new value of each pixel point in the dark area.

[0093] In this step, the speckle pattern is made continuous so that it has better consistency with the RGB image. The processing idea of ​​this step is that for each pixel in the dark area, we find the nearest points in multiple bright areas within the radius r, and calculate the weighted average value based on the brightness values ​​and distances of these points as the new brightness value of the pixel.

[0094] In the specific implementation, a search radius r is defined for each pixel in the dark area, and then the points in the bright area are searched within this radius. The radius r includes at least two independent bright areas. For each bright area, the bright area point closest to the pixel point is obtained. For each pixel point in the dark area, the distance between each bright area point found and the current dark area pixel point is calculated, and a weight is determined based on this distance. The weight can be calculated as the reciprocal of the distance, the reciprocal of the square of the distance, etc. After obtaining the weights of all bright area points, we can calculate the weighted average value based on these weights and the corresponding brightness values ​​as the new brightness value of the current dark area pixel point. In this way, by traversing all the pixels in the dark area and repeating the above process, we can obtain the processed speckle pattern, in which the brightness of the dark area becomes continuous and more uniform.

[0095] Figure 4 FIG. 1 is a flow chart of the steps of training a converter in an embodiment of the present invention. Figure 4 As shown, a step of training a converter in an embodiment of the present invention includes:

[0096] Step S21: obtaining a pair of training speckle images and training RGB images.

[0097] In this step, in order to train the converter, pairs of speckle images and RGB images need to be prepared. These image pairs should have similar scenes or contents, but come from the structured light sensor and the visible light camera respectively. The paired training speckle images and the training RGB images are obtained by taking the same target object by the depth camera to ensure that each pair of images is aligned in space and time, that is, they represent the view of the same scene at the same time. The collected images can also be preprocessed, such as denoising, enhancement, cropping, etc., to improve the training effect.

[0098] Step S22: extracting features from the training speckle image through the RGB face recognition model to obtain a first training feature; extracting features from the training RGB image through the RGB face recognition model to obtain a second training feature.

[0099] In this step, the RGB face recognition model is used to extract the features of the speckle pattern and the RGB image. The training speckle pattern is input into the RGB face recognition model (it needs to be converted into a three-channel form first), and the first training feature is extracted through the convolution layer, pooling layer and other structures of the model. Similarly, the training RGB image is input into the model to extract the second training feature. These features are usually high-dimensional vectors that represent the key information in the image. Since the RGB face recognition model is more accurate in extracting RGB images, the quality of the second training feature is relatively high, while the quality of the first training feature is relatively low.

[0100] Step S23: using the first training feature as an input value of a converter and using the second training feature as a target value of the converter for training until the converter converges.

[0101] In this step, the training converter is a neural network or other machine learning model to learn the mapping from speckle pattern features to RGB image features. Select a suitable converter model according to the task requirements, such as a fully connected neural network, a convolutional neural network (CNN), a recurrent neural network (RNN), etc. Then design a suitable loss function to measure the difference between the features output by the converter and the target features. Common loss functions include mean square error (MSE), cross entropy loss, etc. Select a suitable optimization algorithm (such as stochastic gradient descent, Adam, etc.) to update the parameters of the converter to minimize the loss function. The paired first training features and the second training features are input into the converter, the loss is calculated by forward propagation, and then the parameters are updated by back propagation. Repeat this process until the converter converges, that is, the loss function no longer decreases significantly. After completing these steps, the converter is trained and can be used to convert the features of the speckle pattern into features similar to the RGB image, thereby supporting subsequent tasks such as image classification, target detection, image fusion, etc.

[0102] Figure 5 FIG. 1 is a flow chart of steps for obtaining a second training feature in an embodiment of the present invention. Figure 5 As shown, in an embodiment of the present invention, a step of obtaining a second training feature includes:

[0103] Step S221: converting the training speckle pattern into a pseudo-color image.

[0104] In this step, since the speckle image is usually a single-channel grayscale image, and the RGB face recognition model expects the input to be a three-channel color image, the speckle image needs to be converted into a pseudo-color image to match the input requirements of the model. According to the characteristics of the speckle image and the application requirements, a suitable pseudo-color mapping method is selected. Common mapping methods include fixed mapping based on grayscale (such as mapping grayscale values ​​to a specific RGB color space), adaptive mapping based on image content (such as using a clustering algorithm to group grayscale values ​​and assign different colors), etc.

[0105] Step S222: extracting features from the pseudo-color image using the RGB face recognition model to obtain a first training feature.

[0106] In this step, a pre-trained RGB face recognition model (such as a convolutional neural network, a deep learning model, etc.) is used to extract features of the pseudo-color image. Select a suitable RGB face recognition model according to the task requirements. This model should be able to process three-channel inputs and output a high-dimensional feature vector. The pseudo-color image is input into the model, and the first training features are extracted through the model's convolutional layer, pooling layer, fully connected layer and other structures. These features usually represent key information in the image, such as edges, textures, shapes, etc.

[0107] Step S223: extracting features from the training RGB image using the RGB face recognition model to obtain second training features.

[0108] In this step, the RGB face recognition model is also used to extract the features of the training RGB image, so as to compare and train the converter with the features of the pseudo-color image. Since the RGB face recognition model for extracting the features of the pseudo-color image has been selected, the model can be directly reused to extract the features of the training RGB image. The training RGB image is input into the model, and the second training features are extracted by the same network structure. These features should be represented in the same feature space as the features of the pseudo-color image, so as to follow up training and comparison.

[0109] After completing these steps, pairs of first training features and second training features will be obtained, which come from the pseudo color image and the training RGB image respectively. These feature pairs will be used to train the converter to learn the mapping relationship from speckle pattern features to RGB image features.

[0110] Figure 6 FIG. 1 is a flow chart of the steps of training a converter to convergence in an embodiment of the present invention. Figure 6 As shown, a step of training a converter to convergence in an embodiment of the present invention includes:

[0111] Step S231: Select a machine learning model and determine initial parameters.

[0112] In this step, select a suitable machine learning model that can learn the mapping relationship from speckle image features to RGB image features. In model selection, choose a suitable model based on the complexity of the problem and the characteristics of the data. For example, for complex image conversion tasks, you can choose a deep learning model (such as a convolutional neural network CNN) or a generative adversarial network (GAN). For simpler tasks, you can choose a traditional machine learning algorithm (such as support vector machine SVM, random forest, etc.). However, considering the complexity of feature conversion, a deep learning model is usually more suitable. Parameter initialization: Set the initial parameters for the model, such as learning rate, weight decay, batch size, etc. These parameters have an important impact on the training effect and speed of the model.

[0113] Step S232: setting the first training feature as an input value of the machine learning model, and setting the second training feature as a target value of the machine learning model.

[0114] In this step, training data is prepared, the extracted speckle image features (first training features) are used as input, and the corresponding RGB image features (second training features) are used as target values. In this step, it is necessary to ensure that each first training feature is paired with a corresponding second training feature. The paired feature data is input into the machine learning model, where the first training features are used as the data of the input layer and the second training features are used as the data of the output layer or target layer.

[0115] Step S233: Use the paired training speckle images and the training RGB images to train the machine learning model.

[0116] In this step, through iterative training, the model can learn the mapping relationship from speckle image features to RGB image features. The input features (first training features) are forward propagated through the model to obtain the predicted output of the model. The difference between the predicted output and the target value (second training feature) is calculated, that is, the loss value. According to the loss value, the parameters of the model are updated through the back propagation algorithm to reduce the loss value. Repeat the process of forward propagation, loss calculation and back propagation until the model performance reaches a certain standard or no longer improves significantly.

[0117] Step S234: When the performance of the machine learning model reaches a certain threshold or no longer improves significantly, stop training.

[0118] In this step, the performance of the model is evaluated regularly during the training process, such as using the validation set to calculate accuracy, recall and other indicators. When the performance of the model reaches a preset threshold (such as accuracy exceeding 90%) or the performance does not improve significantly over multiple consecutive iterations, the training is stopped. The trained model parameters are saved to a file for subsequent use.

[0119] Figure 7 FIG. 1 is a flow chart of steps for obtaining a comparison result in an embodiment of the present invention. Figure 7 As shown, in an embodiment of the present invention, a step of obtaining a comparison result includes:

[0120] Step S31: Compare the second feature with the features in the database.

[0121] In this step, the second feature identified in step S2 is compared with known features stored in the database to find possible matches. The second feature is compared with each feature in the database one by one. This may require traversing all feature records in the database.

[0122] Step S32: Calculate the similarity between the second feature and each feature in the database.

[0123] In this step, the similarity between the second feature and each feature in the database is quantified to determine whether there is a close enough match. Choose an appropriate similarity metric, such as Euclidean distance, cosine similarity, Manhattan distance, etc. These methods calculate similarity based on the mathematical properties of feature vectors. For each feature in the database, calculate the similarity value between it and the second feature. Record the similarity value of each feature for subsequent analysis.

[0124] Step S33: determining the comparison result between the second feature and the database according to the calculation result of the similarity.

[0125] In this step, based on the similarity calculation results, determine whether there is a match between the second feature and the database, and may further determine the degree or confidence of the match. Set a similarity threshold to determine whether the two features are close enough to be considered a match. This threshold may be adjusted according to application requirements and data characteristics. Compare the similarity value of each feature with the threshold. If the similarity value of a feature is higher than the threshold, it is determined to be a match. Output the comparison results, including whether a match is found, the number of matches (if there are multiple matches), and possible match degree or confidence information.

[0126] Figure 8The figure is a schematic diagram of the structure of a system for recognizing speckle patterns using an RGB face recognition model according to an embodiment of the present invention.

[0127] like Figure 8 As shown, a system for recognizing speckle patterns using an RGB face recognition model in an embodiment of the present invention includes:

[0128] An extraction module, used for extracting features from the speckle pattern through an RGB face recognition model to obtain a first feature;

[0129] A conversion module, configured to process the first feature through a converter to obtain a second feature; wherein the converter is trained by a pair of speckle images and RGB images;

[0130] The comparison module is used to compare the second feature to obtain a comparison result.

[0131] This embodiment converts the features of the speckle pattern into a second feature that can be processed through a converter, so that the RGB face recognition model can process the speckle pattern with high quality, so that the high-quality RGB face recognition model trained based on a large number of RGB images can recognize and process the speckle pattern, solving the problem of few speckle pattern samples and difficulty in training a high-quality speckle pattern face recognition model.

[0132] The embodiment of the present invention also provides a device for recognizing speckle patterns using an RGB face recognition model, comprising a processor and a memory in which executable instructions of the processor are stored. The processor is configured to execute the steps of a method for recognizing speckle patterns using an RGB face recognition model by executing the executable instructions.

[0133] As described above, this embodiment converts the feature of the speckle pattern into a second feature that can be processed through a converter, so that the RGB face recognition model can process the speckle pattern with high quality, so that the high-quality RGB face recognition model trained based on a large number of RGB images can recognize and process the speckle pattern, which solves the problem of few speckle pattern samples and difficulty in training a high-quality speckle pattern face recognition model.

[0134] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as systems, methods or program products. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software implementations, which may be collectively referred to herein as "circuits", "modules" or "platforms".

[0135] Fig. 9 Schematic diagram of the structure of a device for recognizing speckle patterns using an RGB face recognition model in an embodiment of the present invention. Fig. 9The electronic device 600 according to this embodiment of the present invention is described. Fig. 9 The electronic device 600 shown is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0136] like Fig. 9 As shown, the electronic device 600 is in the form of a general computing device. The components of the electronic device 600 may include, but are not limited to: at least one processing unit 610, at least one storage unit 620, a bus 630 connecting different platform components (including the storage unit 620 and the processing unit 610), a display unit 640, etc.

[0137] The storage unit stores program codes, which can be executed by the processing unit 610, so that the processing unit 610 executes the steps of various exemplary embodiments of the present invention described in the method of recognizing a speckle pattern by an RGB face recognition model in the above-mentioned description. For example, the processing unit 610 can execute the following steps: Figure 1 Follow the steps shown in .

[0138] The storage unit 620 may include a readable medium in the form of a volatile storage unit, such as a random access memory unit (RAM) 6201 and / or a cache memory unit 6202 , and may further include a read-only memory unit (ROM) 6203 .

[0139] The storage unit 620 may also include a program / utility 6204 having a set (at least one) of program modules 6205, such program modules 6205 including but not limited to: an operating system, one or more application programs, other program modules, and program data, each of which or some combination may include an implementation of a grid environment.

[0140] Bus 630 may represent one or more of several types of bus structures, including a memory unit bus or memory unit controller, a peripheral bus, an accelerated graphics port, a processing unit, or a local bus using any of a variety of bus architectures.

[0141] The electronic device 600 may also communicate with one or more external devices 700 (e.g., keyboards, pointing devices, Bluetooth devices, etc.), one or more devices that enable a user to interact with the electronic device 600, and / or any device that enables the electronic device 600 to communicate with one or more other computing devices (e.g., routers, modems, etc.). Such communication may be performed through an input / output (I / O) interface 650. Furthermore, the electronic device 600 may also communicate with one or more grids (e.g., a local area network (LAN), a wide area network (WAN), and / or a public grid, such as the Internet) through a grid adapter 660. The grid adapter 660 may communicate with other modules of the electronic device 600 through the bus 630. It should be understood that although Fig. 9 Not shown, other hardware and / or software modules may be used in conjunction with electronic device 600, including but not limited to: microcode, device drivers, redundant processing units, external disk drive arrays, RAID systems, tape drives, and data backup storage platforms.

[0142] In an embodiment of the present invention, a computer-readable storage medium is further provided for storing a program, and when the program is executed, the steps of a method for recognizing a speckle pattern using an RGB face recognition model are implemented. In some possible implementations, various aspects of the present invention may also be implemented in the form of a program product, which includes a program code. When the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps of various exemplary embodiments of the present invention described in the above-mentioned method for recognizing a speckle pattern using an RGB face recognition model section of this specification.

[0143] As shown above, this embodiment converts the features of the speckle pattern into a second feature that can be processed through a converter, so that the RGB face recognition model can process the speckle pattern with high quality, so that the high-quality RGB face recognition model trained based on a large number of RGB images can recognize and process the speckle pattern, which solves the problem of few speckle pattern samples and difficulty in training a high-quality speckle pattern face recognition model.

[0144] Fig.10 Schematic diagram of the structure of a computer-readable storage medium in an embodiment of the present invention. Fig.10 As shown, a program product 800 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0145] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0146] Computer readable storage media may include data signals propagated in baseband or as part of a carrier wave, wherein readable program codes are carried. Such propagated data signals may take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. The readable storage medium may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, device, or device. The program codes contained on the readable storage medium may be transmitted using any suitable medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination thereof.

[0147] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of grid, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., via the Internet using an Internet service provider).

[0148] This embodiment converts the features of the speckle pattern into a second feature that can be processed through a converter, so that the RGB face recognition model can process the speckle pattern with high quality, so that the high-quality RGB face recognition model trained based on a large number of RGB images can recognize and process the speckle pattern, solving the problem of few speckle pattern samples and difficulty in training a high-quality speckle pattern face recognition model.

[0149] In this specification, each embodiment is described in a progressive manner, and each embodiment focuses on the differences from other embodiments, and the same and similar parts between the embodiments can be referred to each other. The above description of the disclosed embodiments enables professionals and technicians in this field to implement or use the present invention. The various modifications to these embodiments will be obvious to professionals and technicians in this field, and the general principles defined herein can be implemented in other embodiments without departing from the spirit or scope of the present invention. Therefore, the present invention will not be limited to these embodiments shown in this article, but will comply with the widest range consistent with the principles and novel features disclosed herein.

[0150] The above describes the specific embodiments of the present invention. It should be understood that the present invention is not limited to the above specific embodiments, and those skilled in the art can make various modifications or variations within the scope of the claims, which do not affect the essence of the present invention.

Claims

1. A method for recognizing speckle patterns using an RGB face recognition model, characterized in that: include: Step S1: extracting facial features from the speckle pattern through an RGB face recognition model to obtain a first feature; Step S2: Processing the first feature through a converter to obtain a second feature; wherein the converter is trained by a pair of speckle images and RGB images; Step S3: Compare the second feature to obtain a comparison result.

2. The method for recognizing speckle patterns using an RGB face recognition model according to claim 1, characterized in that: Step S1 includes: Step S11: performing brightness processing on the speckle pattern to make the brightness of the speckle pattern continuous; Step S12: converting the speckle pattern into a three-channel image; Step S13: extracting features from the three-channel image to obtain a first feature.

3. The method for recognizing speckle patterns using an RGB face recognition model according to claim 2, characterized in that: Step S11 includes: Step S111: dividing the speckle pattern into a dark area and a plurality of independent bright areas according to brightness; Step S112: for each pixel point in the dark area, a weighted average value is calculated based on the distances of a plurality of points on the bright area that are closest to each other within a radius r, so as to obtain a new value of each pixel point in the dark area.

4. The method for recognizing speckle patterns using an RGB face recognition model according to claim 1, characterized in that: The converter includes: Step S21: obtaining a pair of training speckle images and training RGB images; Step S22: extracting features from the training speckle image through the RGB face recognition model to obtain a first training feature; extracting features from the training RGB image through the RGB face recognition model to obtain a second training feature; Step S23: using the first training feature as an input value of a converter and using the second training feature as a target value of the converter for training until the converter converges.

5. The method for recognizing speckle patterns using an RGB face recognition model according to claim 4, characterized in that: Step S22 includes: Step S221: performing brightness processing on the training speckle pattern to make the brightness of the training speckle pattern continuous, and converting the training speckle pattern into a three-channel image; Step S222: extracting features from the three-channel image using the RGB face recognition model to obtain a first training feature; Step S223: extracting features from the training RGB image using the RGB face recognition model to obtain second training features.

6. The method for recognizing speckle patterns using an RGB face recognition model according to claim 4, characterized in that: Step S23 includes: Step S231: Select a machine learning model and determine initial parameters; Step S232: setting the first training feature as an input value of the machine learning model, and setting the second training feature as a target value of the machine learning model; Step S233: training the machine learning model using the paired training speckle images and the training RGB images; Step S234: When the performance of the machine learning model reaches a certain threshold or no longer improves significantly, stop training.

7. The method for recognizing speckle patterns using an RGB face recognition model according to claim 1, characterized in that: Step S3 includes: Step S31: comparing the second feature with features in a database; Step S32: Calculate the similarity between the second feature and each feature in the database; Step S33: determining the comparison result between the second feature and the database according to the calculation result of the similarity.

8. A system for recognizing speckle patterns using an RGB face recognition model, used to implement the method for recognizing speckle patterns using an RGB face recognition model according to any one of claims 1 to 7, characterized in that: include: An extraction module, used for extracting features of the speckle pattern through an RGB face recognition model to obtain a first feature; A conversion module, configured to process the first feature through a converter to obtain a second feature; wherein the converter is trained by a pair of speckle images and RGB images; A comparison module is used to compare the second feature to obtain a comparison result.

9. A device for recognizing speckle patterns using an RGB face recognition model, characterized in that: include: processor; a memory storing executable instructions of the processor; The processor is configured to execute the steps of the method for recognizing speckle patterns using an RGB face recognition model as described in any one of claims 1 to 7 by executing the executable instructions.

10. A computer-readable storage medium for storing a program, characterized in that: When the program is executed, the steps of the method for recognizing speckle patterns using an RGB face recognition model described in any one of claims 1 to 7 are implemented.

Images