Automatic model evaluation method and device based on batch normalization layer

An automatic evaluation and normalization technology, applied in the field of computer vision, can solve the problems of consuming a lot of manpower and material resources, the model evaluation method is not feasible, and the test data sample size is large, so as to save manpower, material resources and time

Active Publication Date: 2021-06-25
ZHEJIANG UNIV
View PDF4 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Although this requirement can be met by using standard test cases, in actual application scenarios, the sample size of test data is very large, and it will consume a lot of manpower and material resources if the data is manually labeled
Therefore, many real-world scenarios contain unlabeled test data, making general model evaluation methods infeasible, thus triggering the research of automatic model evaluation methods.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Automatic model evaluation method and device based on batch normalization layer

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0033] A batch normalization layer-based model automatic evaluation method and device of the present invention first extracts the batch normalization layer parameters of the fourth module of the model as a benchmark after the first training is completed; then evaluates the model when needed The second training is performed on the unlabeled test data set. During the second training process, the parameters of the non-batch normalization layer do not need to be updated, and the gradient backpropagation is not required. Only the mean and variance of the batch normalization layer need to be updated. Two parameters; after the second training is completed, the batch normalization layer parameters of the fourth module of the model after the second training are also extracted; After the second training, the parameters extracted were normalized by Gaussian respectively, and then the Euclidean distance of the two groups of parameters was calculated, and the distance was used to evaluate t...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an automatic model evaluation method and device based on a batch normalization layer. The method comprises the following steps: after first training is completed, extracting batch normalization layer parameters of a fourth module of a model as a measurement reference; training the model for the second time on a label-free test data set needing to be evaluated, wherein in the second training process, parameters of a non-batch normalization layer do not need to be updated, gradient back propagation is not needed, and only the two parameters of the mean value and the variance of the batch normalization layer need to be updated; after the second training is completed, extracting batch normalization layer parameters of the fourth module of the model after the second training; respectively carrying out Gaussian normalization on the reference parameters obtained by the first training and the parameters extracted after the second training on the new test set, then calculating the Euclidean distance between the two groups of parameters, and using the distance to evaluate the precision of the label-free test set on the original model.

Description

technical field [0001] The invention belongs to the field of computer vision, and in particular relates to a model automatic evaluation method and device based on a batch normalization layer. Background technique [0002] Target re-identification includes pedestrian re-identification and vehicle re-identification. It aims to retrieve the user-specified pedestrian or vehicle from a series of cross-camera surveillance videos. This technology is widely used in smart cities, security monitoring and other fields. [0003] To solve object re-identification tasks, deep learning-based methods usually require datasets to train and test the models. The one used to train the model is called the training set, and the one used to test the accuracy of the model is called the test set. In order to calculate the accuracy of a model, a test set consisting of test sample images and their true labels is usually required. Although standard test cases can be used to meet this requirement, in a...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06N3/084G06V40/103G06V20/54G06N3/048G06N3/045G06F18/22G06F18/24G06F18/214
Inventor 解皓楠罗浩姜伟
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products