Supercharge Your Innovation With Domain-Expert AI Agents!

Image classification method for optimizing decision boundaries and enhancing robustness of deep neural network

A technology of deep neural network and classification method, which is applied in the field of image classification that optimizes the decision boundary and enhances the robustness of deep neural network. The effect of network robustness

Pending Publication Date: 2021-05-11
BEIJING UNIV OF TECH
View PDF0 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] Aiming at the problem that when the existing model classifies images, adding small disturbances that are difficult to detect by the naked eye will change the category and cause inaccurate image classification, the present invention proposes a method to optimize the decision boundary to enhance the robustness of the deep neural network. The innovation of the image classification method is that a new set of methods is proposed to calculate the network decision boundary and its topological properties to construct the decision domain model of the current network. According to the analysis of the distribution of the decision boundary in the sample, an appropriate strategy is selected to adjust the decision. Boundary: By using samples close to the decision boundary to calculate and generate adversarial samples, through confrontation training, adjust the network parameters corresponding to the decision boundary that is sensitive to disturbances, that is to say, the optimized neural network is less sensitive to samples with disturbances added , thus improving the robustness of the network

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Image classification method for optimizing decision boundaries and enhancing robustness of deep neural network
  • Image classification method for optimizing decision boundaries and enhancing robustness of deep neural network
  • Image classification method for optimizing decision boundaries and enhancing robustness of deep neural network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0054] According to the above method, the specific implementation details are as follows:

[0055] Step 1: Build the network

[0056] Concrete network can be the LeNet network that uses in the experimental process of the present invention as basic network, has made appropriate adjustment according to data set;

[0057] The input sample size is 32*32*3.

[0058] The network structure is as follows:

[0059] The first convolution layer: use 6 convolution kernels with a size of 5*5*3, so the size of the convolution kernel is (5*5*1)*6; the step size of the convolution operation is 1, and Relu is used as The activation function processes the result after the first convolution, and the output size is 28*28*6.

[0060] The first maximum pooling layer: the maximum pooling layer with a window of 2*2, the output size is 14*14*6;

[0061] The second convolution layer: use 16 convolution kernels of 5*5*6, so the size of the convolution kernel is (5*5*6)*16, the step size of the convo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to an image classification method for optimizing decision boundaries and enhancing robustness of a deep neural network, which is characterized in that adversarial samples are calculated by calculating a decision domain model of a network, and distribution of the decision boundaries corresponding to the neural network is optimized through adversarial training, so that the robustness of the network is improved. The method specifically comprises the steps that parameters of a trained deep neural network are used for calculating and obtaining a corresponding decision domain model, the model and a training sample are used for determining which decision boundaries corresponding to the network are sensitive to disturbance, and data in a training set is used for calculating adversarial samples of samples around the decision boundaries sensitive to disturbance; the adversarial samples are mixed into training samples, adversarial training is carried out on the network, network parameters are optimized so that decision boundaries move in the opposite direction of the sensitive direction, the sensitivity of the decision boundaries to disturbance is reduced, the deep neural network with high robustness is obtained, and the anti-interference capability of the network in a classification task is improved.

Description

technical field [0001] The invention belongs to the field of artificial intelligence, and in particular relates to an image classification method for optimizing decision boundaries and enhancing the robustness of deep neural networks. Background technique [0002] Deep neural networks can be used to perform classification and regression tasks. Today, deep neural networks perform well in a variety of classification tasks. When the deep neural network performs classification tasks, it mainly relies on the decision domains obtained by dividing the sample space by the deep neural network. Each decision domain corresponds to its own category. When a sample point falls into a certain decision domain, the corresponding sample is classified. The network is classified into categories corresponding to the decision domain. But for some special picture samples, adding some small perturbations to them will cause the network to make wrong judgments on the category of the picture. This k...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/084G06N3/045G06F18/2411Y02T10/40
Inventor 刘波杜宾
Owner BEIJING UNIV OF TECH
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More