Self-adaptive neural network training method for image recognition

A neural network training and image recognition technology, applied in the field of image recognition, can solve problems such as long training time, distance amplification, and difficulty in convergence.

Active Publication Date: 2021-05-07
UNIV OF ELECTRONIC SCI & TECH OF CHINA
View PDF8 Cites 6 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Tripletloss belongs to Metric Learning. Compared with softmax, it can easily train large-scale data sets without being limited by video memory. It can make the distance between samples of the same type as small as possible and the distance between samples of different types as large as possible. The disadvantages It is too much attention to the local area, which makes it difficu

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Self-adaptive neural network training method for image recognition
  • Self-adaptive neural network training method for image recognition
  • Self-adaptive neural network training method for image recognition

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The specific embodiments of the present invention are described below so that those skilled in the art can understand the present invention, but it should be clear that the present invention is not limited to the scope of the specific embodiments. For those of ordinary skill in the art, as long as various changes Within the spirit and scope of the present invention defined and determined by the appended claims, these changes are obvious, and all inventions and creations using the concept of the present invention are included in the protection list.

[0038] The current image classification methods based on deep learning all use softmax and its deformation as the loss function. The softmax loss function will divide the entire feature space according to the number of categories to ensure that the categories are separable. This is very suitable for multi-classification tasks such as MNIST and ImageNet, because the test category must be in the training category. Softmax doe...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a self-adaptive neural network training method for image recognition. The method comprises the steps: acquiring and preprocessing an image data set; constructing a convolutional neural network model, and setting an adaptive loss function; inputting the preprocessed image data into a convolutional neural network model for forward propagation to obtain a feature vector and a classification layer weight of the image; calculating an adaptive loss function according to the image feature vector and the classification layer weight, and judging whether the convolutional neural network model converges; performing back propagation on the convolutional neural network model according to the adaptive loss function, and updating the weight of the classification layer; and progressively increasing the number of iterations, and updating the adaptive loss function. Compared with a softmax-based classification loss function training method, the method provided by the invention has the advantages that the setting of hyper-parameters is reduced, the convergence speed of the convolutional neural network model can be accelerated, and the image classification and recognition accuracy can be improved.

Description

technical field [0001] The invention relates to the technical field of image recognition, in particular to an image recognition-oriented adaptive neural network training method. Background technique [0002] The success of convolutional neural networks (CNNs) in image classification and recognition is mainly due to: massive training data, network architecture, and reasonable loss function (loss function). Among them, designing a reasonable loss function according to the characteristics of the data is a key step to improve the image recognition ability. [0003] Softmax function is the most important loss function used in image classification and recognition, and its recognition effect on difficult samples is not good. Through research, it is found that when the intra-class distance of the sample is greater than the inter-class distance, although the softmax loss function can distinguish the inter-class distance, it cannot effectively distinguish the intra-class distance. Th...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/08
CPCG06N3/084G06F18/22G06F18/24G06F18/214
Inventor 罗杨刘翔骆春波韦仕才王亚宁彭涛
Owner UNIV OF ELECTRONIC SCI & TECH OF CHINA
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products