Method of improving performance of convolutional neural network based on linear discriminant analysis criterion

A technology of convolutional neural network and linear discriminant analysis, applied in the field of deep learning convolutional neural network, it can solve the problems of difficulty in systematically improving network performance, lack of theoretical analysis and support, etc.

Inactive Publication Date: 2016-01-13
XI AN JIAOTONG UNIV
View PDF3 Cites 42 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

In view of the above two situations, some scholars have recently tried to make some small modifications to the structure of the convolutional neural network, but these small skills are based on experiment-driven, some skills summarized through a large number of experiments, lack of theory Of course, it is difficult to systematically improve network performance

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method of improving performance of convolutional neural network based on linear discriminant analysis criterion
  • Method of improving performance of convolutional neural network based on linear discriminant analysis criterion
  • Method of improving performance of convolutional neural network based on linear discriminant analysis criterion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0041]In order to further improve the performance of the convolutional neural network, not simply by increasing the network size and data size, but also avoid falling into the dilemma of purely experimental drive, the present invention improves the performance of the convolutional neural network by drawing on some mechanisms of the human visual cortex , the human visual system is superior to the machine vision system in almost all tasks, so it has always been an attractive thing to simulate the object recognition of the visual cortex to build a machine system. In fact, the local connection of convolutional neural network The structure shared with weights has been borrowed from some recent neuroscience research results.

[0042] Recent neuroscience research results show that target recognition, in the ventral pathway of the visual cortex, is characterized by a series of nonlinear transformations to gradually dissociate different types of visual target manifolds. Inspired by the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method of improving performance of a convolutional neural network based on a linear discriminant analysis criterion, which belongs to the field of deep learning convolutional neural networks, the field of brain cognition and the field of computer vision image classification. The method comprises the following steps: 1) to-be-processed image sets are divided into a training set, a verification set and a test set; 2) a convolutional neural network model is selected; 3) one layer in the convolutional neural network model in the second step is selected, regularization constraints based on the linear discriminant analysis criterion are carried out on features of the selected layer, and a new convolutional neural network model is formed; and 4) according to mini-batch-based stochastic gradient descent method, the training set is used for training the new convolutional neural network model, and after the new convolutional neural network model is well trained, the well-trained convolutional neural network model tests to-be-classified images, and classified prediction is completed. Experimental results show that the method of the invention can significantly improve the convolutional neural network image classification precision.

Description

Technical field: [0001] The invention relates to the field of deep learning convolutional neural network, the field of brain cognition and the field of computer vision image classification, in particular to a method for improving the performance of the convolutional neural network and a method for improving the performance of the convolutional neural network for image classification. Background technique: [0002] The current deep convolutional neural network has been widely used in various fields of computer vision, such as image classification, target detection and localization, and image retrieval. For a long time, the methods to improve the performance of convolutional network image classification can be roughly divided into two types: one is to increase the scale of the network structure, that is, to increase the number of layers of the network and the number of nodes in each layer; the other is to use larger scale training set. [0003] Increasing the scale of the net...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/66G06N3/08
CPCG06N3/08G06V30/194
Inventor 龚怡宏石伟伟王进军张世周
Owner XI AN JIAOTONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products