Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

A Deep Neural Network Method Based on Information Lossless Pooling

A neural network and pooling technology, applied to biological neural network models, neural architectures, instruments, etc., can solve the problems of feature information loss and high complexity of pooling operations, so as to improve performance, improve network performance, and achieve simple effects

Inactive Publication Date: 2020-08-07
TIANJIN UNIV
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0013] The purpose of the present invention is to overcome the problems of feature information loss and high complexity of pooling operations in the existing deep neural network pooling layer operation, and propose a deep neural network method based on information lossless pooling, which can effectively maintain The feature information of all feature maps in the pooling process further improves the performance of deep neural networks for various computer vision tasks

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A Deep Neural Network Method Based on Information Lossless Pooling
  • A Deep Neural Network Method Based on Information Lossless Pooling
  • A Deep Neural Network Method Based on Information Lossless Pooling

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0034] Below in conjunction with accompanying drawing this patent is described further.

[0035] figure 1 (a)(b) describe traditional pooling operations. In the traditional pooling operation, assuming that a neighborhood contains four values ​​​​(1.5, 1.1, 2.0, 0.8) as shown in Figure (a), after the traditional pooling operation, such as the maximum pooling operation, the output is the largest A value of 2.0 is used as the output of the current neighborhood. That is, a numerical value is used to replace the current neighborhood value, while other values ​​are discarded. As shown in (b), after the traditional pooling operation (step size is 2), the dimension of the single feature map is reduced to half of the original. However, in this process, part of the information is lost and cannot be recovered, which is an information-damaging pooling operation, which limits the performance of the neural network when it is applied to tasks such as image recognition.

[0036] figure 1...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a deep convolutional neural network method based on information lossless pooling, which is used for image classification, comprising the following steps: collecting various types of images, and marking the image categories as image label information; dividing the image set, dividing The collected images are divided into training set, verification set and test set; design a convolutional neural network structure based on information lossless pooling, including the number of convolutional layers used and the number of information lossless pooling layers, and design the convolutional layer The number of filters, design information lossless pooling layer Gaussian smoothing filter parameters, pooling window size and convolution filter structure for feature fusion, design the number of network training loop iterations and network final convergence conditions, and initialize Network parameters; batches of training data are input into the network for calculation and training.

Description

technical field [0001] The invention relates to a method for high-performance picture classification and object recognition in the field of computer vision, in particular to a method for carrying out picture classification and object recognition using a deep learning method. Background technique [0002] In recent years, deep learning technology has been widely used in multiple tasks such as image classification, semantic segmentation and object detection, and automatic driving in the field of computer vision. As an important implementation method in deep learning technology, deep convolutional neural network has achieved remarkable results in many tasks. [0003] Deep convolutional neural networks are often composed of multi-layer convolutional layers and pooling layers. The convolutional layer contains filter parameters for feature extraction, and the pooling layer is used to maintain the translation invariance of the neural network and reduce the impact of data disturbanc...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Patents(China)
IPC IPC(8): G06K9/62G06N3/04
CPCG06N3/045G06F18/24G06F18/214
Inventor 李亚钊庞彦伟
Owner TIANJIN UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products