Deep learning network based on group convolution feature topological space and training method thereof

A deep learning network and convolution technology, which is applied to the deep learning network and its training field based on group convolution feature topological space, can solve the problems of lack of global spatial features, slow training speed, and a large number of samples, so as to speed up network training. and convergence speed, the effect of accelerating training convergence speed

Active Publication Date: 2020-06-30
NANJING INST OF TECH
View PDF4 Cites 5 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, CNN also has the following disadvantages: (1) training requires a large number of samples, and the training speed is very slow; (2) the convolution kernel only extracts local features, and the final features used for recognition are the aggregation of local features, which lacks global features to some extent. Spatial features
However, how to mine the value behind the topology of the graph and achieve rapid training and convergence around the topological spatial relationship of multi-channel CNN convolution features has not yet been seen.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning network based on group convolution feature topological space and training method thereof
  • Deep learning network based on group convolution feature topological space and training method thereof

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0047] In order to better understand the technical content of the present invention, specific embodiments are given together with the attached drawings for description as follows.

[0048] Such as figure 1 As shown, the present invention provides a detailed network structure diagram, including: convolution feature extraction layer L1, group convolution topology layer L2 and deep feature recognition layer L3.

[0049] The convolutional feature extraction layer L1 uses a traditional CNN network to extract multi-channel convolutional features, including a first convolutional layer Conv1, a first pooling layer Pool1, a second convolutional layer Conv2, and a second pooling layer Pool2.

[0050] The group convolution topology layer L2 includes group convolution feature layer Group Features, graph network input layer GraphInput, graph neural network hidden layer Hidden Layer, and graph network output layer Graph Output, which is responsible for extracting CNN features under differen...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a deep learning network based on a group convolution feature topological space. The deep learning network comprises a convolution feature extraction layer, a group convolutiontopological layer and a deep feature recognition layer. The convolution feature extraction layer is used for extracting multi-channel CNN convolution features of the sample data and taking an extraction result as input of the group convolution topology layer; the group convolution topology layer is used for combining the extracted multi-channel CNN convolution features, forming group convolution according to group classification by using channel indexes, constructing a graph topological space, regarding each group convolution feature as a graph topological space node, automatically / manually constructing a graph topological space node connection rule, generating a Laplace matrix L, and taking the Laplace matrix L as input of a depth feature recognition layer; and the depth feature recognition layer is used for outputting group convolution feature topological space diagram features corresponding to the sample data according to the input Laplace matrix L. According to the method, graph topology space rules of CNN features under different channels can be given, so that the traditional CNN training and convergence speed is increased.

Description

technical field [0001] The present invention relates to the technical field of artificial intelligence, in particular to a deep learning network based on group convolution feature topological space and a training method thereof. Background technique [0002] Convolution Neural Network (CNN) is one of the representative algorithms of deep learning, which includes convolution calculation and neural network with deep structure. Most of today's image recognition methods use CNN to automatically extract image features, thus realizing the transformation from the experience-driven artificial feature paradigm to the data-driven representation learning paradigm. However, CNN also has the following disadvantages: (1) training requires a large number of samples, and the training speed is very slow; (2) the convolution kernel only extracts local features, and the final features used for recognition are the aggregation of local features, which lacks global features to some extent. spati...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/082G06N3/045
Inventor 钱夔田磊刘义亭
Owner NANJING INST OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products