Construction method for network connection adaptive deep convolutional model

A deep convolution and network connection technology, applied in the field of data processing, can solve problems such as data redundancy, and achieve the effect of reducing the scale of parameters, reducing the problem of overfitting, and reducing data correlation

Inactive Publication Date: 2018-06-15
NANJING UNIV OF INFORMATION SCI & TECH
View PDF0 Cites 11 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0015] The invention provides a method for constructing a network connection self-adaptive deep convolution model, which is used to solve the problem of serious data redundancy in existing deep learning methods, and improves the accuracy and efficiency of deep convolution model construction

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Construction method for network connection adaptive deep convolutional model
  • Construction method for network connection adaptive deep convolutional model
  • Construction method for network connection adaptive deep convolutional model

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0036] The specific implementation of the method for constructing the network connection adaptive depth convolution model provided by the present invention will be described in detail below in conjunction with the accompanying drawings.

[0037] The construction method of the network connection self-adaptive depth convolution model provided in this specific embodiment, with image 3 It is a flowchart of a construction method of a network connection adaptive depth convolution model in a specific embodiment of the present invention. Such as image 3 As shown, the construction method of the network connection adaptive depth convolution model provided by this specific embodiment includes the following steps:

[0038] Step 1: Orthogonalize the weight vector in the convolutional neural network. The specific calculation formulas are shown in the following formulas (5) and (6):

[0039] w i =v i (5)

[0040]

[0041] In the formula, v i , v j Respectively, the i-th weight v...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a construction method for a network connection adaptive deep convolutional model. The method comprises the steps that first, weight vectors in a convolutional neural network areorthogonalized; second, connection between layers in the convolutional neural network is deleted according to a norm; and third, an activation function is constructed. According to the method, data relevancy is lowered through weight vector orthogonalization; the connection between layers in the convolutional neural network is deleted based on the p norm, the problem of overfitting in the construction process of the deep convolutional model is effectively lowered, and network connection adaptation is realized; and the activation function is constructed to generalize data information as much as possible on the premise of not changing a parameter scale, and therefore the accuracy of the deep convolutional model is improved.

Description

technical field [0001] The invention relates to the technical field of data processing, in particular to a method for constructing a network connection self-adaptive deep convolution model. Background technique [0002] With the continuous development of information technology and the popularization of electronic equipment, people rely more and more on the Internet, and at the same time leave a large amount of data on the Internet. With the advancement and development of deep learning research, people began to apply deep learning models to solve real-world problems. However, due to the huge amount of data and complex reality, the deep learning model often has many problems during the training process, such as: too many model parameters during the training process, serious data redundancy, and greatly increased training time. Some of these problems come from some imperfections of the traditional neural network. For example, the fully connected layer in the traditional neural...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04
CPCG06N3/045
Inventor 田青张文强孔勇张玉飞
Owner NANJING UNIV OF INFORMATION SCI & TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products