Supercharge Your Innovation With Domain-Expert AI Agents!

Neural network splitting learning algorithm

A neural network and learning algorithm technology, applied in the field of artificial intelligence and machine learning, can solve the problems of deep learning network accuracy and training speed can not be balanced, deep learning network model can not be reused and other problems

Pending Publication Date: 2022-08-05
史永康
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] For the accuracy of the deep learning network and the training speed can not be taken into account and the problem that the deep learning network model cannot be reused, the present invention is based on the basic neural network function For splitting, the neural network function will be supplemented Integrate into base neural network functions

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network splitting learning algorithm
  • Neural network splitting learning algorithm
  • Neural network splitting learning algorithm

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0123] Only the supplementary neural network is updated here The weight parameters of , do not update the underlying neural network weight parameter. The loss function is shown below.

[0124]

[0125] Supplemental Neural Networks Using Gradient Descent Algorithms The weight parameters are updated. The following formula solves the pair Layer Weight Parameters partial derivative of .

[0126]

[0127] Weight parameters for the supplemental neural network to update. which is marked on the upper right represents the number of times, represents the learning rate.

[0128]

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The artificial neural network technology plays a more and more important role in the fields of mode recognition, image processing, automatic control, natural language processing, combinatorial optimization and the like through a specific information processing method and a network structure algorithm. In recent years, with the increase of data set samples, the number of layers of a deep learning network is more and more, and the calculation complexity is higher and higher. The accuracy of deep learning is improved by increasing the number of layers of a deep learning network, and the problem that the training speed of a neural network model is low occurs. The problems that the accuracy and the training speed of a deep learning network cannot be considered at the same time, and a deep learning network model cannot be reused are solved. According to the neural network splitting learning algorithm, a trained neural network function is split and supplemented, and a new neural network function is integrated. Only the supplementary part of the neural network function is trained, so that the training speed is increased, the accuracy of the original neural network function is improved, and the deep learning network model can be reused.

Description

technical field [0001] The invention relates to the field of artificial intelligence and machine learning, in particular to a neural network learning algorithm. Background technique [0002] With its unique information processing method and network structure algorithm, artificial neural network technology plays an increasingly important role in pattern recognition, image processing, automatic control, natural language processing, combinatorial optimization and other fields. In recent years, with the increase of data set samples, the number of deep learning network layers is increasing, and the computational complexity is getting higher and higher. By increasing the number of deep learning network layers to improve the accuracy of deep learning, the problem of slow neural network model training occurs. In order to solve the problem that the accuracy and training speed of the deep learning network cannot be balanced and the deep learning network model cannot be reused. The n...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06N3/04G06N3/08
CPCG06N3/04G06N3/08
Inventor 史永康
Owner 史永康
Features
  • R&D
  • Intellectual Property
  • Life Sciences
  • Materials
  • Tech Scout
Why Patsnap Eureka
  • Unparalleled Data Quality
  • Higher Quality Content
  • 60% Fewer Hallucinations
Social media
Patsnap Eureka Blog
Learn More