Neural network model multiplexing method based on transfer learning

A neural network model, transfer learning technology, applied in biological neural network models, neural learning methods, neural architectures, etc., to achieve the effect of good generalization ability and overcoming differences

Pending Publication Date: 2021-11-05
云南电网有限责任公司信息中心
View PDF0 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Even with so much training data, the cost

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network model multiplexing method based on transfer learning
  • Neural network model multiplexing method based on transfer learning
  • Neural network model multiplexing method based on transfer learning

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0019] The features and other related features of the present invention will be further described below in conjunction with the accompanying drawings to facilitate the understanding of technicians in the industry.

[0020] Step 1: When the source domain service is distributed from the P, the target domain service is from the Q distribution, with the MMD to measure the similarities of the two distributions.

[0021] MMD's statistical test method refers to: For two distributed samples, by looking for a continuous function on the sample space, find two different distribution samples on the mean value of the upper function value, by treating two mean differences, two The average difference in distribution corresponds to. Looking for a maximum of this average difference, the average difference is obtained by the value of the MMD, and finally takes MMD as the verification statistic, thus judge whether the two distributions are the same. At the same time, this value is also used to deter...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a neural network model multiplexing method based on transfer learning. The method includes measuring the similarity of two distributions of the target domain and the source domain according to MMD (Maximum Mean Difference); judging whether the distribution of the target domain and the source domain is the same or not according to hypothesis testing; if the hypothesis test judges that the two distributions are the same, performing finetune adjustment on the deep neural network model, and realizing multiplexing of the deep neural network model.

Description

technical field [0001] The invention belongs to the field of neural network algorithm model reuse. The technology is based on migration learning, so that the neural network algorithm model can be reused in similar subjects for reference by users. Background technique [0002] As the amount of business data increases, enterprises often regard multi-faceted topic analysis as an independent project, that is, they need to re-acquire data, re-perform data preprocessing, and rebuild models every time they conduct topic analysis. When conducting multi-subject analysis, this approach often leads to problems such as poor reusability of algorithmic models among subjects. In practical applications, it is usually not necessary to train a neural network from scratch for a new task. Such an operation is very time-consuming. In particular, the training data cannot be as large as ImageNet, and a deep neural network with sufficient generalization ability can be trained. Even with such a l...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06F8/36G06K9/62G06N3/04G06N3/08
CPCG06F8/36G06N3/04G06N3/08G06F18/22
Inventor 马文李辉张梅
Owner 云南电网有限责任公司信息中心
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products