Neural network training method based on Gaussian process prior guidance

A neural network training, Gaussian process technology, applied in the field of computer vision, can solve the problem of not reflecting the relationship and so on

Active Publication Date: 2020-02-07
ZHEJIANG UNIV
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The data set itself provides labels, but this inherent label only represents the classification re

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Neural network training method based on Gaussian process prior guidance
  • Neural network training method based on Gaussian process prior guidance
  • Neural network training method based on Gaussian process prior guidance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0099] The implementation method of this embodiment is as described above, and the specific steps will not be described in detail. The following only shows the effect of the case data. The present invention is based on the ResNet network and is implemented on three data sets with true value labels, which are respectively:

[0100] Cifar10 dataset

[0101] Cifar100 dataset

[0102] Tiny-ImageNet dataset

[0103] In this embodiment, a set of experiments is carried out on each selected data set, and the ordinary SGD optimization method is compared with the method described in the present invention.

[0104] The precision comparison of the experimental results of this embodiment is shown in Table 1. Data in the figure shows the average performance of the present invention on 5 tests on relevant datasets, and GPGL in the table is the neural network training method (Gaussian Process Guided Learning) based on Gaussian process prior guidance

[0105] Table 1 Accuracy comparison of...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a neural network training method based on Gaussian process prior guidance. The neural network training method is used for improving the training process of a neural network toobtain a better training effect. The neural network training method specifically comprises the following steps: S1, obtaining a data set for neural network training, selecting a representative set formodeling priori knowledge, and defining an algorithm target; S2, performing a training process of first-stage batch iterative learning on the neural network model, and sequentially executing the steps S21 to S24 in each iterative batch; S3, after the current training process is finished, verifying the neural network model by using the verification set to obtain a verification set error rate of the current model; and S4, continuously repeating the steps S2 and S3 to perform a multi-stage training process on the neural network model until the model converges. According to the neural network training method based on Gaussian process prior guidance, the effectiveness of training can be effectively improved in tasks, and the network learning ability and the learning quality are improved, and the neural network training method has a good application value.

Description

technical field [0001] The invention belongs to the field of computer vision, in particular to a neural network training method guided by a Gaussian process prior. Background technique [0002] Image classification is the task of distinguishing different categories of images in a dataset. At present, the mainstream solution for image classification tasks is to train convolutional neural networks to solve the problem, and the training method generally uses the stochastic gradient descent method. In recent years, as the progress of the network structure has slowed down, the improvement of the training strategy has become increasingly important. Aiming at this goal, the present invention considers that in order to train a given model better in supervised learning such as image classification, it is necessary to provide as perfect and effective supervision information as possible. The dataset itself provides labels, but this inherent label only represents the classification re...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/214
Inventor 崔家宝朱文武励雪巍李玺
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products