Unlock instant, AI-driven research and patent intelligence for your innovation.

Incremental picture classification method based on semi-supervised learning

A semi-supervised learning and image classification technology, applied in neural learning methods, character and pattern recognition, instruments, etc., can solve problems such as forgetting disasters

Pending Publication Date: 2021-03-12
NANJING UNIV
View PDF0 Cites 3 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] Purpose of the invention: In order to solve the problem of forgetting disaster in the process of class incremental learning, while having both space efficiency and time efficiency, this invention proposes an incremental image data classification method based on semi-supervised learning, and improves the accuracy of the model by using auxiliary data. The memory ability of old knowledge, thereby improving the overall classification accuracy of the model

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Incremental picture classification method based on semi-supervised learning
  • Incremental picture classification method based on semi-supervised learning
  • Incremental picture classification method based on semi-supervised learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment

[0063] In order to verify the effect of the proposed new method, this example uses CIFAR-10 / 100 as the experimental data set to simulate the flow data scene, and uses Tiny-Imagenet-200 to extract 10 classes, and each class has 500 pictures as auxiliary data . In addition, ResNet-18 is used as the shared layer module, the initial learning rate is set to 0.0001, the learning rate adjustment strategy is to halve the learning rate every 1 / 4 of the training time, and the gradient descent algorithm chooses the Adam algorithm. For CIFAR-10 / 100, the training epoch is set to 60 / 100, the hyperparameter r is set to 10 / 15, and the number of hidden neurons in each split network is set to 50. For the CIFAR-10 data set, each batch of training samples is 2 classes, which are sent to the model in 5 stages to simulate the incremental classification process; for the CIFAR-100 data set, each batch of training samples is 10 classes , fed in 10 stages. For convenience of description, the new meth...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides an incremental picture classification method based on semi-supervised learning, and the method comprises the steps: 1, carrying out the preprocessing of a new type of pictures and a public data set picture (serving as auxiliary data) appearing in streaming data, and respectively putting the pictures into a set A and a set B; 2, generating a copy for the current model, and fixing copy model parameters; 3, training a teacher model by using the new data; 4, in the current model, for each new category, adding a header network to form a new model of the to-be-updated parameters; 5, performing shuffle operation on the auxiliary data and the new data to integrally form final training data; 6, calculating a target vector for the training data by using the model copy and theteacher model; 7, inputting the training data into the new model, and calculating a loss value according to a model output result and the target vector. 8, adjusting model parameters by using a gradient descent algorithm; and 9, testing the prediction precision of the model.

Description

technical field [0001] The invention relates to an incremental picture classification method based on semi-supervised learning. Background technique [0002] With the development of deep learning, major breakthroughs have been made in many related research fields and practical applications. One of the research directions is image classification. However, the training of the current deep learning model must require all the training data to be sent to the model for training in advance, and incremental learning cannot be performed. However, in practical applications, it is impossible to obtain complete data at one time, especially for streaming data scenarios. This requires the deep learning model to be able to continuously learn and update its own parameters based on the new data provided later. In the learning process of incremental classification, the model needs to be able to learn new knowledge while avoiding the forgetting of old knowledge—this is the catastrophic forget...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/2155G06F18/241
Inventor 申富饶毛乐坤徐百乐
Owner NANJING UNIV