Small sample learning method and device, electronic equipment and storage medium

A learning method and small sample technology, applied in the field of machine learning, can solve problems such as limited application, unsatisfactory effect, poor performance of cross-domain tasks, catastrophic forgetting, etc., to achieve the effect of improving efficiency and accuracy, and accelerating learning

Active Publication Date: 2021-04-09
ZHEJIANG UNIVIEW TECH CO LTD
View PDF6 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0002] Because the conventional deep learning algorithm needs a large number of training sample sets to achieve better results, it limits its application in many fields.
[0003] At present, for the feature learning of small-sample training sets, commonly used technical methods include data enhancement, transfer learning, meta-learning, etc., but these methods still have shortcomings such as poor performance in cross-domain tasks and catastrophic forgetting. The effect of deep learning under the training set is not ideal

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Small sample learning method and device, electronic equipment and storage medium
  • Small sample learning method and device, electronic equipment and storage medium
  • Small sample learning method and device, electronic equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0026] figure 1 It is a flow chart of the small-sample learning method in Embodiment 1 of the present invention, and this embodiment is applicable to the case of performing image classification training on a small-sample data set. The method can be implemented by a small-sample learning device, which can be implemented in the form of software and / or hardware, and can be configured in an electronic device. For example, the electronic device can be a background server and other devices with communication and computing capabilities. like figure 1 As shown, the method specifically includes:

[0027] Step 101: Encode the image training sample set according to the image representation model to obtain an image matrix composed of image vector representations of each image training sample.

[0028] Wherein, the image representation model is used to learn and extract features in the image. Exemplarily, the image representation model may be an encoder composed of a convolutional neural...

Embodiment 2

[0084] image 3 It is a flow chart of the small sample learning method in Embodiment 2 of the present invention. Embodiment 2 is further optimized on the basis of Embodiment 1. After obtaining the trained image representation model and label preprocessing model, complete data The concentrated image test sample set is tested, wherein the image test sample set is a subset of the complete data set. Such as image 3 As shown, the test method includes:

[0085] Step 301. Divide the image test sample set into a support set and a query set; wherein, the support set includes the label of each support image test sample.

[0086] Among them, the query set refers to the image sample set that needs to predict the image classification information; the support set refers to the image sample set that provides label information to provide prediction reference for the image samples to be classified in the query.

[0087] In order to ensure the accuracy of the test results, the image test sa...

Embodiment 3

[0099] Figure 4 It is a schematic structural diagram of a small-sample learning device in Embodiment 3 of the present invention. This embodiment is applicable to the case of performing image classification training on a small-sample data set. Such as Figure 4 As shown, the device includes:

[0100] An image encoding module 410, configured to encode the image training sample set according to the image representation model, to obtain an image matrix composed of image vector representations of each image training sample;

[0101] The label encoding module 420 is used to encode the labels of the image training sample set according to the label preprocessing model to obtain a label matrix composed of label vector representations of each image training sample label;

[0102] A model optimization module 430, configured to perform backpropagation according to the loss values ​​of the image matrix and the label matrix, so as to optimize the parameters of the image representation mo...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The embodiment of the invention discloses a small sample learning method and device, electronic equipment and a storage medium. The small sample learning method comprises the following steps: encoding an image training sample set according to an image representation model to obtain an image matrix formed by image vector representation of each image training sample; encoding labels of the image training sample set according to a label preprocessing model to obtain a label matrix formed by label vector representation of each image training sample label; and performing back propagation according to the loss values of the image matrix and the label matrix to perform parameter optimization on the image representation model and the label preprocessing model so as to obtain a trained image representation model and a trained label preprocessing model. According to the invention, knowledge in a natural language task is introduced into a feature recognition task of an image, fusion of different task knowledge is realized, learning of image features under the condition of a small sample data set is accelerated, and efficiency and accuracy of image feature learning under the condition of the small sample data set are improved.

Description

technical field [0001] The embodiments of the present invention relate to the technical field of machine learning, and in particular, to a small-sample learning method, device, electronic equipment, and storage medium. Background technique [0002] Because the conventional deep learning algorithm needs a large number of training sample sets to achieve better results, it limits its application in many fields. [0003] At present, for the feature learning of small-sample training sets, commonly used technical methods include data enhancement, transfer learning, meta-learning, etc., but these methods still have shortcomings such as poor performance in cross-domain tasks and catastrophic forgetting. The effect of deep learning under the training set is not ideal. Contents of the invention [0004] Embodiments of the present invention provide a small-sample learning method, device, electronic device, and storage medium, so as to improve the learning effect in the case of small...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/08
CPCG06N3/084G06F18/24G06F18/214
Inventor 周迪曹广徐爱华王勋何斌汪鹏君王建新章坚武骆建军樊凌雁肖海林鲍虎军
Owner ZHEJIANG UNIVIEW TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products