Training and feature extraction method of feature extraction network based on multiple data sets

A feature extraction and training method technology, applied in the field of image processing, can solve problems such as gradient dispersion, achieve good features, ensure reliability, and alleviate the effect of gradient dispersion

Active Publication Date: 2021-06-01
SUZHOU KEDA TECH
View PDF3 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] In view of this, the embodiment of the present invention provides a method for training and feature extraction of a feature extraction network based on multiple data sets to solve the problem of gradient dispersion in GRL training

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Training and feature extraction method of feature extraction network based on multiple data sets
  • Training and feature extraction method of feature extraction network based on multiple data sets
  • Training and feature extraction method of feature extraction network based on multiple data sets

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0058] In order to make the purpose, technical solutions and advantages of the embodiments of the present invention clearer, the technical solutions in the embodiments of the present invention will be clearly and completely described below in conjunction with the drawings in the embodiments of the present invention. Obviously, the described embodiments It is a part of embodiments of the present invention, but not all embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without making creative efforts belong to the protection scope of the present invention.

[0059] The joint training of multiple data sets will bring the problem of domain shift and bring noise to feature learning. To solve this problem, the gradient inversion method is often used for joint training of multiple data sets. In the joint training, when the JS divergence or KL divergence used to measure the distance between the two distributions ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the technical field of image processing, in particular to a training and feature extraction method of feature extraction network based on multiple data sets, and the training method comprises the steps: obtaining a plurality of sample data sets; sequentially inputting the sample images in any two sample data sets into a feature extraction network to obtain features corresponding to the sample images; performing gradient inversion on the features corresponding to all the sample images to obtain gradient inversion processing results corresponding to the sample images; based on a gradient inversion processing result, determining a bulldozer distance between any two sample data sets; and training the feature extraction network according to the bulldozer distance to obtain a target feature extraction network. On the basis of a gradient inversion processing result, the bulldozer distance between any two sample data sets is calculated, and the bulldozer distance can still reflect the distance between two distributions when the two distributions are not overlapped, so that the gradient dispersion phenomenon occurring in the GRL can be relieved to a great extent.

Description

technical field [0001] The invention relates to the technical field of image processing, in particular to a method for training and feature extraction of a feature extraction network based on multiple data sets. Background technique [0002] The rise of deep learning technology has greatly promoted the development of large-scale image retrieval. Deep learning has a great demand for data. The more abundant the data, the better the effect. However, the labeling of data requires a lot of manpower and time, so multiple Dataset joint training has become a more convenient way to increase the size of the data. [0003] However, due to the differences in the background and application scenarios of different data sets, the joint training of multiple data sets will bring about the problem of domain shift and bring noise to feature learning. Some existing methods to solve the problem of domain migration are called domain migration. For example, domain migration is realized based on gr...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/46G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06V10/464G06N3/045G06F18/214
Inventor 郁亚峰毛晓蛟章勇曹李军
Owner SUZHOU KEDA TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products