Method for generating unbiased deep learning model based on transfer learning

A technology of deep learning and transfer learning, applied in the field of deep learning, can solve problems such as the model has not been learned, and achieve the effect of ensuring fairness and improving accuracy

Pending Publication Date: 2020-12-22
ZHEJIANG UNIV OF TECH
View PDF0 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, in the existing methods for eliminating the bias of the deep learning model, only one of the factors of the bias of the model is often considered
For example, to eliminate bias directly by preprocessing the sample data set, the problem with this approach is that the trained model has not learned the biased data set, so some biased data may be recognized when identifying the original biased data. Or irrelevant features are very sensitive, and at the same time, because the deep learning model will amplify the influence of this bias, the trained model can only eliminate part of the bias

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method for generating unbiased deep learning model based on transfer learning
  • Method for generating unbiased deep learning model based on transfer learning
  • Method for generating unbiased deep learning model based on transfer learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0045] In order to make the object, technical solution and advantages of the present invention clearer, the present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, and do not limit the protection scope of the present invention.

[0046] In order to solve the problem of inaccurate image recognition due to the bias problem of the deep learning model. This embodiment provides a method for generating an unbiased deep learning model based on migration learning, such as figure 1 As shown, the method for generating an unbiased deep learning model based on transfer learning includes the following steps:

[0047] (1) Definition of bias in deep learning models.

[0048] In the present invention, the erroneous decision caused by the deep learning model relying on false related features during automatic deci...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a method for generating an unbiased deep learning model based on transfer learning. The method comprises the following steps: (1) constructing a task label with a sample imageand an original data set of a biased label; (2) training a biased deep learning model by using the original data set; (3) constructing and training an adversarial attack network, and attacking the original data set by using the trained adversarial network without prejudice; (4) training an initial unbiased deep learning model with the same structure as the biased deep learning model by utilizing the unbiased data set; and (5) preparing a third feature extractor, and forming an unbiased deep learning model by the third feature extractor with determined parameters of the third feature extractorand a second classifier included in the trained initial unbiased deep learning model based on a transfer learning strategy, so as to ensure the fairness of the deep learning model during automatic decision making according to the input image. The accuracy of image recognition is improved.

Description

technical field [0001] The invention belongs to the field of deep learning, and in particular relates to a method for generating an unbiased deep learning model based on migration learning. Background technique [0002] With its powerful ability to learn the inherent laws and highly abstract features of sample data sets, deep learning helps people make decisions automatically and solve many complex pattern recognition problems, so it is applied in medical diagnosis, speech recognition, image recognition, natural Language understanding, advertising, credit, employment, education, and criminal justice, among other areas, have worked well. With the continuous exploration and innovation of researchers, the performance of deep learning has been continuously improved, and its application has become more and more extensive, which has had a profound impact on people's daily life. [0003] Although deep learning can help people obtain more accurate predictions, the latest research s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/045G06F18/214G06F18/241
Inventor 陈晋音陈治清徐国宁徐思雨缪盛欢郑海斌
Owner ZHEJIANG UNIV OF TECH
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products