Deep learning model fairness improvement system and method based on adversarial disturbance

A technology for deep learning and system improvement, applied in neural learning methods, biological neural network models, character and pattern recognition, etc., can solve problems such as limiting real-world applications, and achieve the effect of improving fairness

Pending Publication Date: 2022-04-29
ZHEJIANG UNIV
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Existing techniques to improve the fairness of deep learning models essentially need to modify the deployed model to prevent the model from learning false a

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning model fairness improvement system and method based on adversarial disturbance
  • Deep learning model fairness improvement system and method based on adversarial disturbance
  • Deep learning model fairness improvement system and method based on adversarial disturbance

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0035] In order to make the purpose, technical scheme and advantages of the invention more clear, the invention is further described in detail through specific embodiments in combination with the accompanying drawings of the description. It should be understood that the specific embodiments described herein are only used to explain the invention and are not used to limit the invention.

[0036] Figure 1 It is the framework diagram of the fairness improvement system of the deep learning model based on antagonistic disturbance proposed by the invention, including the deployment model, disturbance generator and discriminator. The deployment model includes the feature extractor and label predictor. The disturbance generator is connected with the feature extractor, and the feature extractor is respectively connected with the label predictor and discriminator. The input of the feature extractor is an image, and the image is represented by the hidden space through the feature extractor,...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a deep learning model fairness improvement system and method based on adversarial disturbance, the system comprises a deployment model, a disturbance generator and a discriminator, the deployment model comprises a feature extractor and a label predictor, and the disturbance generator is connected with the feature extractor. A deployment model is prevented from extracting sensitive features of data, and fairness is improved under the condition that the model is not changed. The input data of the deployment model is processed, and the deep learning model does not need to be changed. According to the method, model fairness is improved based on antagonistic disturbance, a corresponding disturbance generator and a discriminator are designed, sensitive attribute information related to fairness is captured by using the discriminator, training optimization of the disturbance generator is guided, sensitive attribute information of antagonistic disturbance hidden data is generated, and information related to a target task is reserved; and the model is prevented from extracting sensitive information of input data in a feature extraction process, so that the prediction fairness is improved.

Description

technical field [0001] The invention relates to the field of trusted artificial intelligence (AI), in particular to a system and method for improving the fairness of a deep learning model based on an adversarial disturbance. Background technique [0002] In recent years, deep neural networks have demonstrated excellent performance in many fields, such as image processing, natural language processing, speech recognition, and so on. Although the popularization of artificial intelligence technology has promoted changes in various fields and brought convenience and improvement to human life, studies have found that some existing artificial intelligence systems have ethical risks. They contain prejudice and discrimination against specific groups, and even disadvantaged groups put in a more disadvantaged position. Therefore, alleviating the bias of deep learning models and improving the fairness of model decision-making are important prerequisites for ensuring the reliable applic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06V10/764G06V10/40G06V10/82G06K9/62G06N3/08
CPCG06N3/08G06F18/241
Inventor 王志波董小威任奎
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products