Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Deep learning model fairness improvement system and method based on adversarial disturbance

A technology for deep learning and system improvement, applied in neural learning methods, biological neural network models, character and pattern recognition, etc., can solve problems such as limiting real-world applications, and achieve the effect of improving fairness

Pending Publication Date: 2022-04-29
ZHEJIANG UNIV
View PDF5 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

Existing techniques to improve the fairness of deep learning models essentially need to modify the deployed model to prevent the model from learning false associations to eliminate prejudice against specific groups, thus greatly limiting the practical application of these mechanisms for improving model fairness

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning model fairness improvement system and method based on adversarial disturbance
  • Deep learning model fairness improvement system and method based on adversarial disturbance
  • Deep learning model fairness improvement system and method based on adversarial disturbance

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0035] In order to make the object, technical solution and advantages of the present invention more clear, the present invention will be further described in detail through specific embodiments below in conjunction with the accompanying drawings. It should be understood that the specific embodiments described here are only used to explain the present invention, not to limit the present invention.

[0036] figure 1 It is a framework diagram of a deep learning model fairness improvement system based on confrontational disturbance proposed by the present invention, including a deployment model, a disturbance generator, and a discriminator. The deployment model includes a feature extractor and a label predictor, and the disturbance generator is connected to the feature extractor. , the feature extractor is connected to the label predictor and the discriminator respectively. The input of the feature extractor is an image, and the image is represented by the latent space through the...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a deep learning model fairness improvement system and method based on adversarial disturbance, the system comprises a deployment model, a disturbance generator and a discriminator, the deployment model comprises a feature extractor and a label predictor, and the disturbance generator is connected with the feature extractor. A deployment model is prevented from extracting sensitive features of data, and fairness is improved under the condition that the model is not changed. The input data of the deployment model is processed, and the deep learning model does not need to be changed. According to the method, model fairness is improved based on antagonistic disturbance, a corresponding disturbance generator and a discriminator are designed, sensitive attribute information related to fairness is captured by using the discriminator, training optimization of the disturbance generator is guided, sensitive attribute information of antagonistic disturbance hidden data is generated, and information related to a target task is reserved; and the model is prevented from extracting sensitive information of input data in a feature extraction process, so that the prediction fairness is improved.

Description

technical field [0001] The invention relates to the field of trusted artificial intelligence (AI), in particular to a system and method for improving the fairness of a deep learning model based on an adversarial disturbance. Background technique [0002] In recent years, deep neural networks have demonstrated excellent performance in many fields, such as image processing, natural language processing, speech recognition, and so on. Although the popularization of artificial intelligence technology has promoted changes in various fields and brought convenience and improvement to human life, studies have found that some existing artificial intelligence systems have ethical risks. They contain prejudice and discrimination against specific groups, and even disadvantaged groups put in a more disadvantaged position. Therefore, alleviating the bias of deep learning models and improving the fairness of model decision-making are important prerequisites for ensuring the reliable applic...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06V10/764G06V10/40G06V10/82G06K9/62G06N3/08
CPCG06N3/08G06F18/241
Inventor 王志波董小威任奎
Owner ZHEJIANG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products