A method and system for black-box fairness testing of machine learning models based on deep reinforcement learning

Abstract

The invention discloses a machine learning model black-box fairness testing method and system based on deep reinforcement learning. The main process includes: (1) building a machine learning model black-box fairness testing environment; The optimal discrimination instance generation strategy learning and (3) result statistics are three parts. First, the machine learning model black-box fairness test environment is constructed, and then the reinforcement learning agent interacts with the constructed machine learning model black-box fairness test environment. Using deep reinforcement learning algorithm to learn the optimal discrimination instance generation strategy, and finally statistical test results. The invention can solve the problems of no effective heuristic strategy guidance, low test efficiency and high test overhead in the field of machine learning model black box fairness testing.

Description

technical field [0001] The invention relates to a machine learning model black-box fairness testing method and system based on deep reinforcement learning, and relates to the technical fields of software engineering and artificial intelligence. Background technique [0002] Machine learning software is widely used in various decision-making fields in human real life, such as recruitment, insurance, policy prediction, etc. Researchers have found that machine learning software will produce various unfair decision-making behaviors in the actual operation process, resulting in bad social impact. Therefore, from the perspective of software engineering, designing efficient fairness testing algorithms, conducting adequate fairness testing before machine learning software is delivered, and finding as many instances of discrimination in machine learning software as possible have become an urgent problem to be solved. Here, the goal of fairness testing is to find as many instances of...

AI Technical Summary

Problems solved by technology

[0005] In view of the low efficiency and high cost of the existing black-box fairness test, and the white-box fairness test method cannot be used in the black-box scenario, the present invention proposes a black-box fairness test of a machine learning model based on deep reinforcement learning method and system

Images