Bias Detection in ML Models via Correlated Attribute Mapping
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing data management approaches fail to effectively remove bias from models due to correlations between protected and non-protected attributes, leading to persistent bias in model outputs.
Innovation Solution
A method that identifies correlated attributes in a dataset where protected attributes have been removed, using logistic and linear regression models to map data points and detect bias by perturbing class designations, thereby identifying instances of indirect individual bias and performing automated actions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Object-affected harmful factors
If protected attributes are removed from the training data, then the model output is intended to be unaffected by protected attributes, but bias persists due to correlations between protected and non-protected attributes
Solution Approach 1:
The system performs preliminary actions by training separate models to predict protected attributes from non-protected attributes before the main modeling process. These pre-trained models capture the correlations between protected and non-protected attributes, allowing the system to later adjust and correct biased predictions without retraining the entire model, thus maintaining accuracy while reducing bias.
Solution Approach 2:
The system introduces intermediary models that act as mediators between the input data and the final model output. These intermediary models predict protected attributes as intermediate steps, allowing the system to identify and correct biased patterns without directly removing the protective attributes from the training data, thereby preserving useful correlations while eliminating harmful bias.
2Object-affected harmful factors
If the system identifies and corrects bias by mapping data points, then bias reduction is achieved, but the complexity of data processing increases
Solution Approach 1:
The system segments the complex bias correction process into separate, manageable steps: first training models to predict protected attributes, then using these predictions to identify and correct biased data points, and finally integrating corrections into the main model. This segmentation reduces overall complexity by breaking down the data processing into distinct phases that can be optimized independently.
Solution Approach 2:
The system creates copies of the training data with corrected bias by mapping data points from the original dataset to adjusted representations. These copied datasets are then used for training the final model, allowing the system to preserve the structure and relationships of the original data while eliminating bias, thus reducing processing complexity compared to working with the original biased data directly.
Data Source
AI summary
Methods, systems, and computer program products for determining data representative of bias within a model are provided herein. A computer-implemented method includes obtaining a first dataset on which a model was trained, wherein the first dataset contains protected attributes, and a second dataset on which the model was trained, wherein the protected attributes have been removed from the second dataset; identifying, for each of the one or more protected attributes in the first dataset, one or more attributes in the second dataset correlated therewith; determining bias among at least a portion of the identified correlated attributes; and outputting, to at least one user, identifying information pertaining to the one or more instances of bias.


