Bias Detection in ML Models via Correlated Attribute Mapping

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing data management approaches fail to effectively remove bias from models due to correlations between protected and non-protected attributes, leading to persistent bias in model outputs.

Innovation Solution

A method that identifies correlated attributes in a dataset where protected attributes have been removed, using logistic and linear regression models to map data points and detect bias by perturbing class designations, thereby identifying instances of indirect individual bias and performing automated actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Object-affected harmful factors

If protected attributes are removed from the training data, then the model output is intended to be unaffected by protected attributes, but bias persists due to correlations between protected and non-protected attributes

Engineering Contradiction:
Improvebias in model outputVSAvoidmodel accuracy
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The system performs preliminary actions by training separate models to predict protected attributes from non-protected attributes before the main modeling process. These pre-trained models capture the correlations between protected and non-protected attributes, allowing the system to later adjust and correct biased predictions without retraining the entire model, thus maintaining accuracy while reducing bias.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces intermediary models that act as mediators between the input data and the final model output. These intermediary models predict protected attributes as intermediate steps, allowing the system to identify and correct biased patterns without directly removing the protective attributes from the training data, thereby preserving useful correlations while eliminating harmful bias.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Object-affected harmful factors

If the system identifies and corrects bias by mapping data points, then bias reduction is achieved, but the complexity of data processing increases

Engineering Contradiction:
Improveindirect individual biasVSAvoiddata processing complexity
Core Design Contradiction:
Object-affected harmful factorsVSDevice complexity

Solution Approach 1:

The system segments the complex bias correction process into separate, manageable steps: first training models to predict protected attributes, then using these predictions to identify and correct biased data points, and finally integrating corrections into the main model. This segmentation reduces overall complexity by breaking down the data processing into distinct phases that can be optimized independently.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system creates copies of the training data with corrected bias by mapping data points from the original dataset to adjusted representations. These copied datasets are then used for training the final model, allowing the system to preserve the structure and relationships of the original data while eliminating bias, thus reducing processing complexity compared to working with the original biased data directly.

Inventive Principle:
Principle #26Copying

Data Source

PatentUS11636386B2Determining data representative of bias within a model
Publication Date: 2023.04.25 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11636386B2 patent drawing
  • US11636386B2 patent drawing
  • US11636386B2 patent drawing

AI summary

Methods, systems, and computer program products for determining data representative of bias within a model are provided herein. A computer-implemented method includes obtaining a first dataset on which a model was trained, wherein the first dataset contains protected attributes, and a second dataset on which the model was trained, wherein the protected attributes have been removed from the second dataset; identifying, for each of the one or more protected attributes in the first dataset, one or more attributes in the second dataset correlated therewith; determining bias among at least a portion of the identified correlated attributes; and outputting, to at least one user, identifying information pertaining to the one or more instances of bias.