Interactive ML Model Development with Visual Interpretability

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Machine learning models are often considered 'black boxes,' making it difficult for subject matter experts to understand how they arrive at results, which reduces confidence in their use and reliability.

Innovation Solution

An interactive framework for machine learning model development that incorporates human intelligence, allowing experts to visualize and refine models through a graphical user interface, enabling domain knowledge input and creating a 'white box' model that is more interpretable and reliable.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If conventional machine learning algorithms are used, then predictive accuracy can be achieved, but the model becomes a 'black box' that is difficult to interpret

Engineering Contradiction:
Improvepredictive accuracyVSAvoidinterpretability
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent introduces an intermediary visualization layer that sits between the machine learning model and the user. This visualization component translates the internal workings of the black box model into interpretable visual representations, allowing users to understand decision boundaries and model behavior without sacrificing predictive accuracy

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent employs color-coded visualizations to represent different decision regions and model predictions. By using color changes and visual encoding, the system makes the invisible internal states of the machine learning model visible and interpretable to users

Inventive Principle:
Principle #32Color changes

2Productivity

If machine learning models are deployed without interactive visualization, then automated prediction is achieved, but user confidence and understanding are reduced

Engineering Contradiction:
Improveautomated prediction capabilityVSAvoiduser confidence
Core Design Contradiction:
ProductivityVSEase of operation

Solution Approach 1:

The patent implements an interactive feedback mechanism where users can explore model predictions, adjust parameters, and immediately see how changes affect decision boundaries. This real-time feedback loop builds user confidence by allowing them to understand and verify model behavior while maintaining automated prediction capabilities

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The visualization system is dynamic and interactive, allowing users to manipulate parameters and observe changes in real-time. This dynamic interaction transforms static black box predictions into an explorable, understandable system that maintains automation while building user confidence

Inventive Principle:
Principle #15Dynamics

Data Source

PatentEP3644241B1Interactive machine learning model development
Publication Date: 2023.08.09 THE BOEING CO
  • EP3644241B1 patent drawingFigure 1
  • EP3644241B1 patent drawingFigure 2
  • EP3644241B1 patent drawingFigure 3

AI summary

A method is provided that includes generating a visual environment for interactive development of a machine learning (ML) model. The method includes accessing observations of data each of which includes values of independent variables and a dependent variable, and performing an interactive exploratory data analysis (EDA) of the values of a set of the independent variables. The method includes performing an interactive feature construction and selection based on the interactive EDA, and in which select independent variables are selected as or transformed into a set of features for use in building a ML model to predict the dependent variable. The method includes building the ML model using a ML algorithm, the set of features, and a training set produced from the set of features and observations of the data. And the method includes outputting the ML model for deployment to predict the dependent variable for additional observations of the data.