Deep Neural Network Linguistic Expressions for Explainable Predictive Models

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current predictive models are unintelligible to human users, making them difficult to understand, modify, and optimize, which requires additional computing resources and hinders efficient production.

Innovation Solution

A deep neural network (DNN) is trained on labeled sentences to produce linguistic expressions that can be modified by human experts, forming explainable predictive models capable of labeling unlabeled sentences, using techniques such as semantic role labeling and neural logic programming.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If current predictive models are used, then prediction accuracy is achieved, but model intelligibility deteriorates making them difficult to understand and modify

Engineering Contradiction:
Improveprediction accuracyVSAvoidmodel intelligibility
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent introduces linguistic expressions as an intermediary layer between the deep neural network and human users. These linguistic expressions serve as a mediator that translates the internal representations of the DNN into human-understandable forms, allowing users to comprehend and modify model behavior without needing to understand the complex neural network architecture directly.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent segments the predictive model into distinct components: the deep neural network for accurate prediction and the linguistic expressions for human interpretation. This segmentation allows each component to fulfill its specific function - the DNN handles complex pattern recognition while the linguistic expressions provide interpretable representations that can be easily understood and modified by humans.

Inventive Principle:
Principle #1Segmentation

2Reliability

If current predictive models are used, then prediction capability is maintained, but additional computing resources are required due to lack of optimization

Engineering Contradiction:
Improveprediction capabilityVSAvoidcomputing resources
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent enables the predictive model to serve itself by generating linguistic expressions that can be used to optimize and refine the model's own behavior. The linguistic expressions provide a mechanism for the system to automatically understand and adjust its own functioning, reducing the need for external computational resources for model optimization and interaction.

Inventive Principle:
Principle #25Self-service

3Measurement precision

If current predictive models are used, then classification accuracy is achieved, but model modification efficiency deteriorates due to difficulty in understanding

Engineering Contradiction:
Improveclassification accuracyVSAvoidmodel modification efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The linguistic expressions act as an intermediary that bridges the gap between high-accuracy classification and ease of modification. By providing human-understandable representations of the classification logic, the linguistic expressions enable users to efficiently identify and modify specific aspects of the model's decision-making process without needing to understand or modify the entire complex neural network architecture.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11900070B2Producing explainable rules via deep learning
Publication Date: 2024.02.13 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11900070B2 patent drawing
  • US11900070B2 patent drawing
  • US11900070B2 patent drawing

AI summary

A computer-implemented method according to one embodiment includes receiving, at a deep neural network (DNN), a plurality of sentences each having an associated label; training the DNN, utilizing the plurality of sentences and associated labels; and producing a linguistic expression (LE) utilizing the trained DNN.