Gradient Explanation Data Conversion Unit

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

There is no existing technology to convert explanation data from Integrated Gradient (IG) to Vanilla Gradient (VG) for machine learning models, despite VG offering simpler information useful for model evaluation and data-free knowledge distillation.

Innovation Solution

An information processing device with an estimation result acquisition unit and an explanation data conversion unit that converts first explanation data (IG) into second explanation data (VG) based on estimation results, utilizing algorithms to handle bias and zero components in the data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If Integrated Gradient (IG) explanation data is used, then explanatory power is improved, but information simplicity deteriorates

Engineering Contradiction:
Improveexplanatory powerVSAvoidinformation simplicity
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent transforms explanation data between different gradient-based methods (IG and VG) by adjusting computational parameters. The conversion unit changes the mathematical parameters of the explanation data from IG format to VG format, allowing users to switch between high explanatory power and high simplicity based on their needs, without losing the underlying attribution information.

Inventive Principle:
Principle #35Parameter changes

2Loss of information

If Vanilla Gradient (VG) explanation data is used, then information simplicity is improved, but explanatory power deteriorates

Engineering Contradiction:
Improveinformation simplicityVSAvoidexplanatory power
Core Design Contradiction:
Loss of informationVSMeasurement precision

Solution Approach 1:

The conversion unit enables bidirectional transformation between IG and VG explanation data by modifying computational parameters. When VG data needs to be converted to IG-like explanatory power, the system adjusts the parameter representation while preserving the gradient attribution information, effectively converting simplicity into explanatory depth.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent introduces a conversion unit as an intermediary component that mediates between IG and VG explanation methods. This intermediary transforms the explanation data from one format to another, allowing the system to leverage the simplicity of VG while achieving the explanatory power of IG through parameter transformation.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If conversion from IG to VG explanation data is implemented, then adaptability is improved, but device complexity increases

Engineering Contradiction:
Improveexplanation format flexibilityVSAvoidconversion processing complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The conversion unit serves as a dedicated intermediary component that handles the transformation between different explanation formats. By isolating the conversion logic in a separate unit, the system achieves high adaptability without significantly increasing overall complexity, as the conversion process is encapsulated and can be independently optimized.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240256969A1Information processing apparatus, conversion method and program
Publication Date: 2024.08.01 NIPPON TELEGRAPH & TELEPHONE CORP
  • US20240256969A1 patent drawing
  • US20240256969A1 patent drawing
  • US20240256969A1 patent drawing

AI summary

Provided is an information processing device including: an estimation result acquisition unit that acquires estimation result data indicating an estimation result of a machine learning model and first explanation data for explaining the estimation result; and an explanation data conversion unit that converts the first explanation data into second explanation data on the basis of the estimation result data.