Automated AI Model Documentation via Factsheet Templates

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The current documentation of artificial intelligence (AI) systems is a costly, manual, and inconsistent process lacking standard practices and methodologies, making it difficult to represent, store, and manage model facts throughout the AI model's life cycle, from creation to deployment and improvement.

Innovation Solution

A method for automatically generating documentation for AI models by accessing a model facts policy, collecting relevant data, and using a factsheet template to populate an AI model factsheet, providing a structured approach for documentation across various stages of the AI model's life cycle.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual documentation processes are used for AI models, then flexibility in handling diverse model information is maintained, but the process becomes costly, time-consuming, and inconsistent

Engineering Contradiction:
Improvedocumentation efficiencyVSAvoiddocumentation process complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the AI model documentation process into distinct components: model facts extraction, documentation generation, and template-based structuring. This segmentation allows automated processing of specific documention tasks while maintaining overall process flexibility, resolving the contradiction between productivity improvement and process complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary documentation generation system that acts as a mediator between the AI model and the final documentation. This intermediary automatically extracts model facts, applies templates, and generates structured documentation, thereby improving productivity without requiring direct manual intervention in each documentation task.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If standardized documentation practices are implemented for AI models, then consistency and regulatory compliance improve, but adaptability to different model types and stages is reduced

Engineering Contradiction:
Improvedocumentation consistencyVSAvoidmodel documentation adaptability
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent implements dynamic documentation templates that can adapt to different AI model types, development stages, and specific requirements. The templates are configured based on model facts and can be customized without breaking standardization, allowing the system to maintain consistency while adapting to diverse documentation needs across different models and lifecycle stages.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent changes parameters such as template selection, fact extraction criteria, and documentation structure based on the specific AI model and its lifecycle stage. This parameter-based adaptability allows standardized practices to be applied flexibly, maintaining reliability through consistent processes while accommodating versatility through configurable parameters.

Inventive Principle:
Principle #35Parameter changes

3Loss of information

If comprehensive model facts are collected throughout the AI model lifecycle, then transparency and trust are improved, but the amount of data to be managed and processed increases significantly

Engineering Contradiction:
Improvemodel information transparencyVSAvoiddata management complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent extracts only the essential model facts needed for documentation from the comprehensive set of AI model information. This selective extraction approach maintains transparency by capturing critical model details while reducing data management complexity by focusing on relevant information rather than processing all available data.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent performs preliminary organization and structuring of model facts as they are collected throughout the AI model lifecycle. By preparing and categorizing data in advance using defined schemas and templates, the system maintains comprehensive information transparency while reducing the complexity of subsequent data processing and management tasks.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11263188B2Generation and management of an artificial intelligence (AI) model documentation throughout its life cycle
Publication Date: 2022.03.01 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11263188B2 patent drawing
  • US11263188B2 patent drawing
  • US11263188B2 patent drawing

AI summary

A method for automatically generating documentation for an artificial intelligence model includes receiving, by a computing device, an artificial intelligence model. The computing device accesses a model facts policy that indicates data to be collected for artificial intelligence models. The computing device collects artificial intelligence model facts regarding the artificial intelligence model according to the model facts policy. The computing device accesses a factsheet template. The factsheet template provides a schema for an artificial intelligence model factsheet for the artificial intelligence model. The computing device populates the artificial intelligence model factsheet using the factsheet template with the artificial intelligence model facts related to the artificial intelligence model.