Interactive Digital Dashboards for Machine Learning Process Monitoring

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems lack a centralized platform to visualize the status of multiple machine learning and artificial intelligence processes, making it difficult to detect delays or failures in data pipelining operations, which can lead to temporal delays in delivering predicted outputs and hinder the ability to identify and mitigate potential choke points.

Innovation Solution

An interactive digital dashboard is implemented, providing a graphical representation of the status of each machine learning or artificial intelligence process, allowing real-time monitoring of process-specific metrics and historical data, enabling analysts to identify and address delays or failures, and optimize data pipelining efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If multiple machine learning and artificial intelligence processes are executed across different business units, then the productivity and adaptability of the system improve, but the complexity of monitoring and managing these processes increases

Engineering Contradiction:
Improveprocess execution efficiencyVSAvoidmonitoring system complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent implements a centralized monitoring system that segments and visualizes the status of multiple machine learning and artificial intelligence processes individually through a dashboard interface. Each process can be monitored separately with its own metrics and status indicators, allowing operators to track numerous processes without being overwhelmed by aggregate complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a centralized monitoring system as an intermediary between the distributed machine learning and artificial intelligence processes and the operators. This intermediary collects status data from multiple processes, processes it centrally, and presents it through a unified dashboard interface, simplifying the monitoring task while maintaining visibility of individual process states.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Reliability

If real-time monitoring of process status is implemented, then the reliability and timeliness of detecting delays or failures improve, but the loss of time for data collection and processing increases

Engineering Contradiction:
Improvedetection reliabilityVSAvoiddata processing time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The patent implements continuous background collection of status data from machine learning and artificial intelligence processes, preparing and storing this data before it is needed for analysis. By maintaining an up-to-date repository of process status information, the system can quickly retrieve and display relevant data when delays or failures occur, reducing the time needed for detection and response.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent establishes a feedback loop where the centralized monitoring system continuously collects status data from processes, analyzes it in real-time, and provides immediate visual feedback through the dashboard when anomalies are detected. This continuous feedback mechanism ensures reliable detection of issues while minimizing delay through automated real-time processing rather than periodic batch analysis.

Inventive Principle:
Principle #23Feedback

3Reliability

If a centralized monitoring system is implemented to track multiple processes, then the ability to identify and mitigate choke points improves, but the device complexity and resource requirements increase

Engineering Contradiction:
Improveprocess management reliabilityVSAvoidmonitoring infrastructure complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent implements a centralized monitoring system with a universal dashboard interface that can track and visualize multiple types of machine learning and artificial intelligence processes simultaneously. The system handles diverse process types through a unified architecture, reducing infrastructure complexity by avoiding the need for separate monitoring systems for each process type while maintaining comprehensive oversight capability.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20220188705A1Interactive digital dashboards for trained machine learning or artificial intelligence processes
Publication Date: 2022.06.16 THE TORONTO DOMINION BANK
  • US20220188705A1 patent drawing
  • US20220188705A1 patent drawing
  • US20220188705A1 patent drawing

AI summary

The disclosed embodiments include computer-implemented processes that generate and maintain interactive digital dashboards for machine learning or artificial intelligence processes. For example, an apparatus may obtain process data associated with an execution of a plurality of machine learning or artificial intelligence processes. Based on the process data, the apparatus may determine, for each of the plurality of machine learning or artificial intelligence processes, value of one or more metrics characterizing a status of one or more operations that support the execution of the corresponding machine learning or artificial intelligence process. Further, the apparatus may transmit status data that includes the one or more metric values and corresponding process identifiers to a device, which presents, for each of the machine learning or artificial intelligence processes, a graphical representation of at least one of the determined one or more metric values within a digital interface.