ML Control Model Verification Beyond the Learning Range

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing machine learning models for controlling controlled objects in complex systems like three-tank-level control systems may output unintended actions when operating outside their learned range, potentially causing adverse effects, especially in safety-critical environments.

Innovation Solution

A model verification apparatus that includes a model storage unit, learning range identification, verification data acquisition, and result output units to identify and display actions outside the learning range of a machine learning model, using an action map with different densities or colors to discriminate intended and unintended actions.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a machine learning model is used to control complex systems, then control capability and adaptability are improved, but the risk of unintended actions outside the learning range increases

Engineering Contradiction:
Improvecontrol capabilityVSAvoidsafety
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The patent performs verification of the machine learning model's actions before actual deployment. The learning range identification unit determines the boundaries of learned behavior in advance, and the verification data acquisition unit collects test data within these boundaries beforehand. This preliminary verification process ensures that the model will not produce unintended actions during actual operation, thus maintaining safety while preserving adaptability.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements a feedback mechanism where the verification result output unit provides information about the model's predicted actions outside the learning range. This feedback loop allows operators to review and validate the model's behavior before deployment, ensuring that even adaptable actions remain within acceptable safety boundaries. The system continuously monitors and adjusts based on verification results.

Inventive Principle:
Principle #23Feedback

2Reliability

If verification data outside the learning range is collected, then safety is improved, but system complexity and verification time increase

Engineering Contradiction:
ImprovesafetyVSAvoidverification system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies local quality by focusing verification efforts specifically on the boundaries of the learning range rather than uniformly across all possible states. The learning range identification unit determines specific boundary regions, and verification data is collected targeted at these critical areas. This localized approach maintains high safety standards while avoiding unnecessary complexity in regions where the model is already well-understood.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs verification not just at the exact boundaries but also in regions slightly beyond them. This partial excessive action ensures comprehensive safety coverage by testing not only the immediate boundaries but also adjacent regions where unexpected behavior might occur. This approach enhances safety without requiring verification of every possible state space.

Inventive Principle:
Principle #16Partial or excessive action

3Reliability

If the learning range is strictly limited, then safety is improved, but the model's adaptability and productivity decrease

Engineering Contradiction:
ImprovesafetyVSAvoidoperational efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The patent implements dynamic boundaries for the learning range rather than fixed static limits. The learning range identification unit continuously determines boundaries based on the actual distribution and quality of training data. This dynamic approach allows the operational range to expand as more high-quality training data becomes available, maintaining safety through continuous verification while improving productivity by utilizing a broader operational envelope when conditions permit.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS12578692B2Model verification apparatus, model verification method, and non-transitory computer readable medium
Publication Date: 2026.03.17 YOKOGAWA ELECTRIC CORP
  • US12578692B2 patent drawing
  • US12578692B2 patent drawing
  • US12578692B2 patent drawing

AI summary

Provided is a model verification apparatus including a model storage unit configured to store a machine learning model that has been subjected to machine learning, by using a learning sample including state data indicating a state of equipment in which a controlled object is provided and action data indicating an action for deciding a manipulated variable to be applied to the controlled object, so as to output an action according to the state of the equipment, a learning range identification unit configured to identify a learning range indicating a range of the learning sample, a verification data acquisition unit configured to acquire verification data indicating a plurality of states of the equipment outside the learning range, and a verification result output unit configured to output a verification result indicating a plurality of actions to be output by the machine learning model in response to an input of the verification data.