Physics-Guided Validation Filters for Calibration Domain Compliance

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current model validation techniques for physics system simulators do not adequately ensure that post-validation calibration changes keep predictions within the predetermined model validation domain, leading to potential violations of the validation boundaries and reduced confidence in model accuracy.

Innovation Solution

Implementing a validation assist filter that ensures calibrated model parameters and responses remain within the model validation domain by filtering out parameter and response variations that could cause predictions to fall outside the boundaries, using methods such as singular value decomposition, project pursuit techniques, and neural networks to maintain model integrity.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If post-validation calibration changes are made to improve physics system simulator predictions, then prediction accuracy is improved, but the model validation domain boundaries may be violated

Engineering Contradiction:
Improveprediction accuracyVSAvoidvalidation domain compliance
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent implements a feedback mechanism where the validation domain boundary module continuously monitors calibrated parameters and predictions to ensure they remain within validated boundaries. When calibration attempts to push parameters beyond boundaries, the system provides feedback to adjust the calibration, thus maintaining both accuracy improvements and validation compliance.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The patent performs preliminary validation domain boundary determination before calibration is applied. By establishing the boundaries in advance and checking against them before calibration changes are finalized, the system prevents violations from occurring, allowing calibration to improve accuracy without compromising validation compliance.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If conservative assumptions are used in model validation, then validation reliability is improved, but the validation domain is restricted

Engineering Contradiction:
Improvevalidation confidenceVSAvoidvalidation domain scope
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The patent transforms the static, conservative validation approach into a dynamic system where the validation domain boundary module adaptively determines boundaries based on actual model behavior and uncertainty quantification. This allows the validation domain to expand beyond conservative estimates while maintaining reliability through continuous monitoring and uncertainty analysis.

Inventive Principle:
Principle #15Dynamics

3Measurement precision

If model parameters are adjusted post-validation to reduce discrepancies with measurements, then model accuracy is improved, but confidence in validated predictions degrades

Engineering Contradiction:
Improvemodel accuracyVSAvoidprediction confidence
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The system implements feedback by continuously monitoring whether calibrated parameters remain within the validation domain boundaries. When parameter adjustments are made to improve accuracy, the validation domain boundary module provides feedback to ensure these adjustments do not exceed the boundaries, thereby maintaining prediction confidence.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The validation domain boundaries are determined preliminarily before calibration activities. This preliminary establishment of boundaries provides a safe corridor within which parameter adjustments can be made to improve accuracy without compromising the confidence established during validation.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12367408B2Physics-guided analytical model validation
Publication Date: 2025.07.22 UT BATTELLE LLC
  • US12367408B2 patent drawing
  • US12367408B2 patent drawing
  • US12367408B2 patent drawing

AI summary

This invention relates to a parameter or response assist filter that ensures that the predictions of a post-validation calibrated physics system simulator will remain within boundaries of a predetermined model validation domain. Embodiments utilize one or more filters to ensure calibrated model parameters {acute over (P)} and/or calibrated responses {tilde over (ϕ)} cause physics simulator model predictions to remain within the boundaries of the model validation domain MVD for a target application. The filters can be constructed prior to use or automatically inferred, or otherwise determined, from available measurements and other renditions of the physics system simulator during operation.