Monotonic Time-Delay Neural Network for Risk Assessment

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing monotonic neural networks only evaluate input variables at a single time point, failing to fully utilize time-series data and resulting in inaccurate predictions.

Innovation Solution

The development of monotonic time-delay neural networks that incorporate a sequence of input variable values over time, using attribute networks with constrained weights to generate predictive features and a decision network for risk assessment, ensuring explainability through wavelet analysis and monotonicity constraints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If static monotonic neural networks evaluate input variables at a single time point, then the model structure remains simple, but predictive accuracy deteriorates due to insufficient utilization of time-series information

Engineering Contradiction:
Improvepredictive accuracyVSAvoidmodel structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The neural network is segmented into multiple attribute networks, where each attribute network corresponds to a specific predictor variable and processes its time-series data independently. This segmentation allows the model to capture temporal patterns for each variable while maintaining modular architecture that manages complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The model transitions from evaluating inputs at a single time point to processing sequences of time points, adding the time dimension to the input space. This dimensional expansion enables the network to utilize historical data patterns while structured attribute networks organize the increased complexity.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Ease of operation

If monotonic constraints are enforced to ensure explainability, then interpretability improves, but model flexibility and predictive power may deteriorate

Engineering Contradiction:
ImproveexplainabilityVSAvoidpredictive accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

Monotonicity constraints are applied locally to specific attribute networks and their connections rather than uniformly across the entire network. This allows different parts of the model to have different levels of constraint, maintaining explainability where needed while preserving flexibility in other areas for accurate prediction.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The model uses parameterization techniques where monotonicity is enforced through specific parameter constraints (such as non-negative weights in attribute networks) rather than rigid structural constraints. This allows the network to maintain flexibility in learning optimal parameters while ensuring explainable monotonic relationships.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS20220207324A1Machine-learning techniques for time-delay neural networks
Publication Date: 2022.06.30 EQUIFAX INC
  • US20220207324A1 patent drawing
  • US20220207324A1 patent drawing
  • US20220207324A1 patent drawing

AI summary

Various aspects involve time-delay neural networks for risk assessment or other outcome predictions. For instance, a risk assessment computing system accesses time-series data of predictor variables associated with a target entity and determines a risk indicator for the target entity by inputting the time-series data of the predictor variables into a time-delay neural network. The time-delay neural network includes a set of attribute networks each corresponding to a predictor variable and a decision network configured to generate the risk indicator from outputs of the set of attribute networks. The risk assessment computing system further transmits, to a remote computing device, a responsive message including the risk indicator for use in controlling access to one or more interactive computing environments by the target entity.