Supervised Graph Learning Factor Model

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current machine learning techniques, such as neural networks, require a predetermined graph structure for model training, which limits their applicability and flexibility in representing stochastic systems, whereas supervised graph learning aims to create probabilistic graphs without any predetermined structure using training data to make predictions or inferences.

Innovation Solution

The system employs processors to access training data, determine a factor graph model by estimating probability density functions using Monte Carlo integration in the frequency domain, and applies the model to new observed data for inference, allowing the graph structure to be deduced automatically from the data without prior constraints.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If a predetermined graph structure is used for model training, then the model training process is simplified and more stable, but the applicability and flexibility in representing stochastic systems is limited

Engineering Contradiction:
Improveapplicability and flexibility in representing stochastic systemsVSAvoidgraph structure definition complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system automatically learns the graph structure from training data without requiring manual specification. The factor graph model and its structure are determined through supervised learning algorithms that analyze relationships in the data, allowing the model to self-configure its architecture based on the inherent patterns in the stochastic system being modeled.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The graph structure transitions from a static predetermined form to a dynamic learned structure. The factor graph model adapts its topology during training by identifying dependencies and relationships in the data, enabling the structure to evolve and optimize for the specific stochastic system being represented.

Inventive Principle:
Principle #15Dynamics

2Reliability

If a predetermined graph structure is specified, then the model training is more straightforward, but the ability to capture complex stochastic system relationships is reduced

Engineering Contradiction:
Improveinference accuracyVSAvoidautomated structure learning complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The manual mechanical process of specifying graph structures is replaced with automated learning algorithms. Instead of manually defining nodes and edges based on domain knowledge, the system uses supervised learning to automatically discover the graph structure from training data, substituting human effort with computational processes.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

Training data serves as an intermediary between the stochastic system and the factor graph model. The data mediates the structure learning process by providing empirical evidence of relationships, allowing the model to infer the graph structure indirectly through patterns in the training data rather than direct specification.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Adaptability or versatility

If graph structure is learned automatically from data, then the model becomes more adaptable to different stochastic systems, but the training process becomes more computationally intensive

Engineering Contradiction:
Improvegeneralization to new stochastic systemsVSAvoidcomputational resources for training
Core Design Contradiction:
Adaptability or versatilityVSPower

Solution Approach 1:

The structure learning process is segmented into discrete steps: identifying candidate factors, determining dependencies, constructing the factor graph, and refining parameters. This segmentation allows the complex learning process to be broken down into manageable computational tasks that can be executed efficiently and scaled to different problem sizes.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20230080028A1Supervised graph learning
Publication Date: 2023.03.16 MISSION SOLUTIONS GRP INC
  • US20230080028A1 patent drawing
  • US20230080028A1 patent drawing
  • US20230080028A1 patent drawing

AI summary

The present disclosure relates to supervised graph learning. In aspects, a system includes one or more processors and at least one memory storing instructions. The instructions, when executed by the processor(s), cause the system to access training data relating to variables, determine a factor graph model based on the training data where the factor graph model includes component factors, estimate probability density functions for the component factors based on Monte Carlo integration in the frequency domain, and apply the factor graph model with the estimated probability density functions for the component factors to new observed data to make a prediction.