Bayesian Graph Convolutional Neural Networks for Noisy Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Graph Neural Networks (GNNs) face limitations such as assuming input graphs represent ground-truth, sensitivity to error links, overfitting, and sensitivity to training node selection, particularly in noisy data environments where important links may be missed or spurious links added, leading to deviations in node relationships.

Innovation Solution

A machine learning system that generates multiple random graph realizations of an observed graph using a Bayesian framework, learns a predictive function through these realizations, and averages predicted label probabilities to improve resilience and generalization, employing a graph convolutional neural network (GCNN) with Monte Carlo dropout for weight generation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If existing GCNN configurations assume input graph represents ground-truth, then the model training is simplified, but the model becomes sensitive to error links and noisy data

Engineering Contradiction:
Improvemodel training simplicityVSAvoidmodel robustness to noisy data
Core Design Contradiction:
Ease of manufactureVSReliability

Solution Approach 1:

The patent applies preliminary action by generating multiple perturbed graph realizations before training the GCNN model. Instead of directly training on the observed graph, the method first creates multiple alternative graph structures by adding/removing edges according to a probabilistic model, then trains the GCNN on these pre-generated realizations. This preliminary perturbation process prepares the model to handle noisy data by exposing it to various possible graph configurations before actual training begins.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent implements beforehand cushioning by introducing controlled noise and uncertainty into the graph data before training. By generating multiple graph realizations with varying edge configurations, the method creates a cushion of diversity that protects the model from overfitting to any single graph configuration. This cushioning effect allows the model to learn robust patterns that generalize better to noisy, real-world graph data.

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Loss of information

If GCNN aggregates information from all neighbors, then structural information is captured, but overfitting occurs with limited labeled nodes

Engineering Contradiction:
Improvestructural information captureVSAvoidgeneralization capability
Core Design Contradiction:
Loss of informationVSReliability

Solution Approach 1:

The patent applies dynamics by making the graph structure dynamic rather than static. Instead of aggregating from a fixed neighbor set, the method generates multiple dynamic graph realizations where the neighbor relationships vary across realizations. The GCNN is trained on these dynamic variations, allowing it to learn which neighbor relationships are truly informative versus those that are artifacts of a single graph configuration. This dynamic approach prevents overfitting while preserving structural information.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent implements parameter changes by varying the graph structure parameters (edge presence/absence) across multiple realizations. By changing the adjacency matrix parameters according to a probabilistic model, the method creates diverse training samples with different neighbor configurations. This parameter variation forces the model to learn robust features that are invariant to specific graph configurations, thereby preventing overfitting while maintaining structural information capture.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If multiple random graph realizations are generated, then uncertainty measurement and robustness improve, but computational complexity increases

Engineering Contradiction:
Improveuncertainty measurement capabilityVSAvoidcomputational complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent applies partial action by generating a limited number of graph realizations rather than exhaustively sampling all possible graph configurations. Instead of considering every possible edge perturbation, the method generates a manageable set of realizations (e.g., 10-100 samples) that provide sufficient diversity for robust training without overwhelming computational resources. This partial sampling approach balances uncertainty measurement capability with computational feasibility.

Inventive Principle:
Principle #16Partial or excessive action

Solution Approach 2:

The patent implements segmentation by dividing the training process into multiple independent stages, each working on a separate graph realization. Rather than processing one large complex task, the method segments the problem into multiple smaller, parallelizable training runs on individual graph realizations. This segmentation allows the computational workload to be distributed and managed efficiently, reducing overall complexity while maintaining the benefits of multiple realizations.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11531886B2Bayesian graph convolutional neural networks
Publication Date: 2022.12.20 HUAWEI TECH CANADA CO LTD
  • US11531886B2 patent drawing
  • US11531886B2 patent drawing
  • US11531886B2 patent drawing

AI summary

Method and system for predicting labels for nodes in an observed graph, including deriving a plurality of random graph realizations of the observed graph; learning a predictive function using the random graph realizations; predicting label probabilities for nodes of the random graph realizations using the learned predictive function; and averaging the predicted label probabilities to predict labels for the nodes of the observed graph.