Dynamic Graph Embedding for Link Prediction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional graph representation learning methods are inadequate for capturing the complex dynamics of evolving networks over time, as they assume short-term patterns and smooth changes, failing to accurately predict new links in dynamic networks.

Innovation Solution

A dynamic graph embedding model using neural networks with nonlinear layers and recurrent layers is developed to learn structural patterns and temporal transitions, optimizing a loss function with a weighting matrix to prioritize observed edges, enabling the prediction of future network links.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If conventional graph representation learning methods are used, then the model structure is simple, but the ability to capture temporal dynamics and predict future links is insufficient

Engineering Contradiction:
Improvelink prediction accuracyVSAvoidmodel complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent transforms static graph embeddings into dynamic temporal embeddings by introducing time-dependent evolution mechanisms. The node embeddings are updated recursively over time steps, capturing the dynamic nature of network evolution. This allows the model to adapt to changing network structures and predict future links accurately.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The patent employs a hierarchical structure where temporal graph embeddings are nested within an autoencoder framework. The encoder captures temporal patterns by processing sequences of graph snapshots, while the decoder reconstructs future graph states. This nested architecture integrates multiple levels of abstraction to handle both local graph structures and global temporal dynamics.

Inventive Principle:
Principle #7Nested doll (Nesting)

2Measurement precision

If the model captures complex temporal patterns with nonlinear interactions, then link prediction accuracy improves, but computational complexity increases

Engineering Contradiction:
Improvetemporal pattern capture accuracyVSAvoidcomputational complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent changes the parameter representation by using low-dimensional embedding vectors that evolve over time. Instead of modeling complex high-dimensional interactions directly, the method transforms graph structures into compact embedding spaces where temporal dynamics are captured through parameter evolution. This reduces computational complexity while preserving essential temporal patterns.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces traditional mechanical graph algorithms with neural network-based embedding methods. The autoencoder framework substitutes explicit temporal reasoning mechanisms with learned representations that automatically capture nonlinear interactions. This substitution enables the model to handle complex temporal patterns more efficiently through distributed representations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Manufacturing precision

If the model uses a weighting matrix to prioritize observed edges, then reconstruction accuracy of observed edges improves, but the model may overfit to existing links

Engineering Contradiction:
Improveedge reconstruction accuracyVSAvoidgeneralization to unobserved links
Core Design Contradiction:
Manufacturing precisionVSReliability

Solution Approach 1:

The patent applies partial weighting to the loss function by using a weighting matrix that emphasizes observed edges but does not completely ignore unobserved links. This partial action allows the model to focus on reconstructing known connections while maintaining sensitivity to potential future links. The weighting scheme balances the need for accurate reconstruction with the goal of discovering new connections.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11562186B2Capturing network dynamics using dynamic graph representation learning
Publication Date: 2023.01.24 SIEMENS AG
  • US11562186B2 patent drawing
  • US11562186B2 patent drawing
  • US11562186B2 patent drawing

AI summary

Methods and systems for dynamic network link prediction include generating a dynamic graph embedding model for capturing temporal patterns of dynamic graphs, each of the graphs being an evolved representation of the dynamic network over time. The dynamic graph embedding model is configured as a neural network including nonlinear layers that learn structural patterns in the dynamic network. A dynamic graph embedding learning by the embedding model is achieved by optimizing a loss function that includes a weighting matrix for weighting reconstruction of observed edges higher than unobserved links. Graph edges representing network links at a future time step are predicted based on parameters of the neural network tuned by optimizing the loss function.