Bayesian Graph Convolution Networks for Sparse Bipartite Graphs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing graph-based recommender systems face data sparsity issues due to the limited information in bipartite user-item interaction graphs, leading to suboptimal user and item embeddings and recommendation performance, especially in environments with rapidly expanding user and content volumes.

Innovation Solution

The method involves generating multiple random graph topologies by replacing node neighborhoods with those of similar nodes based on probabilistic sampling, using a graph convolution neural network (GCNN) to learn non-linear user and item embeddings, and averaging these embeddings across different topologies to improve representation and diversity in recommendations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If traditional collaborative filtering methods are used to build predictive models based on user past behavior, then personalized recommendations can be provided, but the system performance degrades due to data sparsity when user-item interaction information is limited

Engineering Contradiction:
Improverecommendation accuracyVSAvoiddata sparsity
Core Design Contradiction:
ReliabilityVSLoss of information

Solution Approach 1:

The patent combines multiple graph topologies (original bipartite graph plus randomly generated graphs) into a unified training framework. By merging information from multiple graph representations, the system overcomes data sparsity in any single graph, enabling more reliable embedding learning even when user-item interaction data is limited

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The system performs preliminary actions by pre-generating multiple random graph topologies before the actual recommendation task. These pre-generated graphs serve as additional training data that enriches the limited user-item interaction information, allowing the model to learn more robust embeddings in advance

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If graph convolution neural networks are trained on a single observed bipartite graph, then user and item embeddings can be learned, but the embeddings are suboptimal due to limited information in the graph structure

Engineering Contradiction:
Improveembedding qualityVSAvoidgraph information volume
Core Design Contradiction:
Measurement precisionVSQuantity of substance

Solution Approach 1:

The patent extends the training from a single graph dimension to multiple graph dimensions by generating and utilizing multiple random graph topologies. This dimensional expansion provides the GCNN with more diverse structural information, enabling higher precision embedding learning despite limited original graph data

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

3Adaptability or versatility

If deterministic graph structures are used for training, then the model learns from fixed patterns, but recommendation diversity decreases and fails to capture potential user preferences

Engineering Contradiction:
Improvepreference coverageVSAvoidgraph structure fixedness
Core Design Contradiction:
Adaptability or versatilityVSStability of the object's composition

Solution Approach 1:

The patent introduces dynamics by replacing fixed deterministic graph structures with multiple randomly generated graph topologies. This dynamic approach allows the model to adapt to different structural patterns, capturing a broader range of potential user preferences while maintaining learning stability through the ensemble of graphs

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system changes the structural parameters of the graph by generating multiple random topologies with varying edge configurations. This parameter variation enables the model to learn more versatile embedding representations that generalize better to unseen user-item interactions

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11494617B2Recommender system using bayesian graph convolution networks
Publication Date: 2022.11.08 HUAWEI TECH CO LTD
  • US11494617B2 patent drawing
  • US11494617B2 patent drawing
  • US11494617B2 patent drawing

AI summary

System and method for processing an observed bipartite graph that has a plurality of user nodes, a plurality of item nodes, and an observed graph topology that defines edges connecting at least some of the user nodes to some of the item nodes such that at least some nodes have node neighbourhoods comprising edge connections to one or more other nodes. A plurality of random graph topologies are derived that are realizations of the observed graph topology by replacing the node neighbourhoods of at least some nodes with the node neighbourhoods of other nodes. A non-linear function is trained using the plurality of user nodes, plurality of item nodes and plurality of random graph topologies to learn user node embeddings and item node embeddings for the plurality of user nodes and plurality of item nodes, respectively.