Graph Convolutional Network Node Categorization for Over-Smoothing

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing Graph Convolutional Network (GCN) models face 'over-smoothing' issues due to using the same weighted parameter set for all nodes, failing to account for different relationship patterns in graph data, which limits their effectiveness in processing larger and more complex graph data structures.

Innovation Solution

Classifying nodes into categories based on relationship patterns and determining specific parameter value subsets for each category, allowing for tailored graph convolution operations within the GCN model to capture deeper-level node relationships.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Device complexity

If the same weighted parameter set is used for all nodes in the GCN model, then the model structure remains simple and easy to implement, but it causes over-smoothing issues and fails to capture different relationship patterns in graph data

Engineering Contradiction:
Improvemodel structure complexityVSAvoidfeature extraction accuracy
Core Design Contradiction:
Device complexityVSMeasurement precision

Solution Approach 1:

The patent applies local quality by assigning different parameter value sets to different node categories based on their relationship patterns. Instead of using a uniform parameter set for all nodes, the model now adapts parameters locally to each node's specific relationship pattern, enabling more precise feature extraction while maintaining manageable complexity through systematic categorization.

Inventive Principle:
Principle #3Local quality

2Measurement precision

If different parameter value sets are trained for different node relationship patterns, then the feature extraction accuracy improves, but the model complexity and training requirements increase

Engineering Contradiction:
Improvefeature extraction accuracyVSAvoidmodel complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the graph data by categorizing nodes into different relationship patterns (e.g., star pattern, chain pattern, ring pattern). This segmentation allows the model to train separate parameter value sets for each pattern type, improving feature extraction accuracy while organizing complexity into manageable, distinct categories rather than treating all nodes uniformly.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent changes parameters by training and storing multiple parameter value sets corresponding to different node relationship patterns. The GCN model dynamically selects and applies the appropriate parameter set based on the detected relationship pattern of each node, enabling adaptive parameter adjustment that improves accuracy while keeping the overall framework systematic and controllable.

Inventive Principle:
Principle #35Parameter changes

3Reliability

If multiple parameter value sets are stored for different node categories, then the processing of complex graph data becomes more accurate, but the memory requirements and computational overhead increase

Engineering Contradiction:
Improveprocessing accuracyVSAvoidparameter data volume
Core Design Contradiction:
ReliabilityVSQuantity of substance

Solution Approach 1:

The patent manages parameter data volume by organizing multiple parameter value sets according to distinct node relationship patterns. Each parameter set is specifically tailored to its corresponding pattern type, allowing the system to store and retrieve only the necessary parameters for each node based on its category, thereby improving processing accuracy while optimizing memory utilization through structured parameter management.

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11609936B2Graph data processing method, device, and computer program product
Publication Date: 2023.03.21 EMC IP HLDG CO LLC
  • US11609936B2 patent drawing
  • US11609936B2 patent drawing
  • US11609936B2 patent drawing

AI summary

A method for graph data processing comprises obtaining graph data which includes a plurality of nodes and data corresponding to the plurality of nodes respectively; classifying the plurality of nodes into at least one category of a plurality of categories, wherein the plurality of categories are associated with a plurality of node relationship patterns; determining, from a plurality of candidate parameter value sets of a graph convolutional network (GCN) model, parameter value subsets respectively matching at least one category, wherein the plurality of candidate parameter value sets are determined by training the GCN model respectively for the plurality of node relationship patterns; and using the parameter value subsets respectively matching the at least one category to respectively perform a graph convolution operation in the GCN model on data corresponding to the nodes classified into the at least one category to obtain a processing result for the graph data.