Structure-Aware Molecular Encoder for Graph Representation Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing molecular graph representation learning methods face challenges such as high computational resource usage, poor generalization ability, and insufficient labeling data, which limits their effectiveness in capturing valuable chemical field information and applying to new graphs.

Innovation Solution

A molecular graph representation learning method based on contrastive learning that uses a heterogeneous graph and relational graph convolutional networks to encode molecular structures, incorporating functional group information and leveraging fingerprint similarities to select positive and negative samples for self-supervised training, thereby capturing richer structural information.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional unsupervised graph representation learning methods are used, then molecular graphs can be transformed into dense representations, but the lack of parameter sharing between encoders consumes too much computing resources

Engineering Contradiction:
Improverepresentation qualityVSAvoidcomputing resources
Core Design Contradiction:
Measurement precisionVSUse of energy by moving object

Solution Approach 1:

The patent merges multiple encoder functions into a single unified encoder that processes different molecular graphs. This single encoder shares parameters across all molecular graphs, eliminating the need for separate encoders for each graph. The encoder takes as input node features, edge features, and graph-level features, and outputs a unified representation that captures both local and global molecular properties, thereby reducing computational resource consumption while maintaining representation quality.

Inventive Principle:
Principle #5Merging (Combining)

2Measurement precision

If traditional unsupervised graph representation learning methods are used, then molecular graphs can be transformed into dense representations, but the model lacks generalization ability and is difficult to apply to new graphs

Engineering Contradiction:
Improverepresentation qualityVSAvoidgeneralization ability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent performs preliminary action by pre-training the encoder on a large dataset of molecular graphs before applying it to new graphs. The pre-training process allows the encoder to learn generalizable features and patterns from diverse molecular structures. Once pre-trained, the encoder can be applied to new, unseen molecular graphs without requiring retraining, thereby improving generalization ability while maintaining representation quality.

Inventive Principle:
Principle #10Preliminary action

3Quantity of substance

If supervised pre-trained models are built on graph representations using atom types as labels, then the model can be trained on available data, but the few types of atoms and frequent appearance of individual atoms prevent capturing valuable chemical field information

Engineering Contradiction:
Improvetraining dataVSAvoidchemical field information
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The patent applies local quality by incorporating specific chemical domain knowledge into the encoder's feature processing. Instead of treating all nodes uniformly, the encoder separately processes node features (atom-level), edge features (bond-level), and graph-level features (molecule-level). This allows the model to capture local chemical patterns such as functional groups, bonding patterns, and molecular topology, thereby preserving valuable chemical field information that would be lost in uniform processing.

Inventive Principle:
Principle #3Local quality

4Quantity of substance

If supervised graph-level tasks are used for pre-training, then the model can learn from labeled data, but most molecules lack labeling which limits model use in practical scenarios

Engineering Contradiction:
Improvelabeled dataVSAvoidpractical applicability
Core Design Contradiction:
Quantity of substanceVSAdaptability or versatility

Solution Approach 1:

The patent implements self-service by designing the encoder to automatically extract and process multiple types of features (node features, edge features, graph-level features) without requiring external labeled data for training. The encoder learns to generate meaningful molecular representations by processing the structural information already present in the molecular graphs themselves. This self-supervised approach eliminates the need for costly experimental labeling while maintaining practical applicability to real-world molecular analysis tasks.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS20230052865A1Molecular graph representation learning method based on contrastive learning
Publication Date: 2023.02.16 ZHEJIANG UNIV
  • US20230052865A1 patent drawing

AI summary

The present invention is a molecular graph representation learning method based on contrastive learning, the method comprising: obtaining a molecular fingerprint representation of each molecule, and calculating a similarity between each two molecular fingerprints; collecting a full amount of chemical functional group information, and matching a corresponding functional group for each atom in the molecule; using a heterogeneous graph to model a molecular graph; using a RGCN in the structure-aware molecular encoder to encode the representation of each atom in the molecule and the representation of the functional group to which the atom belongs, and mapping the molecule to a feature space through an aggregation function to obtain a structure-aware feature representation; according to the fingerprint similarity between molecules, selecting positive and negative samples, and carrying out a comparative learning in the feature space; obtaining the structure-aware molecular encoder by using the contrastive learning method for training on a large-sample molecular dataset, and applying the structure-aware molecular encoder to a prediction task of downstream molecular attributes. The present invention helps to capture more abundant molecular structure information and solve the problem on molecular property prediction.