Adversarial Autoencoder for Graph-to-Sequence Molecular Generation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current Graph-to-Sequence (G2S) models face limitations in effectively converting complex graph data, such as molecular structures, into accurate sequence representations, particularly in preserving structural information and generating molecules with desired properties.

Innovation Solution

The proposed solution involves an improved G2S model architecture that incorporates a variational or adversarial autoencoder configuration, utilizing graph data input to an encoder, generating latent vectors, and then using a decoder to produce sequence data while incorporating property data for conditional generation, along with a discriminator for adversarial training, and employing techniques like Jacobian clamping for smoother latent spaces.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If a standard autoencoder architecture is used for graph-to-sequence conversion, then the model can learn latent representations, but the structural information of molecular graphs is not effectively preserved

Engineering Contradiction:
Improvestructural informationVSAvoidmodel architecture
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The model segments the encoding process into two distinct pathways: a graph encoder that processes molecular graph structure separately from a sequence encoder that processes SMILES strings. This segmentation allows each encoder to specialize in preserving its respective input type's structural information while contributing to a combined latent representation that maintains both graph and sequence characteristics.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces an intermediary adversarial discriminator component that acts as a mediator between the encoders and the latent space. This discriminator enforces consistency between the graph-based and sequence-based latent representations by adversarially training them to produce equivalent encodings for the same molecule, thereby preserving structural information through the intermediary constraint.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If traditional machine learning models are used to estimate compound properties, then the drug discovery process remains time-consuming and costly

Engineering Contradiction:
Improvedrug discovery efficiencyVSAvoidproperty estimation accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The model transforms the drug discovery process by changing the parameter representation from traditional molecular descriptors to learned latent embeddings from dual encoders. This parameter transformation enables the model to capture complex non-linear relationships in molecular structure-property relationships, improving prediction accuracy while maintaining computational efficiency for high-throughput screening.

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The patent replaces traditional mechanical drug discovery methods (wet lab experiments and manual screening) with a deep learning-based in silico prediction system. The dual-encoder autoencoder model substitutes physical experimentation with computational property estimation, dramatically increasing productivity by enabling rapid virtual screening of large molecular libraries before committing to expensive and time-consuming experimental validation.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Adaptability or versatility

If variational autoencoders are used to learn latent representations, then the model can generate molecules, but the generated molecules may not have desired biochemical properties

Engineering Contradiction:
Improvemolecule generation capabilityVSAvoidproperty control accuracy
Core Design Contradiction:
Adaptability or versatilityVSManufacturing precision

Solution Approach 1:

The patent implements feedback through adversarial discriminators that provide gradient signals back to the encoders during training. These discriminators are trained to distinguish between real molecular properties and generated properties, creating a feedback loop that continuously refines the latent space representation. This feedback mechanism ensures that generated molecules progressively improve in matching desired biochemical properties while maintaining structural validity.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The model employs dynamic training where the discriminator and encoders are trained in alternating stages, allowing the system to adaptively balance between generating structurally valid molecules and achieving desired property distributions. The dynamic adversarial training process enables the latent space to evolve and reorganize itself to simultaneously satisfy both structural constraints and property targets.

Inventive Principle:
Principle #15Dynamics

Data Source

PatentUS20230075100A1Adversarial autoencoder architecture for methods of graph to sequence models
Publication Date: 2023.03.09 INSILICO MEDICINE IP LTD
  • US20230075100A1 patent drawing
  • US20230075100A1 patent drawing
  • US20230075100A1 patent drawing

AI summary

A graph-to-sequence (G2S) architecture is configured to use graph data of objects to generate sequence data of new objects. The process can be used with objects types that can be represented as graph data and sequence data. For instance, such data is molecular data, where each molecule can be represented as molecular graph and in SMILES. Examples also include popular tasks in deep learning of image-to-text or/and image-to-speech translations. Images can be naturally represented as graphs, while text and speech can be natively represented as sequences. The G2S architecture can include a graph encoder and sample generator that produce latent data in a latent space, which latent data can be conditioned with properties of the object. The latent data is input into a discriminator to obtain real or fake objects, and input into a decoder for generating the sequence data of the new objects.