Antibody Design Using Transfer Learning and Graph Neural Networks

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for antibody discovery and design face challenges such as overfitting, data scarcity, and the need for extensive wet-lab experiments, particularly in predicting antibody-antigen binding affinity and epitope recognition, which are time-consuming and costly, and fail to adequately incorporate antigen 3D structure for optimized paratope design.

Innovation Solution

A deep learning-based approach using a combination of variational autoencoders, residual neural networks, generative adversarial networks, and graph neural networks for designing and analyzing antibodies, including transfer learning techniques to generate CDR3 sequences, humanized variable regions, and predict 3D antibody paratope structures, while reducing dimensionality and identifying key biophysical properties.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If deep neural network depth is increased to improve antibody sequence modeling capability, then prediction accuracy is improved, but overfitting and vanishing gradient problems occur

Engineering Contradiction:
Improveprediction accuracyVSAvoidmodel stability
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The patent segments the deep neural network into multiple modules including variational autoencoder, residual neural network, and graph neural network components. Each module performs a specific function (sequence generation, feature extraction, structure prediction) which can be independently optimized and trained, preventing overfitting while maintaining overall prediction accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent employs transfer learning where the model is pre-trained on large datasets of known antibody sequences and structures before being fine-tuned on specific target antigens. This preliminary training establishes robust feature representations that generalize well to novel targets, reducing overfitting on smaller datasets.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If large training datasets are used to improve model performance, then prediction accuracy is improved, but data scarcity for novel targets remains a limitation

Engineering Contradiction:
Improveprediction accuracyVSAvoidgeneralization to novel targets
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The model performs preliminary training on large, diverse datasets of antibody sequences and structures from multiple sources (public databases, experimental data). This pre-training establishes generalizable features that can be transferred to novel targets with limited data through fine-tuning, enabling accurate predictions even when training data for the specific target is scarce.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent develops a universal antibody design framework that can handle multiple types of antibody formats (full-length antibodies, nanobodies, fragments) and multiple targets simultaneously. The graph neural network component learns universal features of antigen-antibody interactions that generalize across different antigen types, improving adaptability to novel targets.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If wet-lab experiments are performed to accurately predict antibody-antigen binding affinity, then measurement precision is improved, but time consumption and cost increase significantly

Engineering Contradiction:
Improvebinding affinity prediction accuracyVSAvoiddiscovery time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent creates computational copies of wet-lab experiments through in-silico modeling. The graph neural network predicts binding affinity, epitope recognition, and structural features by processing amino acid sequences and anticipated 3D structures, providing results that correlate with experimental measurements but without the time and cost of actual wet-lab experiments. This enables rapid screening of many candidates before selective experimental validation.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The model performs preliminary assessment of binding affinity and epitope recognition computationally before wet-lab experiments are conducted. This prioritization allows researchers to focus experimental resources on the most promising candidates, reducing the overall number of experiments needed and accelerating the discovery process while maintaining accuracy for the selected candidates.

Inventive Principle:
Principle #10Preliminary action

4Measurement precision

If extensive wet-lab experiments are conducted to explore antibody sequence space, then measurement precision is improved, but productivity decreases due to time and resource constraints

Engineering Contradiction:
Improveepitope recognition accuracyVSAvoiddiscovery throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent uses computational models to create virtual representations of antibody-antigen interactions, enabling high-throughput screening of large antibody sequence spaces in-silico. The graph neural network can evaluate thousands of sequences for epitope recognition and binding properties simultaneously, providing precise predictions that guide subsequent focused wet-lab experiments, thereby dramatically increasing discovery throughput.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The model performs preliminary high-throughput screening and ranking of antibody candidates based on predicted epitope recognition and binding affinity. This computational triage identifies the most promising candidates for subsequent experimental validation, allowing the research pipeline to process many more candidates than would be feasible with exhaustive wet-lab testing, thus improving overall productivity.

Inventive Principle:
Principle #10Preliminary action

5Manufacturing precision

If 3D structure data is incorporated to improve paratope design accuracy, then manufacturing precision is improved, but device complexity and computational requirements increase

Engineering Contradiction:
Improveparatope design accuracyVSAvoidmodel complexity
Core Design Contradiction:
Manufacturing precisionVSDevice complexity

Solution Approach 1:

The patent segments the structural analysis into distinct components handled by specialized modules: the variational autoencoder processes sequence data, the residual neural network extracts features, and the graph neural network specifically handles 3D structural relationships. This modular approach incorporates 3D structure information systematically without overwhelming the overall model complexity, as each module focuses on its specific aspect.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent transitions from analyzing only 1D amino acid sequences to incorporating 3D spatial structures by representing antibodies as graphs where nodes are residues and edges represent spatial relationships. This dimensional expansion enables accurate paratope design by capturing spatial arrangements critical for binding, while the graph neural network efficiently handles the increased complexity through its architecture designed for relational data.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS20240379248A1Machine learning for designing antibodies and nanobodies in-silico
Publication Date: 2024.11.14 MARWELL BIO INC
  • US20240379248A1 patent drawing
  • US20240379248A1 patent drawing
  • US20240379248A1 patent drawing

AI summary

A computer-implemented method for generating a set of candidate variant amino acid sequences of an antibody, a nanobody, or a fragment thereof, having binding ability to a target protein, may comprise: (a) obtaining a set of seed amino acid sequences; and (b) processing the set of seed amino acid sequences using a first trained machine learning algorithm to generate the set of candidate amino acid sequences, wherein the first trained machine learning algorithm is trained with first training data comprising a set of training amino acid sequences for the target protein, wherein the first trained machine learning algorithm is further trained through a transfer learning method using a second trained machine learning algorithm, wherein the second trained machine learning algorithm is trained with second training data comprising a set of training amino acid sequences for a second target protein, wherein the second target protein is different from the target protein.