Optimization of antibody generation models

Abstract

Embodiments of the present disclosure relate to optimization of antibody generation models. The method for model training comprises the following steps: generating a plurality of first antibodies by using a current antibody generation model based on information of a target antigen; respectively determining respective antibody energy of the plurality of first antibodies; based on the antibody energy of the plurality of first antibodies, constructing a plurality of first samples for an antibody generation model, the plurality of first samples including at least one positive sample and at least one negative sample, the energy tag corresponding to the first antibody in the positive sample indicating that the antibody energy thereof satisfies the energy preference associated with the target antigen, and the energy tag corresponding to the second antibody in the negative sample indicating that the antibody energy thereof satisfies the energy preference associated with the target antigen; the energy label corresponding to the first antibody in the negative sample indicates that the antibody energy does not meet the energy preference; and performing fine tuning on the antibody generation model according to an optimization target using the plurality of first samples, the optimization target being based on a difference between a predicted energy tag of an antibody generated by the fine-tuned antibody generation model and an energy tag between the plurality of first samples.

Description

Technical Field

[0001] Example embodiments of the present disclosure relate generally to the field of computers, and more particularly to optimization of antibody production models. Background Art

[0002] Antibodies are one of the important components of the immune system in animals. Specifically, antibodies are a "Y"-shaped protein composed of two chains, light and heavy, that can specifically bind to pathogens in animals. Their high specificity gives antibodies a promising application as a macromolecular drug. The specificity of antibodies comes from the complementarity determining region (CDR) of the antibody. CDR is usually also the part where the antibody binds to the antigen, and they play a key role in the recognition and binding of the antigen. In addition, the rest of the antibody is relatively conservative, so the design of antibodies can be regarded as the design of CDRs with binding ability for specific antigens. Understanding the importance of sequence analysis of the antibody CDR region is crucial to understanding the specific binding mechanism between antibodies and antigens. Summary of the invention

[0003] In the first aspect of the present disclosure, a method for model training is provided. The method includes: based on the information of the target antigen, using the current antibody generation model to generate multiple first antibodies; respectively determining the antibody energy of each of the multiple first antibodies; based on the antibody energy of the multiple first antibodies, constructing multiple first samples for the antibody generation model, the multiple first samples include at least one positive sample and at least one negative sample, the energy label corresponding to the first antibody in the positive sample indicates that its antibody energy satisfies the energy preference associated with the target antigen, and the energy label corresponding to the first antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference; and using the multiple first samples, fine-tuning the antibody generation model according to the optimization target, the optimization target is based on the difference between the predicted energy label of the antibody generated by the fine-tuned antibody generation model and the energy label between the multiple first samples.

[0004] In the second aspect of the present disclosure, a device for model training is provided. The device includes: an antibody generation module, configured to generate multiple first antibodies based on the information of the target antigen using the current antibody generation model; an energy determination module, configured to respectively determine the antibody energy of each of the multiple first antibodies; a sample construction module, configured to construct multiple first samples for the antibody generation model based on the antibody energy of the multiple first antibodies, the multiple first samples include at least one positive sample and at least one negative sample, the energy label corresponding to the first antibody in the positive sample indicates that its antibody energy satisfies the energy preference associated with the target antigen, and the energy label corresponding to the first antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference; and a model fine-tuning module, configured to use the multiple first samples to perform fine-tuning on the antibody generation model according to the optimization target, the optimization target is based on the difference between the predicted energy label of the antibody generated by the fine-tuned antibody generation model and the energy label between the multiple first samples.

[0005] In a third aspect of the present disclosure, an electronic device is provided. The electronic device includes at least one processing unit; and at least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, and when the instructions are executed by the at least one processing unit, the electronic device executes the method of the first aspect of the present disclosure.

[0006] In a fourth aspect of the present disclosure, a computer-readable storage medium is provided, wherein a computer program is stored on the computer-readable storage medium, and the computer program can be executed by a processor to perform the method according to the first aspect of the present disclosure.

[0007] In a fifth aspect of the present disclosure, a computer program product is provided, which is tangibly stored in a computer storage medium and includes computer executable instructions, which, when executed by a device, cause the device to perform the method of the first aspect.

[0008] It should be understood that the content described in this section is not intended to limit the key features or important features of the embodiments of the present disclosure, nor is it intended to limit the scope of the present disclosure. Other features of the present disclosure will become easily understood through the following description. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In the following, in conjunction with the accompanying drawings and with reference to the following detailed description, the above and other features, advantages and aspects of various implementations of the present disclosure will become more apparent. In the accompanying drawings, the same or similar reference numerals represent the same or similar elements, wherein:

[0010] Figure 1 A schematic diagram showing an example environment in which embodiments of the present disclosure can be implemented;

[0011] Figure 2 A schematic diagram of a model training system for an antibody generation model according to some embodiments of the present disclosure is shown;

[0012] Figure 3 A schematic diagram showing an environment in which embodiments of the present disclosure can be implemented;

[0013] Figure 4 A flowchart of a process for model training according to some embodiments of the present disclosure is shown;

[0014] Figure 5 A block diagram showing an apparatus for model training according to some embodiments of the present disclosure; and

[0015] Figure 6 A block diagram of an electronic device is shown in which one or more embodiments of the present disclosure may be implemented. DETAILED DESCRIPTION

[0016] Embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although certain embodiments of the present disclosure are shown in the accompanying drawings, it should be understood that the present disclosure can be implemented in various forms and should not be construed as being limited to the embodiments set forth herein. On the contrary, these embodiments are provided to provide a more thorough and complete understanding of the present disclosure. It should be understood that the drawings and embodiments of the present disclosure are only for exemplary purposes and are not intended to limit the scope of protection of the present disclosure.

[0017] In the description of the embodiments of the present disclosure, the term "including" and similar terms should be understood as open inclusion, that is, "including but not limited to". The term "based on" should be understood as "based at least in part on". The term "one embodiment" or "the embodiment" should be understood as "at least one embodiment". The term "some embodiments" should be understood as "at least some embodiments". Other explicit and implicit definitions may also be included below.

[0018] Herein, unless explicitly stated, executing a step “in response to A” does not mean executing the step immediately after “A” but may include one or more intermediate steps.

[0019] It is understandable that the data involved in this technical solution (including but not limited to the data itself, the acquisition, use, storage or deletion of the data) shall comply with the requirements of relevant laws, regulations and relevant provisions.

[0020] It is understandable that before using the technical solutions disclosed in the various embodiments of the present disclosure, the types, scopes of use, usage scenarios, etc. of the information involved in the present disclosure should be informed to relevant users and their authorization should be obtained in an appropriate manner in accordance with relevant laws and regulations. The relevant users may include any type of right holders, such as individuals, enterprises, and groups.

[0021] For example, in response to receiving an active request from a user, a prompt message is sent to the relevant user to clearly prompt the relevant user that the operation requested to be performed will require obtaining and using the information of the relevant user, so that the relevant user can independently choose whether to provide information to software or hardware such as an electronic device, application, server or storage medium that executes the operation of the technical solution of the present disclosure based on the prompt message.

[0022] As an optional but non-limiting implementation, in response to receiving an active request from a relevant user, a prompt message is sent to the relevant user, for example, in the form of a pop-up window, in which the prompt message may be presented in text form. In addition, the pop-up window may also carry a selection control for the user to select "agree" or "disagree" to provide information to the electronic device.

[0023] It is understandable that the above notification and the process of obtaining user authorization are only illustrative and do not limit the implementation of the present disclosure. Other methods that meet relevant laws and regulations may also be applied to the implementation of the present disclosure. The activation of the digital assistant related functions, the acquired data, the processing and storage of the data, etc. in the embodiment of the present disclosure shall obtain the prior authorization of the user and other rights holders associated with the user, and shall comply with the relevant laws and regulations and the agreement rules between the rights holders.

[0024] As used herein, the term "model" can learn the association between the corresponding input and output from the training data, so that after the training is completed, the corresponding output can be generated for a given input. The generation of the model can be based on machine learning technology. Deep learning is a machine learning algorithm that processes inputs and provides corresponding outputs by using multi-layer processing units. A neural network model is an example of a model based on deep learning. In this article, "model" may also be referred to as "machine learning model", "learning model", "machine learning network" or "learning network", and these terms are used interchangeably in this article.

[0025] Reinforcement learning, also known as reinforcement learning, evaluation learning or enhanced learning, is one of the machine learning techniques used to describe and solve the problem of how an intelligent agent learns strategies to maximize rewards or achieve specific goals during its interaction with the environment. Reinforcement learning focuses on the interaction between the agent and the environment, and the goal of reinforcement learning is generally to pursue maximum rewards. In other words, reinforcement learning is a learning mechanism that learns how to map from state to behavior in order to maximize the reward obtained. Such an intelligent agent needs to constantly experiment in the environment and continuously optimize the state-behavior correspondence through feedback (rewards) given by the environment.

[0026] Reinforcement learning systems generally involve four elements: policy, reward, value, and environment or model. These four elements are introduced below.

[0027] The policy defines the actions that the model takes in a given state, i.e., the mapping from state to action. The state refers to the state perceived by the model. Usually, the policy is the core of the reinforcement learning system because it determines the action in each state. Depending on the configuration requirements, the policy itself can be a specific mapping or a random distribution.

[0028] Rewards define the goal of a reinforcement learning problem. Rewards are scalar values ​​that the environment sends to the reinforcement learning system at each time step. Rewards define how well the model performs. Therefore, the reward signal is the main factor that influences the policy. The task of the model is to maximize the total reward accumulated over a period of time.

[0029] Value, or value function, is a very important concept in reinforcement learning. Unlike the immediate nature of rewards, value function is a measure of long-term benefits. Judge the benefits of the current action from a long-term perspective, rather than just focusing on the immediate rewards. The calculation of the value function requires analysis of the transition between states.

[0030] The environment, also called the model, is a framework that allows us to predict the next state and corresponding reward given the state and action.

[0031] On the basis of reinforcement learning, model training by means of reinforcement learning (RL) and feedback is also proposed. Such a training scheme is also called reinforcement learning from human feedback (RLHF). In the model training system of RLHF, the target model to be trained is also called the action model (actor model), which is used to map the state s in the reinforcement learning environment to the action a. The state s in reinforcement learning corresponds to the model input, and the action a corresponds to the model output. The output of the target model is the action logic, which includes the score determined by the target model for each potential action based on the input, and the action with the highest score is determined as the generation of the final selection of the target model. The reward model is configured to determine the reward score of the output estimated by the target model for the input. The reward model is used to evaluate the action a and state s of the target model, and determine the reward score based on the quality of the model output. In RLHF, it is expected to maximize the reward score.

[0032] Figure 1 A schematic diagram of an example environment 100 in which embodiments of the present disclosure can be implemented is shown. In environment 100, a data processing system 110 can utilize an antibody generation model 120 to perform an antibody generation task. In some implementations, processing system 110 can utilize antibody generation model 120 to generate antibodies 112 based on input information 102. Antibodies 112 are sometimes also referred to as "synthetic antibodies."

[0033] exist Figure 1 In the embodiment, the processing system 110 can be any type of device with computing capabilities, including a terminal device or a server device. The terminal device can be any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, a personal communication system (PCS) device, a personal navigation device, a personal digital assistant (PDA), an audio / video player, a digital camera / camcorder, a positioning device, a television receiver, a radio broadcast receiver, an e-book device, a gaming device or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. The server device can include, for example, a computing system / server, such as a mainframe, an edge computing node, a computing device in a cloud environment, and the like.

[0034] It should be understood that the structure and functionality of environment 100 are described for exemplary purposes only and does not imply any limitation on the scope of the present disclosure.

[0035] There are usually two modeling schemes to design antibodies for specific antigens: (1) adding antigen information to the input of the model so that the model generates specific antibodies based on the antigen; (2) collecting a large number of antibodies with known activity against the target antigen, directly learning these antibodies, and generating antibodies similar to existing antibodies. In the former scheme, the input information 102 of the antibody generation model includes information about the specific antigen, and sometimes may also include conditional constraints on the antibodies to be generated. For the latter scheme, the input information of the antibody generation model can be arbitrary, because the model has been designed for the target antigen, and the antibodies it outputs are considered to be antibodies with known activity against the target antigen.

[0036] Since the first solution explicitly models the dependency between antibodies and antigens (e.g., the binding of antibodies to targets), it has the ability to design antibodies for unseen antigens, but the model training of this solution is more difficult. The use scenario of the second solution is relatively simple and has limited significance. This is because the actual situation is that when faced with a certain antigen, its antibody is often unknown, and it is hoped that the model can generate antibodies that can bind to the antigen.

[0037] In addition to the differences in task definitions, existing solutions can also be divided into the following categories based on the information used to generate antibodies: (1) sequence design; (2) main chain structure design; and (3) sequence-structure co-design. Among these, because of the close relationship between protein functionality and structure, solutions that target the third solution (i.e., sequence-structure co-design) can utilize complete structural information, and the results are usually more reliable than the first two.

[0038] Currently, some antibody CDR sequence-structure co-design schemes based on diffusion probability models and graph neural networks have been proposed. These schemes learn antibody design by maximizing the probability of the model generating real antibodies on the training set. On the one hand, these schemes ignore the interaction between antibodies and antigens. On the other hand, the limited amount of antibody data also limits the model's learning of likelihood, making the antibodies generated by the existing schemes have strong structural conflicts and lack of binding ability with antigens.

[0039] Antibody design schemes are generally limited in two aspects. First, for the learning objectives of sequence and structure, the accuracy of sequence consistency and structural average deviation is not high, and the interaction between antibody and antigen is also ignored. In addition, due to the extremely limited amount of antibody-antigen data, these models are not fully trained. The above limitations have led to the inability of current antibody generation schemes to design satisfactory antibodies, especially showing a high degree of irrationality in energy.

[0040] According to an embodiment of the present disclosure, a model optimization scheme based on energy preference is proposed for antibody generation. According to the scheme, for a pre-trained antibody generation model, an energy preference associated with a specific antigen is introduced as an optimization target. Multiple antibodies are generated using the pre-trained antibody generation model, and energy data of each of the multiple antibodies is calculated. Based on the energy preference associated with the specific antigen, energy labels are annotated for the generated multiple antibodies, thereby constructing positive samples and negative samples. Then, an optimization algorithm based on energy preference is used to fine-tune the antibody generation model based on the constructed samples.

[0041] The antibody generation task was replanned, and antibody generation was divided into model pre-training and targeted model optimization stages. Energy was introduced as the generation target in the second stage of optimization to solve the shortcomings of the learning target. At the same time, the energy can be used to use the characteristics of software calculation combined with the model obtained in the first stage for large-scale sampling, which can effectively avoid the problem of insufficient data in the antibody generation task. Through such an optimization process, the problem of insufficient data in the antibody generation task can be effectively avoided. Using a large amount of data with energy labels and using a direct preference optimization algorithm can make the model learn more fully, while effectively improving the quality of the designed antibodies and making the generated antibodies more energy-friendly.

[0042] Some example embodiments of the present disclosure will be described below with continued reference to the accompanying drawings.

[0043] Figure 2 A schematic diagram of a model training system 200 for an antibody generation model 120 according to some embodiments of the present disclosure is shown.

[0044] In the architecture 200, the antibody generation model 120 can be constructed based on various generative model structures. In some embodiments, the antibody generation model 120 can be a diffusion model, a graph neural network, or other models suitable for processing data modalities similar to antibodies and antigens. Of course, any other generative model can be applicable to constructing the antibody generation model 120. The embodiments of the present disclosure do not specifically limit the model structure. In the following, for the purpose of explanation, the antibody generation model 120 is mainly described based on the diffusion probability model.

[0045] The antibody generation model 120 is configured to generate antibodies that match the antigen based on at least the information of the antigen. As the model input of the antibody generation model 120, the information of the antigen may include the antibody structure. The antibody belongs to a protein, which may be composed of one or more amino acids. The antibody generation model 120 may generate the protein sequence and structure of the antibody, for example, the sequence and structure corresponding to the CDR (particularly CDR-H3) of the antibody may be generated, and CDR-H3 contributes the most to the diversity and specificity of the antibody. In certain embodiments, the model input of the antibody generation model 120 may also include information on the rest of the antibody except the CDR or CDR-H3, including antibody architecture, other CDRs, etc.

[0046] Since antibodies are composed of amino acids, each amino acid can be represented by: i ∈{ACDEFGHIKLMNPQRSTVWY}, C α coordinate and frame orientation O i ∈SO(3), where i=1,...N, N is the number of amino acids in the antibody. If the CDR-H3 to be generated by the antibody generation model 120 has m amino acids, this can be expressed as: The rest of the antigen-antibody pair can be represented as Thus, the antibody generation task of the antibody generation model 120 can be Generated under conditions is represented by the conditional distribution Modeling.

[0047] In some embodiments, the antibody generation model 120 can be based on a diffusion probability model in a generative model, although other types of generative models are also feasible. For better understanding, the diffusion probability model will be briefly introduced below.

[0048] The diffusion probability model is a type of generative model, but its data generation process is based on a pair of Markov processes, namely the forward diffusion process and the backward denoising process. The forward diffusion process is to gradually interfere with the input data, and obtain a static noise distribution through T step-by-step noise addition steps. Through model training, the learned backward denoising process performs the opposite process, gradually denoising the samples towards the data distribution, and obtaining the desired data. It can be seen that the backward denoising process can correspond to the desired antibody generation process, and finally obtain the antibody.

[0049] For antibody generation, the forward diffusion process of the diffusion probability model can be expressed as follows: in is the noise-free j-th amino acid at step 0, and is the noise-added amino acid in step t. is the noise imposed during the diffusion process, and defines and K is the number of amino acid types. They are category distribution, Gaussian distribution on SO(3), and isotropic Gaussian distribution on SO(3). ScaleRot modifies the rotation matrix by scaling the rotation angles around a fixed rotation axis.

[0050] The backward denoising process (or backward generation process) of the diffusion probability model is to recover the antibody by iterative denoising. The denoising process from step t to step t-1 is defined as: in is the noise sequence and structure of CDR-H3 of the antibody to be generated in step t, are the parameters of the SE(3) equivariant neural network, and f(·)[j] represents the output corresponding to the jth amino acid. The training objective of the reverse generation process is to minimize the Kullback–Leibler (KL) divergence between the variable distribution p and the posterior distribution q, which is expressed as follows:

[0051] After some algebraic transformations, the above training objective can be simplified, and the reconstruction loss at the t-th step can be obtained as follows: in And||·|| F is the matrix Frobenius norm.

[0052] In the above formula (3), the first and third equations can be empirical perturbation denoising. In this way, the total loss function of the antibody generation model 120 can be expressed as By optimizing this loss function, one can start from the noise of the prior distribution and eventually generate antibodies by applying the reverse denoising process.

[0053] In some embodiments, model optimization can also be performed based on RLHF. For the pre-trained antibody generation model 120, the optimization goal is to maximize the reward score of the reward model, as follows: where p θ (resp. ref) is the distribution of the fixed pre-trained model introduced after the model is fine-tuned, and β is a hyperparameter used to control the KL divergence regularity. The optimal solution to the above optimization objective is:

[0054] In the optimization scheme for the diffusion model based on RLHF, model optimization can be achieved by referring to direct preference optimization (DPO), and the optimization objective can be expressed as: where σ(·) is the sigmoid function, and is a pair of “winning” and “losing” data samples (i.e. ), which is determined by the reward score r(·) of the reward model, namely “Winning” Data Sample Corresponding to the positive samples in the optimization of the antibody generation model 120, the “failed” data samples Corresponds to negative samples in the optimization of the antibody generation model 120 .

[0055] It should be understood that the above provides a modeling scheme for antibody generation based on a diffusion probability model and an example optimization scheme based on RLHF. In fact, there may be other modeling schemes and optimization schemes based on a diffusion probability model. In a non-diffusion probability model, such as a model based on a graph neural network, the modeling scheme for antibody generation may also be different.

[0056] In an embodiment of the present disclosure, the training process of the antibody generation model 120 is divided into two stages. The first stage is a pre-training stage, and the second stage is a model optimization stage based on energy preference.

[0057] In the pre-training stage, the antibody generation model 120 is pre-trained based on a pre-training data set, and the pre-training data set includes multiple pairs of mutually matching sample antibodies and sample antigens. In the pre-training stage, the samples in the pre-training data set used can include known antigens, and antibodies with binding ability to antigens. In other words, mutually matching antibodies and antigens refer to that the CDR part of the antibody can be combined with the corresponding antibody. In certain embodiments, the pre-training data set may include a SAbDab antigen-antibody data set. Through pre-training, the antibody generation model 120 can have antibody generation ability.

[0058] In the model optimization stage, the pre-trained antibody generation model 120 can be further optimized. In the embodiment of the present disclosure, the antibody energy is used as the antibody generation target and introduced into the optimization of the second stage to solve the shortcomings of the model learning target. At the same time, the energy can be used to combine the characteristics of software calculation with the model obtained in the first stage for large-scale sampling, avoiding the problem of insufficient antibody data. This method can effectively improve the quality of the designed antibodies, and the performance in energy is more in line with the needs.

[0059] like Figure 2 As shown, based at least on the information of the target antigen, a plurality of antibodies (e.g., antibody 202 and antibody 204) are generated using the current antibody generation model 120. In some embodiments, the antibody generation model 120 may be an optimization performed for a specific target antigen. In this way, the information of the target antigen is used to generate antibodies for constructing samples in each round of fine tuning. In some embodiments, the antibody generation model 120 may be optimized for a plurality of antigens, so the information of the antigens used in the fine tuning of different rounds will be different. In addition to the information of the target antigen, as mentioned above, when generating antibodies, the model input may also include other constraint information for the generated antibodies, such as antibody architectures, other CDRs, etc. The model output of the antibody generation model 120 may include amino acid types, coordinates, frame orientations, etc. In this way, based on the model output, the sequence and / or structure of each antibody may be determined.

[0060] In the optimization phase, energy preference optimization is performed using antigen-antibody energy data obtained by a large amount of sampling from the pre-trained antibody generation model 120. Then, in the energy calculation phase 230, the antibody energy of each of the plurality of antibodies is determined, and based on the antibody energy of the plurality of antibodies, a plurality of samples for the antibody generation model 120 are constructed.

[0061] In some embodiments, the antibody energy of each antibody can be calculated by a predetermined energy function, or an energy calculation algorithm, etc. In some embodiments, the energy of the CDR level in the antibody can be calculated. Antibody energy can be calculated using various known or future antibody energy calculation methods. Then, energy labeling 210 is performed on each antibody (e.g., antibodies 202 and 204) based on the antibody energy. Specifically, the multiple samples include at least one positive sample and at least one negative sample, and the energy label corresponding to the antibody in the positive sample indicates that its antibody energy meets the energy preference associated with the target antigen, and the energy label corresponding to the antibody in the negative sample indicates that its antibody energy does not meet the energy preference.

[0062] The energy preference associated with the target antigen refers to the energy preference for the antibody energy to meet the expectation after the antibody binds to the target antigen. In antibody design, it is expected to generate antibodies with lower total energy. In this way, the energy label of the antibody with lower total energy corresponds to the positive sample; the energy label of the antibody with higher total energy corresponds to the negative sample.

[0063] In some embodiments, in an RLHF-based optimization scheme, the reward model r(·) can be defined as where ε(·) is the energy function, is a temperature parameter (which is a pre-settable hyperparameter). In some embodiments, for the diffusion model, the total energy of the antibody can be calculated as: That is, the sum of the energy of the amino acids in the antibody.

[0064] The antibody production model 120 is fine-tuned using the plurality of samples according to an optimization target based on the difference between the predicted energy signatures of the antibodies generated by the fine-tuned antibody production model 120 and the energy signatures between the plurality of samples.

[0065] In the field of model training, although there are similar two-stage training modes of pre-training and optimization, most of them require the use of high-quality training data in the second stage to optimize the model through supervised fine-tuning schemes. This approach can also achieve the purpose of further optimizing the model, but it cannot make use of a large amount of low-quality training data. According to an embodiment of the present disclosure, an energy preference-based optimization method is used in the second stage. This method can use a model that has not yet completed training to construct sample pairs, so that high-quality and low-quality training data can be utilized at the same time, which can achieve better performance than the traditional supervised fine-tuning scheme.

[0066] In some embodiments, during the optimization (fine-tuning) stage, the optimization objective of the antibody generation model 120 is configured so that the difference between the predicted energy labels of the antibodies generated using the fine-tuned antibody generation model 120 and the energy labels corresponding to the positive samples is reduced, and the difference between the predicted energy labels and the energy labels corresponding to the negative samples is increased.

[0067] In some embodiments, if the antibody generation model 120 is based on a diffusion model and the optimization is performed using a reinforcement learning scheme of RLHF, the optimization objective of the above formula (7) may be used to perform model fine-tuning.

[0068] In some implementations, under the diffusion model, the optimization scheme of DPO can be transformed into optimizing an upper bound through Jensen inequality, that is, performing direct preference optimization at discrete time steps, and its gradient is equivalent to optimizing the likelihood of positive samples and reducing the likelihood of negative samples. Positive samples are reasonable antibody samples with lower energy (e.g., antibody samples with lower CDR energy), and negative samples are antibody samples with higher energy (e.g., antibody samples with higher CDR energy). In this way, after the optimization is completed, the model has the ability to generate reasonable antibody CDRs with lower energy.

[0069] In some implementations, due to It is difficult to solve, so hidden variables can be introduced And use evidence lower bound optimization (ELBO). In particular, L DPO Can be modified to: in and

[0070] In some implementations, under the diffusion model, the optimization scheme of DPO can be optimized by taking advantage of Jensen's inequality and the convexity of the -logσ function to optimize L DPO-Diffusion The upper bound of , that is, performing direct preference optimization at discrete time steps, its gradient is equivalent to optimizing the likelihood of positive samples and reducing the likelihood of negative samples. This can be expressed as follows: in and and From the data and The reverse generation process of as well as

[0071] In some embodiments, optimization based on energy preference can act directly at the level of the entire sample, that is, the optimization of the model is performed by calculating the overall energy of the antibody. Sometimes such an approach may bury amino acids with excellent energy performance in antibodies that are slightly worse overall. In view of this, in some embodiments, a more fine-grained optimization based on energy preference is proposed, that is, energy preference optimization at the amino acid level. This can greatly improve the learning efficiency of the second stage. Energy preference usually defines rewards at the level of the entire antibody sample, while the energy of the antibody CDR region is essentially the sum of the energy at the amino acid level.

[0072] When calculating energy, the antibody energy of each of the multiple antibodies includes the energy at the amino acid residue level of the antibody. Accordingly, the energy preference can be measured at the amino acid level, and the energy labeling at the amino acid residue level can be performed, such as Figure 2 Energy labels 210-1, 210-2, 210-3, ... 210-N (collectively referred to as energy label labels 210) at each amino acid level are shown. In this way, for each of the multiple amino acids of the antibody, it can be determined based on the energy of the amino acid that the amino acid is a positive sample that satisfies the energy preference at the amino acid level, or a negative sample that does not satisfy the energy preference at the amino acid residue level. The optimization target for the antibody generation model 120 includes an optimization target at the amino acid residue level, which is configured to make a difference between the predicted energy label at the amino acid residue level of the antibody generated by the fine-tuned antibody generation model 120 and the energy label at the amino acid residue level of multiple samples.

[0073] In order to perform energy preference optimization at the amino acid level, in some embodiments, Jensen's inequality is used to scale the energy preference optimization loss under the original antibody generation model to an upper bound, which is the energy preference optimization of the diffusion model at both the discrete time step and the amino acid level. Specifically, by using Jensen's inequality and the convexity of the -logσ function, the optimization target at the amino acid level (which is The upper bound of ):

[0074] and L residue-DPO-Diffusion The set of tunable parameters θ for the antibody production model 120 can be calculated as follows: as well as in It can be regarded as the current policy p θ The estimated reward score of It is simply expressed as follows:

[0075] It can be seen that the gradient is reweighted using the estimated reward score of the entire antibody The gradient The reweighting is performed using the estimated reward scores of the amino acids themselves. It can increase the likelihood of all amino acids in positive samples (winning samples) as a whole, and reduce the likelihood of all amino acids in negative samples (losing samples). The residue-level signals can be fully utilized from the estimated reward scores to optimize the antibody efficiently. Thanks to the energy information at the amino acid granularity, the gradient of the model is more reasonable and the optimization converges faster for the new optimization upper bound loss.

[0076] According to experience, directly optimizing the total energy of antibodies will lead to some unwanted "shortcuts". Specifically, in some cases, repulsive force dominates the energy of antibodies, so the antibody generation model will be optimized to push the antibody to the farthest place from the antigen so that the repulsive force can be reduced during the optimization process, and may eventually fall into a local minimum. This effectively reduces the repulsive force, but it may also completely eliminate the attraction between the antibody and the antigen, which will seriously damage the function of the antibody. In some embodiments, when the antibody energy is used as the optimization target, the antibody energy can be decomposed into two aspects: self-structural rationality and antigen binding functionality. Specifically, the antibody energy corresponding to each of the multiple antibodies includes the antibody energy corresponding to multiple energy types. The first energy type includes the total energy of the antibody, which can measure the rationality of the antibody's own structure. The second energy type can include the attraction between the antibody and the target antigen, and the third energy type can include the repulsive force between the antibody and the antigen. Attraction and repulsion can be used to measure the ability of antibodies to bind to antigens. It is expected that the attraction (or attraction energy) between the antibody and the target antigen is stronger and the repulsive force (repulsive energy) is weaker.

[0077] In some embodiments, for an antibody, in the energy function used (e.g., Rosetta energy function), the energy on each amino acid can be roughly divided into attractive force and repulsive force. In order to avoid the model from falling into a local optimum by focusing on optimizing the numerically dominant repulsive force in a shortcut manner, the energy of the antibody is divided into the total energy of the antibody, attractive force and repulsive force. Figure 2 As shown, at each amino acid, the total energy 212 (denoted as CDR E Total ), with antigen attraction 214 (denoted as CDR-Ag E Attraction ), and the repulsive force with the antigen 216 (denoted as CDR-Ag E Repulsion ).

[0078] Although three example energy types are given here, in fact, antibody energy can be decomposed into many other types of energy. In the case of non-generality, the energy calculation formula can be defined as where V is the number of energy types, and ω v is the weight of the v-th energy type.

[0079] For multiple energy types of antibodies, corresponding energy labels (indicating whether the antibody is a positive sample or a negative sample under the energy type) can be marked based on the energies corresponding to the different energy types. In this way, the multiple samples constructed include positive samples and negative samples corresponding to the multiple energy types, respectively. The energy labels corresponding to the antibodies in the positive samples corresponding to each energy type indicate that the antibody energy satisfies the energy preference associated with the target antigen under the energy type, and the energy labels corresponding to the antibodies in the negative samples indicate that the antibody energy does not satisfy the energy preference under the energy type.

[0080] In the case where the antibody energy is decomposed into multiple energy types, the optimization target includes multiple sub-optimization targets corresponding to the multiple energy types, and the sub-optimization target corresponding to each energy type is configured to reduce the difference between the predicted energy label corresponding to the predicted antibody energy of the antibody generated by the fine-tuned antibody generation model 120 and the energy label corresponding to the positive sample corresponding to the energy type, and increase the difference between the predicted energy label and the energy label corresponding to the negative sample corresponding to the energy type. By optimizing the three energy types separately, the model can weigh the rationality from a comprehensive perspective, and the generated CDR can have a reasonable protein interaction with the antigen.

[0081] For each energy type ε v (·), the energy preference gradient corresponding to the energy type can be calculated in a similar way to the above formula (12) For example, for a total energy of 212 (expressed as CDR E Total ), with antigen attraction 214 (denoted as CDR-Ag E Attraction ), and the repulsive force with the antigen 216, can determine the gradient at the amino acid residue level and Then, the parameter set of the antibody generation model 120 can be adjusted based on the gradient of each amino acid residue.

[0082] Some types of energy and properties in antibody-antigen binding are usually mutually exclusive, and the optimization of one property may lead to the degradation of another property. The difficulty in antibody design is to generate CDRs that interact with antigens in a reasonable form, that is, to balance the attractive force and the repulsive force. For example, it is usually hoped that the attraction between the antibody and the target antigen is stronger and the repulsive force is weaker, so that the total energy is reduced after the antibody and antigen are combined, and the designed antibody is more effective against the antigen.

[0083] How to make the optimized antibodies improve in multiple properties at the same time, or optimize another property while ensuring that a certain property remains unchanged, is a problem to be noted in the model optimization process. In some embodiments of the present disclosure, in order to avoid the conflict caused by optimizing attraction and repulsion at the same time, by introducing the gradient conflict solution into the training of the model, by eliminating the conflict between the gradients corresponding to each property, the above-mentioned mutually exclusive problem is solved to a certain extent. In some embodiments, the energy preferences associated with the target antigen under two or more energy types in the calculated multiple energy types conflict with each other. When performing fine-tuning for the antibody generation model 120, the gradient conflict problem is solved by gradient trimming 220. In gradient trimming 220, if the energy preferences corresponding to the first energy type and the second energy type conflict with each other (for example, the conflict between attraction and repulsion), for the first sub-optimization target corresponding to the first energy type and the second sub-optimization target corresponding to the second energy type, the first sub-optimization target and the first sub-optimization target are respectively calculated with respect to the first gradient and the second gradient in the fine-tunable parameter set of the antibody generation model 120. By gradient projection, the first gradient is projected to the normal plane corresponding to the second gradient, and the second gradient is projected to the normal plane corresponding to the first gradient. Then, fine-tuning of the antibody generation model 120 may be performed based on at least the first gradient and the second gradient after being projected on the normal plane.

[0084] In some embodiments, for each energy type ε v (·), calculate the gradient After that, the gradient can be projected (in random order) into the normal plane of other gradients (if these gradients conflict). This process can be expressed as follows: Where υ∈{1, ..., V}, and u=Shuffle(1, ..., V), V is the number of energy types, and Shuffle means random selection.

[0085] The above describes a round of fine-tuning of the antibody generation model 120 starting from the pre-trained antibody generation model 120. The fine-tuning of the antibody generation model 120 may include multiple rounds of iterations. In the first round of iterations, the pre-trained antibody generation model 120 is used to generate antibodies, and the antibody generation model 120 is fine-tuned by constructing samples through the process described above. In the next round of iterations, the fine-tuned antibody generation model 120 is continued to be used to continue to generate new antibodies, and the antibody generation model 120 is further fine-tuned by constructing samples through the process described above. If the antibody generation model 120 is to be optimized for a specific target antigen, then in each round of iteration, the information of the target antigen is used to generate new antibodies, and the energy label of the antibody is also based on the energy preference corresponding to the target antigen. Through the fine-tuning process based on energy optimization, the antibody generation model 120 can continue to be optimized on more training data with energy labels, and obtain more comprehensive learning. Through multiple rounds of iterative fine-tuning, the antibody generation model 120 can achieve the final optimization goal, and antibodies that can be more energy-friendly for actual application requirements.

[0086] After the optimization is completed, the antibody generation model 120 can be used to generate one or more antibodies against the target antigen based on the information of the target antigen (and possibly other input information). In the antibody generation stage, the framework region of the antibody and the information of the target antigen (e.g., the amino acid type and coordinates of the target antigen) can be input to the antibody generation model 120 to generate an antibody that matches the target antigen, such as outputting the CDR sequence and structure corresponding to the antibody.

[0087] Figure 3 A schematic diagram of an environment 300 in which embodiments of the present disclosure can be implemented is shown. Figure 3 In the environment 300 of FIG. 1 , the model is generally shown to involve different stages, including a training stage 302 and an application stage 306. After the training stage is completed, there may also be a testing stage, which is not shown in the figure.

[0088] In the training phase 302, the model training system 310 is configured to perform training of the model 305 using the training data set 332. The model 305 may be, for example, Figure 1 and Figure 2 The antibody generation model 120 in the example. At the beginning of training, the model may have initial parameter values. The training process is to update the parameter values ​​of the model 305 to the expected values ​​based on the training data. The model training system 310 may be configured to implement Figure 2 Model training system 200.

[0089] In the application phase 306, the obtained model 305 has trained parameter values ​​and can be provided to the model application system 330 for use. In the application phase 306, the model 305 can be used to process the corresponding target input 332 in the actual scene and provide the corresponding target output 334. The model application system 330 can be configured to implement Figure 1 The data processing system 110 is configured to apply the antibody production model 120 trained by the model training system 200.

[0090] exist Figure 3 In the embodiment, the model training system 310 and the model application system 330 may include any computing system with computing capabilities, such as various computing devices / systems, terminal devices, servers, etc. The terminal device may involve any type of mobile terminal, fixed terminal or portable terminal, including a mobile phone, a desktop computer, a laptop computer, a notebook computer, a netbook computer, a tablet computer, a media computer, a multimedia tablet, or any combination of the foregoing, including accessories and peripherals of these devices or any combination thereof. Servers include but are not limited to mainframes, edge computing nodes, computing devices in cloud environments, and the like.

[0091] It should be understood that Figure 3 The components and arrangements in the environment 300 shown are merely examples, and a computing system suitable for implementing the exemplary implementations described in the present disclosure may include one or more different components, other components, and / or different arrangements. For example, although shown as being separate, the model training system 310 and the model application system 330 may be integrated into the same system or device. The implementations of the present disclosure are not limited in this respect.

[0092] Figure 4 FIG. 4 is a flowchart of a process 400 for model training according to some embodiments of the present disclosure. The process 400 may be implemented in Figure 2 Model training system 200 or Figure 3 For ease of discussion, reference will be made to the model training system 310. Figure 2 4. The process 400 is described below.

[0093] In block 410 , the model training system 200 generates a plurality of first antibodies based on information of the target antigen using the current antibody generation model.

[0094] At block 420 , the model training system 200 determines antibody energies for each of the plurality of first antibodies.

[0095] In box 430, the model training system 200 constructs multiple first samples for the antibody generation model based on the antibody energy of the multiple first antibodies, the multiple first samples include at least one positive sample and at least one negative sample, the energy label corresponding to the first antibody in the positive sample indicates that its antibody energy satisfies the energy preference associated with the target antigen, and the energy label corresponding to the first antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference.

[0096] In block 440 , the model training system 200 uses the plurality of first samples to perform fine-tuning on the antibody generation model according to an optimization target, where the optimization target is based on the difference between the predicted energy signatures of the antibodies generated by the fine-tuned antibody generation model and the energy signatures between the plurality of first samples.

[0097] In some embodiments, the optimization objective is configured such that the difference between the predicted energy labels of antibodies generated using the fine-tuned antibody generation model and the energy labels corresponding to the positive samples is reduced, and the difference between the predicted energy labels and the energy labels corresponding to the negative samples is increased.

[0098] In some embodiments, the antibody energies corresponding to each of the plurality of first antibodies include antibody energies corresponding to a plurality of energy types. In some embodiments, the plurality of first samples include positive samples and negative samples corresponding to a plurality of energy types, respectively, and the energy label corresponding to the first antibody in the positive sample corresponding to each energy type indicates that its antibody energy satisfies the energy preference associated with the target antigen under the energy type, and the energy label corresponding to the first antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference under the energy type.

[0099] In some embodiments, the optimization target includes multiple sub-optimization targets corresponding to multiple energy types, and the sub-optimization target corresponding to each energy type is configured to reduce the difference between the predicted energy label corresponding to the predicted antibody energy of the antibody generated by the fine-tuned antibody generation model and the energy label corresponding to the positive sample corresponding to the energy type, and increase the difference between the predicted energy label and the energy label corresponding to the negative sample corresponding to the energy type.

[0100] In some embodiments, the energy preferences associated with the target antigen under at least the first energy type and the second energy type in the plurality of energy types conflict with each other. In some embodiments, fine-tuning the antibody generation model according to the optimization target includes: for the first sub-optimization target corresponding to the first energy type and the second sub-optimization target corresponding to the second energy type, respectively calculating the first sub-optimization target and the first sub-optimization target with respect to the first gradient and the second gradient in the fine-tunable parameter set of the antibody generation model; by gradient projection, projecting the first gradient to the normal plane corresponding to the second gradient, and projecting the second gradient to the normal plane corresponding to the first gradient; and fine-tuning the antibody generation model based on at least the first gradient and the second gradient after projection on the normal plane.

[0101] In some embodiments, the antibody energy of each of the plurality of first antibodies comprises an energy at the amino acid residue level of the antibody. In some embodiments, the optimization target comprises an optimization target at the amino acid residue level, and the optimization target at the amino acid residue level is configured to make a difference between the predicted energy signature at the amino acid residue level of the antibody generated using the fine-tuned antibody generation model and the energy signature at the amino acid residue level of the plurality of first samples.

[0102] In some embodiments, the antibody energy corresponding to the multiple energy types includes at least one of the following: the total energy of the antibody, the attraction between the antibody and the target antigen, and the repulsion between the antibody and the antigen.

[0103] In some embodiments, process 400 also includes: based on information of the target antigen, generating multiple second antibodies using the fine-tuned antibody generation model; respectively determining the antibody energy of each of the multiple second antibodies; based on the antibody energy of the multiple second antibodies, constructing multiple second samples for the antibody generation model, the multiple second samples include at least one positive sample and at least one negative sample, the energy label corresponding to the second antibody in the positive sample indicates that its antibody energy satisfies the energy preference associated with the target antigen, and the energy label corresponding to the second antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference; and using the multiple second samples, further fine-tuning the antibody generation model according to the optimization objective.

[0104] In some embodiments, the current antibody generation model is pre-trained based on a pre-training dataset, which includes multiple pairs of mutually matched sample antibodies and sample antigens.

[0105] In some embodiments, the antibody production model is based on a diffusion probability model.

[0106] The embodiments of the present disclosure also provide corresponding devices for implementing the above methods or processes. Figure 5A block diagram of an apparatus 500 for model training according to some embodiments of the present disclosure is shown. The apparatus 500 may be implemented as or included in the data processing system 110. Each module / component in the apparatus 500 may be implemented by hardware, software, firmware, or any combination thereof.

[0107] like Figure 5 As shown, the apparatus 500 includes an antibody generation module 510 configured to generate a plurality of first antibodies based on information of the target antigen using a current antibody generation model; and an energy determination module 520 configured to respectively determine the antibody energy of each of the plurality of first antibodies.

[0108] The device 500 also includes a sample construction module 530, which is configured to construct a plurality of first samples for the antibody generation model based on the antibody energy of the plurality of first antibodies. The plurality of first samples include at least one positive sample and at least one negative sample, the energy label corresponding to the first antibody in the positive sample indicates that its antibody energy satisfies the energy preference associated with the target antigen, and the energy label corresponding to the first antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference.

[0109] The apparatus 500 further includes a model fine-tuning module 540 configured to use the multiple first samples to perform fine-tuning on the antibody generation model according to an optimization objective based on the difference between the predicted energy labels of the antibodies generated by the fine-tuned antibody generation model and the energy labels between the multiple first samples.

[0110] In some embodiments, the optimization objective is configured such that the difference between the predicted energy labels of antibodies generated using the fine-tuned antibody generation model and the energy labels corresponding to the positive samples is reduced, and the difference between the predicted energy labels and the energy labels corresponding to the negative samples is increased.

[0111] In some embodiments, the antibody energies corresponding to each of the plurality of first antibodies include antibody energies corresponding to a plurality of energy types. In some embodiments, the plurality of first samples include positive samples and negative samples corresponding to a plurality of energy types, respectively, and the energy label corresponding to the first antibody in the positive sample corresponding to each energy type indicates that its antibody energy satisfies the energy preference associated with the target antigen under the energy type, and the energy label corresponding to the first antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference under the energy type.

[0112] In some embodiments, the optimization target includes multiple sub-optimization targets corresponding to multiple energy types, and the sub-optimization target corresponding to each energy type is configured to reduce the difference between the predicted energy label corresponding to the predicted antibody energy of the antibody generated by the fine-tuned antibody generation model and the energy label corresponding to the positive sample corresponding to the energy type, and increase the difference between the predicted energy label and the energy label corresponding to the negative sample corresponding to the energy type.

[0113] In some embodiments, the energy preferences associated with the target antigen under at least the first energy type and the second energy type in the plurality of energy types conflict with each other. In some embodiments, the model fine-tuning module 540 includes: a gradient calculation module, configured to calculate the first sub-optimization target corresponding to the first energy type and the second sub-optimization target corresponding to the second energy type, respectively, the first sub-optimization target and the first sub-optimization target in the fine-tunable parameter set of the antibody generation model; a gradient projection module, configured to project the first gradient to the normal plane corresponding to the second gradient through gradient projection, and project the second gradient to the normal plane corresponding to the first gradient; and a projection-based fine-tuning module, configured to perform fine-tuning on the antibody generation model based on at least the first gradient and the second gradient after projection on the normal plane.

[0114] In some embodiments, the antibody energy of each of the plurality of first antibodies comprises an energy at the amino acid residue level of the antibody. In some embodiments, the optimization target comprises an optimization target at the amino acid residue level, and the optimization target at the amino acid residue level is configured to make a difference between the predicted energy signature at the amino acid residue level of the antibody generated using the fine-tuned antibody generation model and the energy signature at the amino acid residue level of the plurality of first samples.

[0115] In some embodiments, the antibody energy corresponding to the multiple energy types includes at least one of the following: the total energy of the antibody, the attraction between the antibody and the target antigen, and the repulsion between the antibody and the antigen.

[0116] In some embodiments, the device 500 also includes: a second antibody generation module, configured to generate multiple second antibodies based on information of the target antigen using a fine-tuned antibody generation model; a second energy determination module, configured to respectively determine the antibody energy of each of the multiple second antibodies; a second sample construction module, configured to construct multiple second samples for the antibody generation model based on the antibody energy of the multiple second antibodies, the multiple second samples including at least one positive sample and at least one negative sample, the energy label corresponding to the second antibody in the positive sample indicates that its antibody energy satisfies the energy preference associated with the target antigen, and the energy label corresponding to the second antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference; and a second model fine-tuning module, configured to use the multiple second samples to perform further fine-tuning on the antibody generation model according to the optimization objective.

[0117] In some embodiments, the current antibody generation model is pre-trained based on a pre-training dataset, which includes multiple pairs of mutually matched sample antibodies and sample antigens.

[0118] In some embodiments, the antibody production model is based on a diffusion probability model.

[0119] The units and / or modules included in the device 500 can be implemented in various ways, including software, hardware, firmware, or any combination thereof. In some embodiments, one or more units and / or modules can be implemented using software and / or firmware, such as machine executable instructions stored on a storage medium. In addition to or as an alternative to machine executable instructions, some or all of the units and / or modules in the device 500 can be implemented at least in part by one or more hardware logic components. As an example and not limitation, exemplary types of hardware logic components that can be used include field programmable gate arrays (FPGAs), application specific integrated circuits (ASICs), application specific standard products (ASSPs), systems on chips (SOCs), complex programmable logic devices (CPLDs), and the like.

[0120] Figure 6 1 shows a block diagram of an electronic device 600 in which one or more embodiments of the present disclosure may be implemented. It should be understood that Figure 6 The electronic device 600 shown is merely exemplary and should not constitute any limitation on the functionality and scope of the embodiments described herein. Figure 6 The electronic device 600 shown can be used to implement Figure 1 The data processing system 110, Figure 2 Model training system 200, Figure 3 A model training system 310 or a model application system 320, or Figure 5 Device 500.

[0121] like Figure 6As shown, the electronic device 600 is in the form of a general electronic device. The components of the electronic device 600 may include, but are not limited to, one or more processors or processing units 610, a memory 620, a storage device 630, one or more communication units 640, one or more input devices 650, and one or more output devices 660. The processing unit 610 may be an actual or virtual processor and is capable of performing various processes according to a program stored in the memory 620. In a multi-processor system, multiple processing units execute computer executable instructions in parallel to improve the parallel processing capability of the electronic device 600.

[0122] The electronic device 600 typically includes a plurality of computer storage media. Such media can be any available media accessible to the electronic device 600, including but not limited to volatile and non-volatile media, removable and non-removable media. The memory 620 can be a volatile memory (e.g., registers, caches, random access memory (RAM)), a non-volatile memory (e.g., a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), flash memory) or some combination thereof. The storage device 630 can be a removable or non-removable medium, and can include a machine-readable medium, such as a flash drive, a disk, or any other medium, which can be used to store information and / or data and can be accessed within the electronic device 600.

[0123] The electronic device 600 may further include additional removable / non-removable, volatile / non-volatile storage media. Figure 6 As shown in , a disk drive for reading or writing from a removable, non-volatile disk (e.g., a "floppy disk") and an optical drive for reading or writing from a removable, non-volatile optical disk may be provided. In these cases, each drive may be connected to the bus (not shown) by one or more data media interfaces. The memory 620 may include a computer program product 625 having one or more program modules that are configured to perform various methods or actions of various embodiments of the present disclosure.

[0124] The communication unit 640 implements communication with other electronic devices through a communication medium. Additionally, the functions of the components of the electronic device 600 can be implemented with a single computing cluster or multiple computing machines that can communicate through a communication connection. Therefore, the electronic device 600 can operate in a networked environment using a logical connection with one or more other servers, a network personal computer (PC), or another network node.

[0125] The input device 650 may be one or more input devices, such as a mouse, a keyboard, a tracking ball, etc. The output device 660 may be one or more output devices, such as a display, a speaker, a printer, etc. The electronic device 600 may also communicate with one or more external devices (not shown) through the communication unit 640 as needed, such as a storage device, a display device, etc., communicate with one or more devices that allow a user to interact with the electronic device 600, or communicate with any device that allows the electronic device 600 to communicate with one or more other electronic devices (e.g., a network card, a modem, etc.). Such communication may be performed via an input / output (I / O) interface (not shown).

[0126] According to an exemplary implementation of the present disclosure, a computer-readable storage medium is provided, on which computer-executable instructions are stored, wherein the computer-executable instructions are executed by a processor to implement the method described above. According to an exemplary implementation of the present disclosure, a computer program product is also provided, which is tangibly stored on a non-transitory computer-readable medium and includes computer-executable instructions, and the computer-executable instructions are executed by a processor to implement the method described above.

[0127] Various aspects of the present disclosure are described herein with reference to the flowcharts and / or block diagrams of the methods, devices, equipment, and computer program products implemented according to the present disclosure. It should be understood that each box in the flowchart and / or block diagram and the combination of each box in the flowchart and / or block diagram can be implemented by computer-readable program instructions.

[0128] These computer-readable program instructions can be provided to a processing unit of a general-purpose computer, a special-purpose computer, or other programmable data processing device, thereby producing a machine, so that when these instructions are executed by the processing unit of the computer or other programmable data processing device, a device that implements the functions / actions specified in one or more boxes in the flowchart and / or block diagram is generated. These computer-readable program instructions can also be stored in a computer-readable storage medium, and these instructions cause the computer, programmable data processing device, and / or other equipment to work in a specific manner, so that the computer-readable medium storing the instructions includes a manufactured product, which includes instructions for implementing various aspects of the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0129] Computer-readable program instructions can be loaded onto a computer, other programmable data processing apparatus, or other device so that a series of operational steps are performed on the computer, other programmable data processing apparatus, or other device to produce a computer-implemented process, so that the instructions executed on the computer, other programmable data processing apparatus, or other device implement the functions / actions specified in one or more boxes in the flowchart and / or block diagram.

[0130] The flow chart and block diagram in the accompanying drawings show the possible architecture, function and operation of the system, method and computer program product according to multiple implementations of the present disclosure. In this regard, each square box in the flow chart or block diagram can represent a part of a module, program segment or instruction, and a part of a module, program segment or instruction includes one or more executable instructions for realizing the logical function of the specification. In some implementations as replacements, the function marked in the square box can also occur in a sequence different from that marked in the accompanying drawings. For example, two continuous square boxes can actually be executed substantially in parallel, and they can sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each square box in the block diagram and / or flow chart, and the combination of the square boxes in the block diagram and / or flow chart can be realized by a special hardware-based system that performs the function or action of the specification, or can be realized by a combination of special hardware and computer instructions.

[0131] The above descriptions of various implementations of the present disclosure are exemplary, non-exhaustive, and not limited to the disclosed implementations. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described implementations. The selection of terms used herein is intended to best explain the principles of the implementations, practical applications, or improvements to the technology in the market, or to enable other persons of ordinary skill in the art to understand the various implementations disclosed herein.

Claims

1. A method for model training, comprising: Based on the information of the target antigen, multiple first antibodies are generated using the current antibody generation model; respectively determining the antibody energy of each of the plurality of first antibodies; Based on the antibody energies of the multiple first antibodies, constructing multiple first samples for the antibody generation model, the multiple first samples include at least one positive sample and at least one negative sample, the energy label corresponding to the first antibody in the positive sample indicates that its antibody energy satisfies the energy preference associated with the target antigen, and the energy label corresponding to the first antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference; as well as The antibody production model is fine-tuned using the plurality of first samples according to an optimization target based on differences in energy signatures between predicted energy signatures of antibodies generated by the fine-tuned antibody production model and the plurality of first samples.

2. According to claim 1, wherein the optimization objective is configured so that the difference between the predicted energy label of the antibody generated using the fine-tuned antibody generation model and the energy label corresponding to the positive sample is reduced, and the difference between the predicted energy label and the energy label corresponding to the negative sample is increased.

3. The method according to claim 1, wherein the antibody energies corresponding to each of the plurality of first antibodies include antibody energies corresponding to a plurality of energy types, and The multiple first samples include positive samples and negative samples corresponding to the multiple energy types respectively, the energy label corresponding to the first antibody in the positive sample corresponding to each energy type indicates that its antibody energy satisfies the energy preference associated with the target antigen under the energy type, and the energy label corresponding to the first antibody in the negative sample indicates that its antibody energy does not satisfy the energy preference under the energy type.

4. The method according to claim 3, wherein the optimization target includes multiple sub-optimization targets corresponding to the multiple energy types respectively, and the sub-optimization target corresponding to each energy type is configured so that the difference between the predicted energy label corresponding to the predicted antibody energy of the antibody generated by the fine-tuned antibody generation model and the energy label corresponding to the positive sample corresponding to the energy type is reduced, and the difference between the predicted energy label and the energy label corresponding to the negative sample corresponding to the energy type is increased.

5. The method of claim 4, wherein the energy preferences associated with the target antigen under at least a first energy type and a second energy type among the plurality of energy types conflict with each other, and wherein fine-tuning the antibody generation model according to an optimization objective comprises: For a first sub-optimization objective corresponding to the first energy type and a second sub-optimization objective corresponding to the second energy type, respectively calculating a first gradient and a second gradient of the first sub-optimization objective and the first sub-optimization objective in a set of fine-tunable parameters of the antibody generation model; Projecting the first gradient onto a normal plane corresponding to the second gradient, and projecting the second gradient onto a normal plane corresponding to the first gradient, through gradient projection; as well as Fine-tuning the antibody generation model is performed based on at least the first gradient and the second gradient after being projected on a normal plane.

6. The method according to claim 1, wherein the antibody energy of each of the plurality of first antibodies comprises energy at the level of amino acid residues of the antibody, and The optimization target includes an optimization target at the amino acid residue level, and the optimization target at the amino acid residue level is configured to make the difference between the predicted energy signature at the amino acid residue level of the antibody generated based on the fine-tuned antibody generation model and the energy signature at the amino acid residue level of the multiple first samples.

7. The method according to claim 3, wherein the antibody energies corresponding to the multiple energy types include at least one of the following: The total energy of the antibody, The attraction between the antibody and the target antigen, The repulsive force between the antibody and the antigen.

8. The method according to claim 1, further comprising: Based on the information of the target antigen, generating a plurality of second antibodies using the fine-tuned antibody generation model; respectively determining the antibody energy of each of the plurality of second antibodies; Based on the antibody energies of the plurality of second antibodies, constructing a plurality of second samples for the antibody generation model, the plurality of second samples comprising at least one positive sample and at least one negative sample, the energy label corresponding to the second antibody in the positive sample indicating that the antibody energy thereof satisfies the energy preference associated with the target antigen, and the energy label corresponding to the second antibody in the negative sample indicating that the antibody energy thereof does not satisfy the energy preference; as well as The antibody production model is further fine-tuned using the plurality of second samples according to the optimization objective.

9. The method according to claim 1, wherein the current antibody generation model is pre-trained based on a pre-training dataset, and the pre-training dataset includes a plurality of pairs of mutually matching sample antibodies and sample antigens.

10. The method according to any one of claims 1 to 9, wherein the antibody production model is based on a diffusion probability model.

11. A device for model training, comprising: an antibody generation module, configured to generate a plurality of first antibodies based on information of the target antigen using a current antibody generation model; an energy determination module, configured to respectively determine the antibody energy of each of the plurality of first antibodies; A sample construction module is configured to construct a plurality of first samples for the antibody generation model based on the antibody energy of the plurality of first antibodies, wherein the plurality of first samples include at least one positive sample and at least one negative sample, wherein the energy label corresponding to the first antibody in the positive sample indicates that the antibody energy thereof satisfies the energy preference associated with the target antigen, and the energy label corresponding to the first antibody in the negative sample indicates that the antibody energy thereof does not satisfy the energy preference; as well as The model fine-tuning module is configured to use the multiple first samples to perform fine-tuning on the antibody generation model according to an optimization target, wherein the optimization target is based on the difference between the predicted energy labels of the antibodies generated by the fine-tuned antibody generation model and the energy labels between the multiple first samples.

12. An electronic device comprising: at least one processing unit; as well as At least one memory, the at least one memory is coupled to the at least one processing unit and stores instructions for execution by the at least one processing unit, the instructions, when executed by the at least one processing unit, causing the electronic device to perform the method according to any one of claims 1 to 10.

13. A computer-readable storage medium having a computer program stored thereon, wherein the computer program can be executed by a processor to implement the method according to any one of claims 1 to 10.

14. A computer program product tangibly stored in a computer storage medium and comprising computer executable instructions which, when executed by a device, cause the device to perform the method according to any one of claims 1 to 10.

Images