The invention discloses a ChemBERTa-FP anti-
cancer drug prediction method based on combination of
deep learning and the chemical field. The ChemBERTa-FP anti-
cancer drug prediction method comprises the following steps: step 1, acquiring data of a CI-60DTP
database and data of a ChEMBL
database; step 2, ChemBERTa and BERTbase are used as a basic pre-training model; a BERT base pre-trains a deep bidirectional
language representation model, and an additional output layer is used for adjusting the pre-trained BERT base model, so that a model is created for a wide range of tasks under the condition that major architecture modification is not carried out; meanwhile, ChemBERTa is used as a basic pre-training model, RoBERTa is used as a basic model, pre-training is carried out on a PubChem 77M
data set, and a specific chemical language SMILES is added in training; 3, the dimension represented by the model vector of ChemBERTa is 384, the number of heads is 12, and the number of
layers of
Transformer is 6. According to the invention, two
deep learning models, namely ChemBERTa and BERT-base, are innovatively utilized in the field of anti-
cancer molecule screening, which is the first application of the models.