The invention discloses a molecular multi-mode characterization method based on attention fusion, and the method comprises the following steps: firstly, carrying out the independent
feature extraction of the one-dimensional, two-dimensional and three-dimensional
modes of a molecule through a
molecular sequence encoder, a molecular map
encoder and a
molecular conformation encoder, and carrying out the
feature extraction of the one-dimensional, two-dimensional and three-dimensional features of the molecule; based on
natural language text description, multi-level contrast learning is adopted, and gradual alignment of each mode and the text is achieved; secondly, multi-
modal consistency constraint is introduced, the characterization distance of the same molecule in different modals is shortened, and
semantic consistency is ensured; thirdly, adaptively integrating multi-
modal features through a
modal attention fusion module to obtain uniform molecular
semantic representation, and further performing final alignment with a text embedding space; and finally, completing tasks such as molecule-text bidirectional retrieval and molecule attribute prediction by utilizing fusion representation. According to the method, under the condition that the model does not need to be retrained for different tasks,
natural language-driven molecular retrieval, editing and property prediction can be realized, and the method has relatively high robustness, expansibility and universality.