The invention particularly relates to a ship multi-
modal image fusion recognition method based on graph neural structure alignment, and the method comprises the following steps: 1, obtaining a ship multi-
modal image, and constructing a backbone neural network to extract the features of the multi-
modal image; 2, constructing graph nodes of the graph neural network, and generating an adjacent edge relationship; 3, for graph structures constructed in different
modes, adopting a two-level graph attention mechanism to complete structure alignment; step 4, utilizing an optimal transmission mechanism to realize structure alignment between the
infrared and visible light modal diagrams; step 5, feature re-injection is carried out to fuse space coordinates and
global information, and the positioning and expression ability of node features is improved; and step 6, training the constructed ship multi-modal
image fusion recognition network by adopting local feature alignment loss, graph-level
semantic consistency loss and classification supervision loss. According to the method, the problem of alignment errors caused by inconsistency of
infrared and visible light modal images is solved, the structure and
semantic information of the
infrared and optical images are fully fused, the accuracy and robustness of cross-modal target recognition are effectively improved, and the method is suitable for complex scenes such as multi-modal ship recognition.