The invention provides a tumor recognition method based on multi-
modal feature fusion, relates to the technical field of tumor recognition, and is used for solving the problems of missing multi-
modal feature calibration, insufficient
semantic association, poor generalization and insufficient clinical
interpretability in the prior art. The method comprises the following steps: firstly, synchronously acquiring
visual structure and
electrical impedance bimodal data through an event-driven
sensor array, and completing preprocessing through pulse coding, STDP rule optimization and quality
verification; then, respectively extracting structured feature vectors of a tumor
visual structure class and characteristic feature vectors of a numerical attribute class by a heterogeneous twin coding engine, and unifying dimensions and distribution through processes such as multi-scale dynamic
perception and cross-
modal calibration; then based on an attention mechanism, InfoNCE contrast loss and
minority class weight gain, dynamic weighted fusion and
semantic association enhancement are performed on the bimodal features, and a comprehensive
feature vector is generated; and finally, through clinical logic
adaptation and multi-center deviation correction, outputting a tumor benign and malignant identification result through a full-connection classifier, and synchronously generating a clinical interpretable report containing key features and weights. According to the method, the complementary advantages of bimodal information are effectively integrated, the problems of heterogeneous multi-center equipment, unbalanced samples and the like are solved, the tumor recognition accuracy and the early-stage tiny
tumor detection rate are improved, the computing
power consumption is reduced, edge
medical equipment deployment is adapted, and the requirements for low misjudgment and
traceability of
clinical diagnosis are met.