The invention discloses a tumor space-occupying
brain network neural
image alignment method based on multi-
modal fusion, and belongs to the technical field of medical
image processing and
artificial intelligence crossing. The method comprises the following core steps of multi-
modal image heterogeneous feature decoupling, tumor occupation deformation field modeling,
functional network topological structure maintenance, cross-
modal feature adversarial alignment, dynamic deformation constraint optimization and clinical
interpretability verification, and construction of a three-dimensional non-rigid registration network based on a double attention mechanism. And differential homeomorphic mapping of a tumor
focus area and normal
brain tissue is realized through the cascaded
spatial transformation module. Aiming at the problems of insufficient multi-modal feature alignment and
brain network topology
distortion in the prior art, the invention provides a function connection constrained cross-modal fusion strategy, a graph
convolution network is adopted to
encode resting
state function connection features, and network node displacement caused by tumor occupation is dynamically corrected in combination with deformable
convolution and a bidirectional feature competition mechanism; a space consistency
loss function based on
white matter fiber bundle tracing is designed, and through
diffusion tensor imaging feature guide structure-function bimodal joint optimization, the problems of insufficient registration precision in a
focus area and whole
brain network connection
distortion of a traditional method are solved. Experiments show that the registration precision of the method in
glioma cases reaches 0.82 mm and is improved by 37% compared with that of a traditional method, and
dissection-function consistency of
functional network reconstruction around tumors is remarkably improved.