The invention discloses a multi-
modal image processing method based on frequency
perception and interactive fusion. The problem of
image fusion under a low-light condition can be solved in a decoupling type double-
branch parallel processing mode. The method comprises the following steps: importing a
data set and performing characteristic
decomposition, receiving visible light and
infrared images, and decoupling each
modal image into low-rank and sparse characteristics; carrying out
interactive content fusion, carrying out cross-
modal interaction on high and
low frequency features through bilateral
information exchange, carrying out enhancement, and reconstructing an intermediate
fusion image; performing parallel
global illumination estimation, inputting the visible light image into an illumination
estimation network based on
frequency domain processing, and generating an ideal illumination image; and performing physical illumination reconstruction and output, and performing brightness improvement on the intermediate
fusion image to obtain a
fusion image. According to the method, specialized
processing of frequency
perception and a cross-modal deep interaction mechanism are combined, and the quality and robustness of multi-modal
image fusion under complex conditions are remarkably improved by decoupling content fusion and an illumination
estimation task.