A device image enhancement reconstruction method fusing space-spectrum inter-transformer

Abstract

The present application belongs to the technical field of image processing and enhancement, and relates to a device image enhancement reconstruction method fusing space-spectrum interval Transform, comprising the following steps: obtaining visible light image and infrared thermal imaging data and generating structure confidence map and thermal anomaly confidence map; extracting double-mode feature and obtaining space path feature and spectrum interval path feature by shunting; calculating space self-attention guided by structure confidence to generate purified space feature flow; when the trigger is met, performing self-attention check based on spectrum interval path feature and purified flow to generate hot spot structure check flow; obtaining fusion map by using two types of confidence map to guide double-flow gate fusion; modulating shallow layer feature during decoding reconstruction and combining fusion map to obtain device image. The present application solves the problem of key image information dilution and external interference introduction caused by lack of cross-source feature quality quantitative evaluation and long-range space dependence construction capability in the prior art.

Images