The invention relates to the technical field of
computer vision and fire monitoring, and provides a fire
image detection and segmentation method based on an end-to-end unified framework and physical knowledge embedding. Aiming at the problems of computation redundancy, feature segmentation and strong dependence on visible light caused by traditional staged
processing, the invention provides the following technical scheme: constructing an end-to-end network comprising an Officient
Hybrid Ender
encoder and a
mask-dino decoder, and realizing
global modeling and cross-scale
feature fusion through a single-layer Transform; thermal imaging physical knowledge embedding is innovatively introduced, and three fusion
modes of pixel-level addition, feature-level Embedding and
interactive learning are adopted; a lightweight single-layer Transform architecture and a multi-task
loss function are designed, and GIOU, Dice and a joint detection segmentation
hybrid matching strategy are combined. According to the method, a bounding box and
mask prediction are synchronously generated through a unified query mechanism, the adaptability of a low-illumination scene is enhanced by using thermal
imaging data, and the training efficiency is improved by decoupling bounding box loss. According to the invention, the real-time performance, robustness and precision of fire monitoring are significantly improved in a complex scene.