The invention discloses a night semantic segmentation method and device based on
wavelet transform detail enhancement and text prompt, and the method comprises the steps: obtaining a night image, carrying out the preprocessing of the night image, and carrying out the reconstruction of a
wavelet image; and inputting the preprocessed night image and the image after
wavelet transform reconstruction into a
deep learning model for semantic segmentation to obtain a segmentation result of the night scene object. A new three-stage
network structure is designed and formed, in the first stage, a three-mode feature extractor composed of an image
encoder, a night semantic category
encoder and a wavelet image
encoder is used for extracting features, in the second stage, a double-
branch cross-mode feature interaction module is designed, and the
feature extraction is carried out through the image encoder. In the first stage, features of different spatial resolutions and semantic hierarchies and
natural language priori of a target object are integrated, all-directional
semantic information from coarse
granularity to fine
granularity is captured, in the third stage, a multi-scale feature segmentation decoder is introduced, details of a low-light area are enhanced, fine texture edges and target contours are captured, and the target object is obtained. Through positioning and understanding of the target area by the
natural language prior enhancement model, the precision of night scene semantic segmentation can be effectively improved.