The invention belongs to the technical field of
artificial intelligence and
computer vision, relates to an environmental
sanitation video garbage detection method based on uncertainty guide hierarchical retrieval, and aims to solve the problem that an existing environmental
sanitation video garbage detection method is high in labeling cost and weak in generalization ability or lacks historical context support, so that complex scenes are missed and missed. The method comprises the following steps: firstly, acquiring an environmental
sanitation video
frame sequence and dividing the sequence into fragments, extracting visual and garbage category language features through a pre-training
encoder, and calculating a negative
cosine distance to obtain category probability distribution; secondly, estimating the uncertainty of frames and fragments by using normalized Renyi entropy, retrieving high-confidence reference fragments from short-time, scene and global levels of a clean and junk double-memory
library when the uncertainty is high, and directly inputting the high-confidence reference fragments into a pre-trained VLM model when the uncertainty is low; and finally, obtaining a final result through evidence
perception time sequence attention fusion, and dynamically updating the
memory bank. According to the scheme, additional training is not needed, the detection robustness and accuracy in complex scenes such as low illumination and shielding are effectively improved, and reliable
technical support is provided for intelligent environmental sanitation operation.