The invention discloses a
traffic scene-oriented hyperspectral
hybrid expert adapter target tracking method and
system, and belongs to the technical field of hyperspectral
visual target tracking. The method comprises the following steps: firstly, preprocessing a hyperspectral vehicle tracking
video sequence, dividing a hyperspectral channel into multi-
stream groups, performing dynamic
cutting and patch embedding, and constructing a multi-
stream image token sequence; then, a hyperspectral interaction
hybrid expert tracking network comprising a multi-
stream Transform extraction module, a
hybrid expert adapter and a time-space hidden state token evolution mechanism is introduced, and joint modeling is carried out on hyperspectral features of a multi-stream template image and a search area image; further, adaptive enhancement is performed on the multi-dimensional features and background interference is suppressed through a mixed expert module consisting of a spectrum expert, a space expert, a time expert and a visual expert; and finally, target positioning prediction is executed based on the enhanced features, and a target tracking result is output. The method can effectively mine interaction information between hyperspectral bands, realizes robust target tracking in combination with a spatio-
temporal context, and is suitable for vehicle target tracking application in a complex
traffic scene.