The invention discloses a hyperspectral image and
LiDAR data collaborative classification method based on double-
branch Swin
Transformer, and the method comprises the steps: S1, employing 3D-2D mixed
convolution to extract the shallow space-spectrum information of a hyperspectral image after
principal component analysis and dimension reduction according to the characteristic of image and spectrum integration of the hyperspectral image; and S2, an improved Swin Transform network is adopted, a ResNet module is adopted in the network, and SSR (Spectral Segment Recombination) is introduced in the network, so that
information loss in feature transmission is eliminated, and deep space-spectrum features of the hyperspectral image are further mined. S3, carrying out 2D-2D
convolution on the
LiDAR data of the other
branch, and mining elevation information through an improved Swin Transform network; and S4, aiming at the hyperspectral and
LiDAR double branches, improving a
CAM (Cross Attention Module) into double-
branch input, through hyperspectral and LiDAR feature interaction, by establishing a dynamic attention mechanism, effectively capturing associated information between two modals, and fusing the associated information into uniform feature representation. The network is tested on two public hyperspectral and
LiDAR data sets, and shows good classification performance.