This invention discloses a collaborative classification method for hyperspectral imagery and
lidar data, comprising: a spectral spatial feature interaction enhancement module, a graph
convolution module, a multi-head self-attention module, and a progressive
feature fusion module for spectral spatial information. Specifically, firstly, deep spectral spatial information between hyperspectral images and
lidar data is mined through weighted
feature fusion and cross-
modal convolution, extracting spatial element-level and spectral channel-level interaction features respectively. Then, a graph
convolution network is used to extract spatial information from the spatial element-level and spectral channel-level interaction features, calculate
spectral similarity, and construct an
adjacency matrix. Next, the spatial features are learned through graph convolution operations to obtain new spatial feature representations. Then, a multi-head self-attention mechanism is used to enhance the global dependency of spectral features, fusing the extracted spatial and spectral features. Finally, a maximum-based
decision fusion and progressive
feature fusion strategy are employed to integrate features at different levels, obtaining the final fused features, which are then used for final classification and output. This invention acquires rich spatial-spectral features simultaneously through a spectral spatial feature interaction enhancement module, a graph convolution module, and a multi-head self-attention module. It also incorporates a spectral spatial information progressive feature fusion module to regulate the information interaction at different
perception levels, thereby leveraging the synergistic advantages of multimodal information and significantly improving the accuracy and stability of
land cover classification tasks.