The application provides a panoramic image dual
perception enhancement method and device fusing deformable
convolution and spherical attention. The method comprises: mapping an ERP image into a polyhedral mesh vertex, inputting image features of all mesh vertices into a U-shaped coding and decoding network to obtain an
image perception result; the U-shaped coding and decoding network comprises a D-level
encoder and a D-level decoder, each level of the
encoder comprises M stacked dual
perception enhancement modules and a down-sampling layer, each level of the decoder comprises M stacked dual
perception enhancement modules and an up-sampling layer, the
encoder and the decoder are connected through a jump connection to transmit features between corresponding levels, and the dual perception enhancement module comprises a deformable spherical
convolution branch, a deformable spherical local self-attention
branch and an adaptive gating fusion block. Based on the dual perception enhancement module, the application can realize deep
collaboration of spherical discrete
mesh geometry adaptive capability and global semantic modeling capability, and improve the perception performance of the ERP image.