一种融合可变形卷积与球面注意力的全景图像双重感知增强方法与装置

By employing a U-shaped encoder-decoder network in panoramic images, combined with deformable convolution and spherical attention, the problems of geometric distortion and insufficient global modeling capabilities in panoramic image processing are solved, achieving efficient image perception enhancement.

CN122175811BActive Publication Date: 2026-07-17HANGZHOU DIANZI UNIV

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
HANGZHOU DIANZI UNIV
Filing Date
2026-05-07
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

When processing panoramic images based on equidistant cylindrical projection, existing technologies often fail to maintain geometric consistency due to the difficulty of traditional convolutional neural networks in maintaining geometric consistency. This results in severe polar distortion, which affects the accuracy of downstream perception tasks. Meanwhile, pure Transformer methods lack the local inductive bias of convolution and cannot effectively capture long-range global contextual dependencies in images.

Method used

A U-shaped encoding and decoding network is adopted, which combines deformable convolution and spherical attention. By mapping panoramic images to the vertices of a polyhedral mesh, deformable spherical convolution branches and deformable spherical local self-attention branches are used to extract local geometric deformation features and global context features in parallel. Feature fusion is performed through adaptive gating fusion blocks to achieve a deep integration of geometric adaptation capability and global modeling capability.

Benefits of technology

It enhances the geometric adaptation and global modeling capabilities of panoramic images, solves the geometric distortion problem existing in traditional methods, strengthens the adaptability to irregular geometric deformations, and improves the accuracy and efficiency of image perception tasks by dynamically fusing weights to balance the contributions of local and global features.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122175811B_ABST
    Figure CN122175811B_ABST
Patent Text Reader

Abstract

本申请提供一种融合可变形卷积与球面注意力的全景图像双重感知增强方法与装置。所述方法包括:将ERP图像映射为多面体网格顶点,将所有网格顶点的图像特征输入至U型编解码网络,以得到图像感知结果;U型编解码网络包含D级编码器与D级解码器,各级编码器包含M个堆叠的双重感知增强模块与一个下采样层,各级解码器包含M个堆叠的双重感知增强模块与一个上采样层,编码器与解码器对应层级之间通过跳跃连接传递特征,双重感知增强模块包含可变形球面卷积支路、可变形球面局部自注意力支路与自适应门控融合块。本申请基于双重感知增强模块能够实现球面离散网格几何自适应能力与全局语义建模能力的深度协同,提高ERP图像的感知性能。
Need to check novelty before this filing date? Find Prior Art