Open vocabulary semantic segmentation method and system based on instance semantic prototype guidance

By using an instance semantic prototype-guided approach, instance masks are generated and visual lexical associations are constrained. Instance semantic prototypes are then constructed for correction and propagation refinement, solving the problems of instance-level semantic instability and boundary inconsistency in open-vocabulary semantic segmentation, and improving the stability and accuracy of the segmentation results.

CN122416016APending Publication Date: 2026-07-17SOUTHEAST UNIV
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202610514985.2
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Filing Date
2026-04-17
Publication Date
2026-07-17

AI Technical Summary

Technical Problem

Existing open-vocabulary semantic segmentation methods suffer from problems such as instance-level semantic instability, strong cross-instance interference, and inconsistent local view reasoning in complex scenarios, making it difficult to effectively solve the problems of semantic breakage and boundary fragmentation within instances.

Method used

By using an instance-based semantic prototype-guided approach, an instance mask is generated. The instance mask and auxiliary visual features are used to constrain the scope and strength of visual word associations. An instance semantic prototype is then constructed for guided correction and progressive propagation refinement, achieving cross-view consistency fusion.

Benefits of technology

It improves regional consistency and boundary quality, enhances the semantic discrimination ability of open lexical terms, reduces the risk of error propagation, and improves the stability and accuracy of segmentation results.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN122416016A_ABST
    Figure CN122416016A_ABST
Patent Text Reader

Abstract

本发明公开了一种基于实例语义原型引导的开放词汇语义分割方法及系统,对待分割图像生成实例掩码,利用实例掩码和辅助视觉特征对视觉词元之间的关联范围和关联强度进行约束重构;将重构后的视觉词元特征与开放词汇类别文本特征进行匹配,获得初始语义预测结果;依据视觉词元不确定性在实例内部构造实例语义原型,利用实例语义原型对高不确定性区域进行引导校正和递进式传播细化,通过跨视图一致性融合得到开放词汇语义分割结果。本发明能够抑制开放词汇语义分割中由类间耦合、背景干扰和局部视图不一致引起的错误预测,提高区域一致性、边界质量和开放词汇语义判别能力。
Need to check novelty before this filing date? Find Prior Art