Target tracking and semantic segmentation method, device and plug-in for sports video

A technology of object tracking and sports, applied in the field of computer vision, can solve problems such as shaking, affecting process speed, tracking and semantic segmentation failure, etc.
CN112347852BActive Publication Date: 2022-07-29SHANGHAI JIAOTONG UNIV

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
SHANGHAI JIAOTONG UNIV
Publication Date
2022-07-29

Smart Images

  • Figure 1
    Figure 1
  • Figure 2
    Figure 2
  • Figure 3
    Figure 3
Patent Text Reader

Abstract

The invention discloses a method, device and plug-in for target tracking and semantic segmentation of sports video. The method includes: extracting a feature map according to input video frames and target initialization position information to obtain feature map information; Perform positioning to obtain target location information; fuse feature map information and target location information, and filter the background information of non-target areas; perform decoding operations according to fused features and feature map information, and finally form a semantic mask of the target. membrane. The device includes: a backbone network encoder, a prediction network unit, a feature fusion network unit and a decoder. The plug-in includes: video information component, video preview component, video playback component, new target component, tracking adjustment component and special effect component. Through the present invention, the tracking accuracy can be improved in sports videos with problems such as target deformation, rotation, and occlusion.
Need to check novelty before this filing date? Find Prior Art

Description

technical field

[0001] The invention relates to the technical field of computer vision, in particular to a method, device and plug-in for target tracking and semantic segmentation of sports video. Background technique

[0002] In recent years, the rapid development of the mobile Internet, especially the 5G industry, has spawned a wide range of digital entertainment application scenarios. Among them, target tracking algorithms are widely used in video special effects editing, human-computer interaction, video surveillance, TV broadcasting, autonomous driving and scientific analysis.

[0003] Object tracking algorithm is a basic topic in the field of computer vision. Early tracking algorithms often search based on manually specified target features, or calculate optical flow to determine target displacement. Tracking algorithms based on this idea often have high time complexity and poor robustness, so their application scope is narrow. After that, the target tracking algori...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More