Multi-target tracking method based on coarse-to-fine shielding processing

A multi-target tracking and occlusion processing technology, which is applied in image data processing, instrument, character and pattern recognition, etc., can solve the problems of poor occlusion detection effect and dependence on prediction results, etc.

Pending Publication Date: 2021-12-07
SOUTHEAST UNIV
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

For the problem of occluded target detection, some improved non-maximum suppression algorithms have been proposed, such as soft-NMS, softer-NMS, adaptive-NMS, etc., and some improved loss functions h

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Multi-target tracking method based on coarse-to-fine shielding processing
  • Multi-target tracking method based on coarse-to-fine shielding processing
  • Multi-target tracking method based on coarse-to-fine shielding processing

Examples

Experimental program
Comparison scheme
Effect test

Example Embodiment

[0030] Example

[0031] The surveillance video used in the model training in this embodiment is the surveillance video in the actual subway scene. The scene diagram is as follows figure 2 shown.

[0032] In this example, the figure 2 Take the subway station surveillance video shown in as an example. These video images include both pedestrians without occlusion and pedestrians with occlusion. After the video in the subway scene is obtained, the pedestrians in the video are marked to obtain the subway pedestrian multi-target tracking dataset.

[0033] This example proposes a multi-target tracking method based on coarse-to-fine occlusion processing. The occluded targets in the input image are processed from coarse to fine. On this basis, the loss function is optimized, and NMS is optimized to achieve better performance. Multi-target tracking effect, the frame diagram of the model is as follows image 3 shown, the specific steps are as follows:

[0034] 1) Image input proce...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-target tracking method based on coarse-to-fine occlusion processing, and the model construction comprises the following steps: adding an occlusion score prediction on the basis of a JDE model prediction head, thereby completing the complete processing of a non-occlusion target and the coarse processing of an occlusion target; on the basis, taking a pedestrian shielding area after mapping and cutting as a training set of the second-step model for training, and completing accurate detection and apparent feature vector extraction of the shielded pedestrians, thereby realizing the fine processing of the shielded target; integrating results output by the two-step model, and finishing pedestrian tracking by using a data association algorithm. According to the invention, the problem that pedestrians cannot be accurately tracked in a shielding scene in the prior art is solved, and the method can well adapt to public environments of various time periods and various pedestrian densities; the method has a better effect on tracking pedestrians.

Description

technical field [0001] The invention belongs to the field of computer vision and monitoring video analysis, and in particular relates to a multi-target tracking method based on rough-to-fine occlusion processing. Background technique [0002] Multi-object tracking is an important part of surveillance video analysis. It can not only be directly used for object trajectory analysis, but also can be used as the research basis for advanced tasks such as object action recognition and behavior analysis. [0003] In order to complete the multi-target tracking task, many mainstream deep learning algorithms have proposed tracking strategies based on detection. These methods split multi-object tracking into a detection module and an embedding module. The detection module completes target detection, and the embedding module uses related algorithms to extract the features of the target. However, there may be multiple repeated calculations between these two modules, which affects the ru...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06T7/246G06K9/00G06K9/62
CPCG06T7/246G06T2207/10016G06F18/2411G06F18/214
Inventor 路小波张帅帅
Owner SOUTHEAST UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products