Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Deep learning-based cross-camera pedestrian multi-target tracking method and device

A multi-target tracking and deep learning technology, applied in neural learning methods, character and pattern recognition, instruments, etc., can solve the problems of large investment of resources, waste, low resolution, etc.

Pending Publication Date: 2021-01-26
SHANGHAI UNIV OF ENG SCI
View PDF2 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0006] In practical applications, enterprises or units that need intelligent monitoring systems directly replace the old monitoring systems with new intelligent monitoring equipment, but the replacement of new intelligent monitoring equipment requires a lot of additional funds and causes great inconvenience to the elimination of old monitoring equipment. Necessary waste of resources
However, the video frames in the old surveillance video have problems such as low resolution, obvious lighting changes, and insufficient occlusion. How to alleviate and reduce the impact of these deficiencies and factors is the key to solving the problem of pedestrian tracking.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Deep learning-based cross-camera pedestrian multi-target tracking method and device
  • Deep learning-based cross-camera pedestrian multi-target tracking method and device
  • Deep learning-based cross-camera pedestrian multi-target tracking method and device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0080] The following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the drawings in the embodiments of the present invention. Obviously, the described embodiments are part of the embodiments of the present invention, not all of them. Based on the embodiments of the present invention, all other embodiments obtained by persons of ordinary skill in the art without making creative efforts shall fall within the protection scope of the present invention.

[0081] like figure 1 As shown, according to an embodiment of the present invention, the present invention provides a single-camera pedestrian multi-target tracking method based on deep learning, comprising the following steps:

[0082] Step S101, acquiring video data;

[0083] The video data may be original video collected by devices such as a camera, or video data obtained after preprocessing on the original video.

[0084] Step S102, input the video to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention relates to a deep learning-based cross-camera pedestrian multi-target tracking method and device. The method comprises the steps of obtaining video data of multiple data sources; inputting the pedestrian detection frame into a trained encoder decoder deep network, simultaneously carrying out pedestrian detection and pedestrian apparent characteristic extraction, obtaining a pedestrian detection frame taking the pedestrian as a central point for detection, and outputting pedestrian apparent characteristics according to the central point; performing association matching on all pedestrian detection boxes based on all pedestrian apparent characteristics to obtain tracking trajectories of all pedestrians; for the tracking trajectory of each pedestrian in the plurality of videos, selecting a high-quality frame; respectively extracting pedestrian face features and gait features by using the trained deep neural network; carrying out feature fusion or matching on various features;and finally, performing cross-camera trajectory association clustering. The method and the device can be directly applied to an old monitoring system, have good robustness, and can realize accurate and efficient cross-camera pedestrian tracking.

Description

technical field [0001] The invention relates to the technical field of computer vision, in particular to a method and device for cross-camera pedestrian multi-target tracking based on deep learning. Background technique [0002] With the advancement of computer performance and the development of deep learning, many computer vision technologies are widely used in people's real life. For the traditional video surveillance system, it needs to rely on a lot of human resources to know whether the specified target appears, where and when it appears, and it mainly plays the role of evidence collection after the event. Research developers in related fields integrate computer vision, image processing, pattern recognition, artificial intelligence and other technologies to develop an intelligent video surveillance system, which can automatically identify and track pedestrians in video sequences with the help of powerful computer data processing capabilities . [0003] In existing ped...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08
CPCG06N3/04G06N3/08G06V40/172G06V40/103G06F18/253G06F18/214
Inventor 张旭徐振国丁亚男汤健
Owner SHANGHAI UNIV OF ENG SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products