A monitoring video multi-target classification retrieval method and system based on depth learning

A deep learning and surveillance video technology, applied in video data retrieval, metadata video data retrieval, digital data information retrieval, etc., can solve the problems of complex security surveillance video scene environment, easy to be subject to background noise and target occlusion, etc. Retrieval time, strong expressiveness, the effect of reducing the number of

Active Publication Date: 2019-01-18
CHINA ELECTRONIC TECH GRP CORP NO 38 RES INST
View PDF5 Cites 17 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0003] Security monitoring video has problems such as complex scene environment, dense targets, and various resolutions. Especially when multi-target classification retrieval is performed, the classification and extraction of targets in surveillance video is more susceptible to factors such as background noise and target occlusion than general target extraction. Shallow features are also difficult to accurately express multiple types of targets with large differences in appearance using unified features. In recent years, the development of deep learning can just solve the above problems

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A monitoring video multi-target classification retrieval method and system based on depth learning
  • A monitoring video multi-target classification retrieval method and system based on depth learning
  • A monitoring video multi-target classification retrieval method and system based on depth learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The embodiments of the present invention are described in detail below. This embodiment is implemented on the premise of the technical solution of the present invention, and detailed implementation methods and specific operating procedures are provided, but the protection scope of the present invention is not limited to the following implementation example.

[0038] Such as figure 1 As shown, this embodiment includes the following steps:

[0039] First train the deep learning model, the training deep learning model is: collect a large amount of diverse monitoring video pictures including people and car targets, mark the positions and categories of people and cars, and input them into the deep convolutional neural network for training to obtain Deep learning models, including target detection models and feature extraction models;

[0040] Then construct the retrieval video library as follows: extract the trajectories of all moving objects in the surveillance video and ...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a monitoring video multi-target classification retrieval method and system based on depth learning. The method comprises: extracting the object to be retrieved: inputting the image to be retrieved, selecting the object to be retrieved by automatic detection or manual digging, and determining the category of the object; extracting depth features: extracting depth features ofthe object to be retrieved by using depth learning feature extraction model; retrieving object: according to the category of the object to be retrieved, comparing the depth feature of the object to be retrieved with the depth feature of the same kind of object in the retrieval database to obtain the object most similar to it; displaying Retrieval results: displaying the retrieval results according to similarity from high to low. Depth features obtained by depth learning feature extraction module are used as the benchmark to match the retrieved target and the similar target in the retrieval database. Because depth features have the advantages of both strong expression and low dimension, the precision of retrieval results is greatly improved.

Description

technical field [0001] The invention relates to a video target retrieval technology, in particular to a method and system for multi-target classification and retrieval of surveillance video based on deep learning. Background technique [0002] In order to create a safer living environment and meet the increasing security needs of the people, the state vigorously promotes the construction of safe cities, and its core foundation is a huge number of video surveillance equipment deployed in every corner of the city. In addition to the important application scenario of urban public security monitoring, as the most effective way in the security field, video surveillance equipment has been widely used in areas closely related to daily life such as airports, stations, banks, shops, and residential areas. Therefore, in recent years, the number of video surveillance devices has increased dramatically, and a large number of video surveillance devices are generating massive amounts of s...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06F16/738G06F16/78G06K9/00G06K9/62
CPCG06V20/52G06V10/751G06F18/241G06F18/214
Inventor 杨利红张俊姜少波甘彤商国军程剑刘海涛李阳胡博张琦珺连捷陈曦
Owner CHINA ELECTRONIC TECH GRP CORP NO 38 RES INST
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products