Looking for breakthrough ideas for innovation challenges? Try Patsnap Eureka!

Monitoring video target real-time query method based on edge cloud convolutional neural network cascading

A convolutional neural network and surveillance video technology, which is applied in the field of real-time query of surveillance video targets, can solve problems such as large network bandwidth requirements and data transmission delay, difficulty in meeting new requirements for real-time performance, and inability to guarantee query accuracy, etc. The effect of uploading data to the cloud, reducing data transmission delay, and improving query accuracy

Pending Publication Date: 2021-01-19
杭州卷积云科技有限公司
View PDF2 Cites 8 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, uploading a large amount of surveillance video to the cloud server brings huge network bandwidth requirements and data transmission delays. It is difficult to meet the new real-time requirements of the surveillance video target query task, and it also brings a huge burden to the cloud server.
At the same time, most edge devices have limited resources and can only deploy lightweight CNN models (such as MobileNet), but cannot guarantee reliable query accuracy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Monitoring video target real-time query method based on edge cloud convolutional neural network cascading
  • Monitoring video target real-time query method based on edge cloud convolutional neural network cascading
  • Monitoring video target real-time query method based on edge cloud convolutional neural network cascading

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0037] The present invention will be further described in detail below in conjunction with the accompanying drawings and embodiments, which are explanations of the present invention rather than limitations.

[0038] Such as figure 1 Shown is the process logic block diagram of the present invention, the monitoring video target real-time query method based on edge-cloud convolutional neural network cascading of the present invention, comprises the following steps:

[0039] Step 1: When a user-defined query command is received, the specific CNN (convolutional neural network) based on the specific training data set and the specified query target will be fine-tuned and trained in the cloud server, and then the specific CNN will be deployed to the edge server;

[0040] Step 2: The edge server uses the target detection algorithm based on the difference between frames to detect and extract the moving target in the surveillance video;

[0041] Step 3: The edge server uses the load-base...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention discloses a monitoring video target real-time query method based on edge cloud convolutional neural network cascading, and belongs to the technical field of computer vision pedestrian re-identification. An edge end server extracts a moving target from the monitoring video, the lightweight CNN preferentially identifies the target, the target which cannot be judged is uploaded to the cloud server, and secondary identification is carried out by using the high-precision CNN. And meanwhile, an edge cloud task scheduling algorithm and a self-adaptive adjustment mechanism of threshold parameters are set, so that the performance of a monitoring video target query task can be effectively improved. Compared with a monitoring video target query method only using a cloud server, the invention has the advantages that the bandwidth consumption from an edge end server to the cloud server is remarkably reduced, the cost is reduced, the average query time delay and the fluctuation of thequery time delay are remarkably reduced, the real-time requirement is met, and meanwhile, the relatively good query accuracy is kept; compared with a monitoring video target query method only using anedge end server, the query accuracy is significantly improved.

Description

technical field [0001] The invention belongs to the technical field of edge computing / deep learning, and in particular relates to a real-time query method for surveillance video targets based on edge-cloud convolutional neural network cascading. Background technique [0002] With the widespread deployment of surveillance cameras, surveillance video data is growing explosively, and surveillance video analysis methods that rely on manual screening can no longer meet actual needs. On the one hand, the speed is slow, and it is difficult for manual screening methods to process a large amount of video data in real time; on the other hand, the cost is high, and massive video analysis brings huge labor costs. Therefore, with the development of deep learning, especially the development of convolutional neural network (CNN), automatic processing and analysis of surveillance video data is becoming more and more popular with the help of computer resources and video analysis algorithms. ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06N3/04G06N3/08G06F16/73
CPCG06N3/08G06F16/73G06V40/20G06V20/41G06N3/045
Inventor 杨树森赵鹏王世博张靖琪赵聪任雪斌王路辉王艺蒙韩青
Owner 杭州卷积云科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Patsnap Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Patsnap Eureka Blog
Learn More
PatSnap group products