Bimodal iterative denoising anomaly detection method based on video weak mark, and terminal

An anomaly detection, dual-modal technology, applied in the field of computer vision, can solve problems such as labels, and achieve the effect of strong robustness and universal applicability

Active Publication Date: 2020-09-04
SHANGHAI JIAO TONG UNIV
View PDF6 Cites 2 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0007] Aiming at the weak label problem of the current data set, the present invention regards the weak label as the noise of the precise label, and denoises the label from the image control and feature space respectively; uses the self-encoder to learn the characteristics of normal and abnormal videos from the image space; uses the graph The convolutional model learns the features of video clips at different times; iteratively updates the classifier and denoiser alternately
The present invention overcomes the difficulty of labeling data by fully considering the problem of weak labeling of video, and uses the method of denoising model. Facing the research field of abnormal detection, which is difficult to collect data, it has strong robustness and can solve the problem of video very well. If labeling is a problem, it has general applicability

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Bimodal iterative denoising anomaly detection method based on video weak mark, and terminal
  • Bimodal iterative denoising anomaly detection method based on video weak mark, and terminal
  • Bimodal iterative denoising anomaly detection method based on video weak mark, and terminal

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0056] The following describes the implementation of the present invention through specific specific examples. Those skilled in the art can easily understand other advantages and effects of the present invention from the content disclosed in this specification. The present invention can also be implemented or applied through other different specific embodiments, and various details in this specification can also be modified or changed based on different viewpoints and applications without departing from the spirit of the present invention.

[0057] The present invention uses a multi-instance learning method as the main framework for anomaly detection, divides the video into multiple video segments as input units, greatly expands the amount of data that can be used for training the network framework in terms of dimensions, and finally achieves good results. Provide basic guarantee. The present invention uses a multi-example learning framework for preliminary denoising, uses a clas...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a bimodal iterative denoising anomaly detection method and terminal based on a video weak mark, and the method comprises the steps: enabling the weak mark to serve as the noiseof an accurate label, and respectively carrying out the label denoising from an image control and a feature space; learning characteristics of normal and abnormal videos from an image space by using an auto-encoder; learning features of the video clip at different times by using a graph convolution model; and alternately updating the classifier and the de-noiser by utilizing iteration. According to the method, the weak marking problem of the video is fully considered, the difficulty of marking the data is overcome by utilizing a denoising model method, and the method has very strong robustness, can well solve the problem of marking of the video and has universal applicability in the research field that the data are difficult to collect in abnormal detection.

Description

Technical field [0001] The invention belongs to the technical field of computer vision, and is specifically a dual-modal iterative denoising abnormal detection method and terminal based on video weak markers, and particularly relates to abnormal detection focusing on abnormal crowd behavior under a surveillance camera. Background technique [0002] Surveillance cameras are increasingly being used in public places, such as streets, intersections, banks, shopping malls and other places with dense traffic. However, the ability of the relevant administrative law enforcement agencies to detect abnormal situations in surveillance video has not kept up, resulting in the inability to make full use of the resources of surveillance cameras, and there are obvious defects in their use. It is also very unrealistic to let people observe surveillance video in real time, because the number of surveillance cameras in our country is already very large. It is not only costly to rely on human resour...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/40G06K9/62
CPCG06V20/40G06V10/30G06F18/2415G06F18/214
Inventor 杨华林书恒
Owner SHANGHAI JIAO TONG UNIV
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products