Method and device for intelligently monitoring and identifying surrounding environment of payee, and medium

A surrounding environment and intelligent monitoring technology, applied in the field of behavior recognition, can solve problems such as limited storage days, long video recording length, and warning and alarming of people who cannot withdraw money.

Active Publication Date: 2021-03-19
EAST CHINA JIAOTONG UNIVERSITY
View PDF5 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, it is not possible to warn the cashier so as to avoid accidents at the first time. In most cases, it is even due to the loose staff and lack of background management.
[0004] The existing technology uses manual interpretation, but because the time spent staring at the background monitoring at work is very long, the length of video ...

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Method and device for intelligently monitoring and identifying surrounding environment of payee, and medium
  • Method and device for intelligently monitoring and identifying surrounding environment of payee, and medium
  • Method and device for intelligently monitoring and identifying surrounding environment of payee, and medium

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0057] The invention provides a method for intelligent monitoring and identification of the surrounding environment of the withdrawal person, such as figure 1 As shown, including video surveillance, target tracking, interactive behavior detection and interactive behavior recognition.

[0058] The target tracking is as follows: when video monitoring shows that people enter around the ATM cash machine, Markov Monte Carlo is used to carry out multi-target tracking with the human body in the monitoring video as a target, and obtain a tracking video including multi-target tracking trajectories.

[0059] Multi-object tracking is especially important in the process of action recognition, without reliable tracking accuracy, the accuracy of the final action recognition cannot be guaranteed. Most current multi-target tracking algorithms do not consider the occlusion of the target as much as possible. The project intends to define the human target intensity mapping relationship diagram ...

Embodiment 2

[0167] This embodiment provides an intelligent monitoring and identification device for the surrounding environment of a cashier, including: a target tracking module, an interaction behavior detection module, and an interaction behavior identification module.

[0168] The target tracking module is used for: when video monitoring shows that people enter around the ATM cash machine, Markov Monte Carlo is used to carry out multi-target tracking with the human body in the monitoring video as a target, and obtain a tracking video including multi-target tracking tracks .

[0169] The interactive behavior detection module is used to: extract the multi-layer pyramid structure of the motion boundary histogram feature MBH and the directional optical flow histogram feature HOOF from the tracking video, and construct the combined feature HOM; according to the combined feature HOM, through the convolutional neural network The algorithm judges the facial portrait and its feature points of e...

Embodiment 3

[0184] The present invention also provides a computer storage medium, including a computer program. When the computer program is executed by a processor, the method for intelligently monitoring and identifying the surrounding environment of a payer described in Embodiment 1 is implemented.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses an intelligent monitoring and recognition method and device for the surrounding environment of a payee, and a medium. The method comprises the steps of video monitoring, targettracking, and interactive behavior detection and recognition. The target tracking comprises the following steps: when the video monitors that someone enters the periphery of the ATM, performing multi-target tracking by taking a human body in the monitoring video as a target by adopting Markov Monte Carlo to obtain a tracking video comprising a multi-target tracking track; the interactive behaviordetection comprises the steps of extracting features from a tracking video and constructing combined features to judge a face portrait and feature points thereof of a human body target through a convolutional neural network algorithm so as to judge whether a head posture and a sight angle are abnormal or not, and carrying out interactive behavior detection on the abnormal situation; the interactive behavior recognition is to further judge the type of the interactive behavior if the interactive behavior exists. According to the invention, people and objects in the withdrawal area can be monitored in real time, and the behaviors of people can be automatically detected and identified.

Description

technical field [0001] The invention belongs to the technical field of behavior recognition, and in particular relates to a method, device and medium for intelligent monitoring and recognition of a cashier's surrounding environment. Background technique [0002] With the popularization of payment methods such as Alipay and WeChat, small amounts are less and less carried out in bank ATMs, and only some transactions with large amounts are easy to use cash. And most of the people who use cash transactions are older people. Therefore, it is necessary to focus on the safety of withdrawals for this group of people. [0003] At present, the monitoring of the surrounding environment of the cash machine mainly relies on the camera installed on the ceiling and the pinhole camera on the ATM for real-time monitoring and video recording. It is manually interpreted during working hours, but the ATM is open 24 hours, so the video is recorded after get off work, and Save the whole day vide...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/46G06K9/62G06Q20/10G06N3/04G06N3/08
CPCG06Q20/1085G06N3/08G06V40/20G06V20/46G06V20/52G06V10/50G06V2201/07G06N3/045G06F18/295
Inventor 涂宏斌刘雨芃徐任玉胡昕岳彭圆圆池瑞
Owner EAST CHINA JIAOTONG UNIVERSITY
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products