Abnormal behavior recognition method, device and apparatus based on voice and image features

A technology of image features and voice features, applied in the field of abnormal behavior recognition, can solve problems such as low accuracy, achieve the effect of security guarantee and improve the safety factor

Pending Publication Date: 2020-07-28
PING AN TECH (SHENZHEN) CO LTD
View PDF0 Cites 12 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

The main purpose is to solve the current technical problem of low accu

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Abnormal behavior recognition method, device and apparatus based on voice and image features
  • Abnormal behavior recognition method, device and apparatus based on voice and image features
  • Abnormal behavior recognition method, device and apparatus based on voice and image features

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0032] Exemplary embodiments of the present disclosure will be described in more detail below with reference to the accompanying drawings. Although exemplary embodiments of the present disclosure are shown in the drawings, it should be understood that the present disclosure may be embodied in various forms and should not be limited by the embodiments set forth herein. Rather, these embodiments are provided for more thorough understanding of the present disclosure and to fully convey the scope of the present disclosure to those skilled in the art.

[0033] The embodiment of the present application provides an abnormal behavior recognition method based on voice and image features, which can determine the action category corresponding to the user's action based on the user's image and voice, and determine whether the action category belongs to abnormal actions, so that according to the judgment Results Taking corresponding measures, this abnormal behavior recognition method based...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention belongs to the field of artificial intelligence, the invention discloses an abnormal behavior recognition method, device and apparatus based on voice and image features. The method comprises: performing feature extraction on the image of the user by utilizing a human body feature extraction model obtained after learning and training to obtain a to-be-recognized image feature vector;performing feature extraction on the voice of the user to obtain a to-be-recognized voice feature vector; performing cross fusion on the to-be-recognized image feature vector and the to-be-recognizedvoice feature vector to obtain a to-be-recognized fusion feature vector; and processing the to-be-recognized fusion feature vector by using an abnormal behavior recognition model obtained by learningand training the convolutional neural network to judge whether the action of the user belongs to an abnormal behavior, and if so, proving that the user belongs to a dangerous person, starting a corresponding interception function to intercept the user. Therefore, the users with abnormal behaviors can be identified more quickly and accurately, the safety coefficient of an enterprise is effectivelyimproved, and effective guarantee is provided for the safety of the users of the enterprise.

Description

technical field [0001] The present application relates to the technical field of artificial intelligence, in particular to a method, device and equipment for abnormal behavior recognition based on voice and image features. Background technique [0002] The security system of the service industry is related to social stability and people's property safety, and has always been the focus of security development. For example, the existing security systems of bank outlets can no longer reliably guarantee the safety of bank outlet operations and personnel in the outlets. [0003] Some security systems in the service industry use the method of triggering an alarm or video surveillance. This method can only notify the relevant personnel to deal with it in a timely manner after the dangerous person enters. [0004] The existing security system only recognizes the behavior of personnel based on the human body posture in the video or picture, and the accuracy of the recognition of dan...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06K9/62G06N3/04G06N3/08G06Q40/02G06Q50/26
CPCG06N3/08G06Q40/02G06Q50/26G06V40/20G06N3/045G06F18/251G06F18/253
Inventor 雷宇泽陈远旭周宝骆加维廖智
Owner PING AN TECH (SHENZHEN) CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products