Target behavior recognition method, device and application based on audio-visual feature fusion

A technology of feature fusion and recognition methods, applied in neural learning methods, character and pattern recognition, instruments, etc., can solve the problems of integrating audio-visual features and not proposing effective solutions.

Active Publication Date: 2022-07-26
CITY CLOUD TECH HANGZHOU CO LTD
View PDF16 Cites 0 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0008] Based on this, there is no effective solution to the problem that the abnormal behavior recognition algorithm cannot be well integrated into audio-visual features to accurately determine whether there is abnormal behavior.

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Target behavior recognition method, device and application based on audio-visual feature fusion
  • Target behavior recognition method, device and application based on audio-visual feature fusion
  • Target behavior recognition method, device and application based on audio-visual feature fusion

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0038] Exemplary embodiments will be described in detail herein, examples of which are illustrated in the accompanying drawings. Where the following description refers to the drawings, the same numerals in different drawings refer to the same or similar elements unless otherwise indicated. The implementations described in the following exemplary embodiments are not intended to represent all implementations consistent with one or more embodiments of this specification. Rather, they are merely examples of apparatus and methods consistent with some aspects of one or more embodiments of this specification, as recited in the appended claims.

[0039] It should be noted that: in other embodiments, the steps of the corresponding methods are not necessarily performed in the order shown and described in this specification. In some other embodiments, the method may include more or fewer steps than described in this specification. In addition, a single step described in this specificat...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The present application proposes a target behavior recognition method, device and application for audio-visual feature fusion, and relates to the technical field of intelligent security. The extraction network extracts visual features and auditory features, and obtains temporal features through LSTM network calculation; and builds a shared semantic subspace through an auto-encoding network, eliminates the semantic deviation of visual and auditory features, and finally fuses visual features and auditory features, The target behavior can be identified based on the fusion features. The present application can improve the accuracy of abnormal behavior identification.

Description

technical field [0001] The present application relates to the technical field of intelligent security, and in particular, to a target behavior recognition method, device and application based on audio-visual feature fusion. Background technique [0002] In the field of urban management and safety management, monitoring emergencies and real-time alarming is very important to public safety management. In real life, personnel fighting is one of the most common abnormal emergencies. The traditional alarm methods mainly include: calling the police to find out that a fight has occurred. Obviously, this reporting method has a lag. In addition, security personnel can stare at the monitoring screen to find abnormalities, but this method is labor-intensive. . [0003] Therefore, there are existing technologies that use surveillance cameras to continuously monitor 24 hours a day, and then judge and alarm the fighting behavior according to the artificial intelligence algorithm, which ...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Patents(China)
IPC IPC(8): G06V10/80G06K9/62G06N3/04G06N3/08
CPCG06N3/08G06N3/044G06F18/254G06F18/253
Inventor 毛云青王国梁齐韬陈思瑶葛俊
Owner CITY CLOUD TECH HANGZHOU CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap