Personnel and vehicle monitoring method and system based on capsule network

A vehicle monitoring and capsule technology, applied in biological neural network models, speech analysis, instruments, etc., can solve the problems of few features, difficult to classify finely, and reduce the recognition accuracy rate, and achieve the increase of vector/matrix dimensions, easy aggregation and classification, The effect of improving the recognition accuracy

Pending Publication Date: 2022-02-08
JINPENG ELECTRONICS INFORMATION MACHINE
View PDF0 Cites 1 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] However, the existing recognition technology ignores the analysis of the sound signal, which limits the further improvement of the recognition accuracy. At present, there are very few researches on the recognition based on the fusion of audio and video features. The main difficulty encountered is that the features of different modalities are not easy to integrate. ;Secondly, the traditional technology needs to use a relatively complete image to analyze, but the monitoring system usually only collects the front and side images of the vehicle, which has fewer features and reduces the recognition accuracy; moreover, the traditional technology only uses traditional image processing and matching technology , difficult to fine-tune and do not have the ability to learn and grow

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Personnel and vehicle monitoring method and system based on capsule network
  • Personnel and vehicle monitoring method and system based on capsule network
  • Personnel and vehicle monitoring method and system based on capsule network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment 1

[0052] This embodiment provides a method for monitoring personnel and vehicles based on a capsule network. The method is applied in the field of security monitoring, and can precisely identify personnel identities and vehicle models, and realize the purpose of finding and tracking target persons and vehicles in a timely manner. Such as figure 1 , figure 2 As shown, the personnel vehicle monitoring method in this embodiment specifically includes the following steps:

[0053] Step S1: Collect monitoring audio and video, and separate the monitoring audio and video to obtain sound data and image data.

[0054]In this embodiment, video images can be collected by monitoring equipment such as cameras, and on-site audio needs to be included in the video images, so that the monitoring audio and video include image data and sound data; wherein, the sound data includes personnel natural voice information, such as the tone of speech , timbre, accent, etc.; sound data also includes vehi...

Embodiment 2

[0103] This embodiment provides a system for monitoring personnel and vehicles based on a capsule network, which implements the method for monitoring personnel and vehicles based on a capsule network as described in Embodiment 1, such as Figure 5 As shown, its monitoring system includes:

[0104] The monitoring audio and video processing module is used to obtain monitoring audio and video, and separate the monitoring audio and video to obtain sound data and image data;

[0105] The feature extraction module is used to perform low-level feature extraction on sound data and image data to obtain spectrograms and image feature maps, and then perform abstract feature processing on the spectrogram and image feature maps, and abstract sound features obtained by abstract feature processing Graph and abstract image feature map are fused to obtain a feature fusion vector;

[0106] The capsule network processing module is used to utilize the capsule network to process the feature fusio...

Embodiment 3

[0114] This embodiment provides an electronic device, which includes a processor, a memory, and a computer program stored on the memory and operable on the processor. When the processor executes the computer program, the first embodiment is implemented. The method for monitoring personnel and vehicles based on the capsule network; in addition, this embodiment also provides a storage medium on which a computer program is stored, and when the computer program is executed, the above method for monitoring personnel and vehicles based on the capsule network is realized.

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a personnel and vehicle monitoring method and system based on a capsule network, and the method comprises the steps: collecting monitoring audios and videos, and separating the monitoring audios and videos to obtain sound data and image data; performing feature extraction on the sound data and the image data, wherein the feature extraction comprises extraction of low-level features and extraction of high-level abstract features; fusing the abstract features of the sound and the image obtained after feature extraction to generate a feature fusion vector, and processing the feature fusion vector by using a capsule network to identify feature information of personnel and vehicles in the monitored audio and video; and performing data comparison processing on the identified feature information of the personnel and the vehicle and pre-registration information to output monitoring results of the target personnel and the target vehicle. According to the method and system, target identification and classification are carried out by using image features and sound features, so that the identification accuracy can be obviously improved, and an accurate identification result is finally obtained.

Description

technical field [0001] The invention relates to the technical field of security monitoring, in particular to a method and system for monitoring personnel and vehicles based on a capsule network. Background technique [0002] With the continuous acceleration of the urbanization process in our country, the security monitoring and emergency management of urban streets, industrial parks, and residential quarters are important tasks related to social security and stability. In this field, it is an important method to improve the level of security monitoring, and it is also the main direction of technological development, to monitor personnel, vehicles, and the relationship between them, and to find abnormal information in time and give an alarm. [0003] Existing recognition technologies mostly use the single-modal recognition method of visual feature analysis to identify the facial features and clothing features of people; but in practice, most surveillance audio and video canno...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06V10/774G06V10/46G06V20/52G06K9/62G06N3/04G10L25/51G10L25/30G10L25/18
CPCG10L25/51G10L25/30G10L25/18G06N3/045G06F18/253
Inventor 周云飞曹志雷魏一
Owner JINPENG ELECTRONICS INFORMATION MACHINE
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap