Video-based behavior recognition method, behavior recognition device and terminal equipment

An identification method and identification device technology, applied in the field of computer vision, can solve the problems of complex background information and insufficient time series modeling ability.

Inactive Publication Date: 2020-01-31
SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
View PDF4 Cites 7 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In view of this, the present invention provides a video-based behavior recognition method, a behavior recognition device, a terminal device, and a computer-readabl

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video-based behavior recognition method, behavior recognition device and terminal equipment
  • Video-based behavior recognition method, behavior recognition device and terminal equipment
  • Video-based behavior recognition method, behavior recognition device and terminal equipment

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0024] In the following description, specific details such as specific system structures and technologies are presented for the purpose of illustration rather than limitation, so as to thoroughly understand the embodiments of the present invention. It will be apparent, however, to one skilled in the art that the invention may be practiced in other embodiments without these specific details. In other instances, detailed descriptions of well-known systems, devices, circuits, and methods are omitted so as not to obscure the description of the present invention with unnecessary detail.

[0025] It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the presence of described features, integers, steps, operations, elements and / or components, but does not exclude one or more other features. , whole, step, operation, element, component and / or the presence or addition of a collection thereof.

[0026] It should also be und...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention provides a video-based behavior recognition method, a video-based behavior recognition device, terminal equipment and a computer readable storage medium. The behavior recognition methodcomprises the steps of extracting a feature of a first full connection layer and a feature of a last convolution layer from an RGB frame of a video through a feature extractor; inputting the feature of the first full connection layer into a full connection long short-term memory network LSTM to carry out time sequence modeling, and inputting the feature of the last convolution layer into a convolution LSTM to carry out time sequence modeling; inputting the features subjected to time sequence modeling through the full-connection LSTM and the features subjected to time sequence modeling throughthe convolution LSTM into a joint optimization layer; and performing behavior identification on the RGB frame of the video through the joint optimization layer. The method can solve the problems thatan existing behavior recognition method is complex in background information, not high enough in time sequence modeling capacity and the like.

Description

technical field [0001] The invention belongs to the technical field of computer vision, and in particular relates to a video-based behavior recognition method, a behavior recognition device, terminal equipment and a computer-readable storage medium. Background technique [0002] Video action recognition is one of the most challenging problems in computer vision. Video behavior recognition is to use computer to automatically analyze video data to identify behavior categories. Video behavior recognition has important application value in many fields, such as intelligent video surveillance, video retrieval, human-computer interaction, etc. However, the existing behavior recognition methods have problems such as complex background information and insufficient ability to model time series. [0003] Therefore, it is necessary to propose a new technical solution to solve the above technical problems. Contents of the invention [0004] In view of this, the present invention pro...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/08G06V40/20G06V20/41G06V20/46G06N3/048G06N3/045
Inventor 徐洋洋王磊程俊
Owner SHENZHEN INST OF ADVANCED TECH CHINESE ACAD OF SCI
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap