Unlock instant, AI-driven research and patent intelligence for your innovation.

Human body behavior recognition method based on interlaced attention enhancing network

A recognition method and attention technology, applied in the field of video processing, can solve the problems of ignoring local detail information of video frames, interference of background information information, and insufficient behavior recognition ability.

Active Publication Date: 2021-02-02
XIDIAN UNIV
View PDF2 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0005] The purpose of the present invention is to address the deficiencies in the above-mentioned prior art, and propose a human behavior recognition method based on interlaced enhanced attention network, which is used to solve the problem that the prior art ignores the local detail information in the video frame, which is easy to be detected in the video. There is a large amount of redundant background information and information interference irrelevant to behavior, which leads to the problem of insufficient recognition ability of behavior

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body behavior recognition method based on interlaced attention enhancing network
  • Human body behavior recognition method based on interlaced attention enhancing network
  • Human body behavior recognition method based on interlaced attention enhancing network

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0052] The present invention will be further described below in conjunction with the accompanying drawings.

[0053] refer to figure 1 , to further describe the specific steps of the present invention.

[0054] Step 1. Generate a training set.

[0055] Select RGB videos containing N behavior categories in the video data set, where N>50, each category contains at least 100 videos, and each video has a certain behavior category.

[0056] Divide each video into 3 segments of equal length, randomly select 1 frame of RGB image in each segment, fix the size of RGB image to 256×340 pixels, and then perform preprocessing by corner cropping, random horizontal flipping, and scale shaking , to get 10 frames of RGB images with a size of 224×224 pixels. Corner cropping refers to selecting a certain size area in the center and four corners of the image for cropping, random horizontal flipping refers to randomly flipping the horizontal direction of the image, and scale jittering refers to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

PUM

No PUM Login to View More

Abstract

The invention provides a human body behavior recognition method based on an interlaced attention enhancing network, and solves the problems that local information is ignored in the prior art and is easily interfered by a large amount of redundant background information and information irrelevant to behaviors in a video, and the behavior recognition capability is insufficient. The method comprisesthe following steps: (1) generating a training set; (2) obtaining a low-level feature map and a high-level feature map; (3) constructing a hierarchical complementary attention module; (4) constructinga local attention enhancing module; (5) establishing a classification network; (6) constructing an interlaced attention enhancing network; (7) constructing a loss function of the interlaced attentionenhancing network; (8) training an interlaced attention enhancing network; and (9) identifying behaviors in the video images. According to the method, the interlaced attention enhancing network and the loss function thereof are constructed, so that the accuracy of behavior recognition can be improved.

Description

technical field [0001] The invention belongs to the technical field of video processing, and further relates to a human behavior recognition method based on an interlaced enhanced attention network in the technical field of computer vision. The invention can be used to identify the behavior category of human body from video. Background technique [0002] In recent years, with the development of artificial intelligence and computer vision, video-based human behavior recognition has been widely used in intelligent video surveillance, human-computer interaction, unmanned driving and other technical fields. The main goal of human behavior recognition is to judge the category of human behavior in a video. Therefore, human behavior recognition can also be regarded as a classification problem in which the input is video and the output is behavior category. At present, convolutional neural network has become the mainstream method in human action recognition due to its powerful ima...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to View More

Application Information

Patent Timeline
no application Login to View More
IPC IPC(8): G06K9/00G06N3/04G06N3/08
CPCG06N3/084G06V40/20G06V20/41G06N3/045Y02D10/00
Inventor 同鸣金磊边放
Owner XIDIAN UNIV