Video-based human body action recognition method and device, medium and electronic device

A technology for human action recognition and electronic equipment, which is applied in the field of computer vision and can solve the problems of low accuracy and poor action recognition effect.

Pending Publication Date: 2021-04-13
YITU PTE LTD
View PDF0 Cites 14 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] In the existing scheme, the features of some areas in the picture are directly extracted for action recognition, but the direct and simple extraction of features of some areas of the image may not be able to better reflect the action characteristics of the human body in the video frame scene, resulting in the effect of action recognition Not good, low accuracy

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Video-based human body action recognition method and device, medium and electronic device
  • Video-based human body action recognition method and device, medium and electronic device
  • Video-based human body action recognition method and device, medium and electronic device

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0043] Illustrative embodiments of the present application include, but are not limited to, video-based human action recognition methods and devices, media, and electronic devices thereof.

[0044] The video-based human action recognition method based on video in this application is suitable for various video processing, especially the scene of video processing of crowded scenes, for example, this scene is applied to robot vision processing, video surveillance and human action recognition, animal action In terms of recognition, it is specifically used for pedestrian action recognition on the road, and dangerous action recognition in special scenes.

[0045] The video-based human action recognition method disclosed in this application can first extract the behavior representation information of the human body instance in the video frame through the action detection model, and then combine the human body detection model to extract the position of the human body instance in the vi...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention relates to the field of computer vision, and particularly discloses a video-based human body action recognition method and device, a medium and an electronic device. The video-based human body action recognition method comprises the steps of obtaining multiple frames of multi-human body images in a video, wherein each frame of multi-human body image comprises multiple human body instances; generating a detection human body bounding box of a human body instance in each frame of multi-human body image; determining an image scene of each frame of multi-human body image, wherein one image scene corresponds to one or more types of actions; based on the detection human body bounding box and the image scene of the multi-frame multi-human body image, identifying the action of the human body instance in the multi-frame multi-human body image, and post-processing the action category and probability of the human body instance through the surrounding environment characteristics in the video frame of the human body instance in the video clip, so that the accuracy of the finally predicted action category of the human body instance is higher.

Description

technical field [0001] The present application relates to the field of computer vision, and in particular discloses a video-based human action recognition method, device, medium and electronic equipment. Background technique [0002] In many scenarios, it is necessary to recognize human actions in a video to determine the action type of the human action. For example, in a monitoring system, in order to perceive human intentions, it is necessary to recognize human actions in the video captured by the monitoring system; in a human-computer interaction system, in order to understand human behavior, it is necessary to recognize Human motion recognition in videos. [0003] In order to realize the recognition of human body movements in the video, the existing scheme is to extract some frames of pictures from the video to be processed, and then use the convolutional neural network to extract the features of the pictures, and then according to the position of the human body extract...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06K9/34G06K9/62G06N3/04G06N3/08G06T7/269
CPCG06N3/084G06T7/269G06T2207/10016G06T2207/30196G06T2207/30232G06V40/23G06V10/267G06N3/048G06N3/045G06F18/214G06F18/24
Inventor 袁粒陈云鹏周奕臣黄子渊冯佳时
Owner YITU PTE LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products