A multi-person pose estimation method based on mask perceptual depth reinforcement learning

A technology of reinforcement learning and attitude estimation, which is applied in computing, computer components, biometric identification, etc., can solve problems such as unknown number of people, difficult estimation, unfavorable detection results, etc.

Active Publication Date: 2019-01-11
杭州云栖智慧视通科技有限公司
View PDF11 Cites 25 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

However, multi-person pose estimation, i.e. judging the poses of multiple people in an image, especially estimating individuals in a crowd, remains a challenging task
The main difficulties of this task are as follows: First, the number of people in the image is unknown, and the people may appear in any position or in any proportion of the image
Second, there is some t

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • A multi-person pose estimation method based on mask perceptual depth reinforcement learning
  • A multi-person pose estimation method based on mask perceptual depth reinforcement learning
  • A multi-person pose estimation method based on mask perceptual depth reinforcement learning

Examples

Experimental program
Comparison scheme
Effect test

Embodiment Construction

[0064] In order to describe the present invention more specifically, the technical solutions of the present invention will be described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0065] The multi-person pose estimation method provided in this embodiment can obtain position and pose information of a non-fixed number of people in an image, and can be applied to multimedia industries such as clinical analysis, human-computer interaction, and behavior recognition.

[0066] In this embodiment, the positioning detection frame and mask are obtained based on the multi-task learning network, the deep reinforcement learning network is used to calibrate the positioning, and finally the human body pose estimation is performed on the person in the detection frame using the single person pose estimation network. The specific embodiments of the present invention will be described below in conjunction with the accompanying drawings.

[0067] fig...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a multi-person pose estimation method based on mask perceptual depth reinforcement learning. Firstly, a multi-person pose estimation model is constructed. The multi-person poseestimation model is composed of a detection network for acquiring a detection frame and a mask, a depth reinforcement learning network for improving the positioning accuracy, and a single-person poseestimation network. Then the multi-character pose estimation model is trained by training samples. During the test, the images to be detected are input into the trained multi-person pose estimation model to obtain the pose of all the detection frames of the images to be detected. The method of the invention introduces the mask information into the depth reinforcement learning network and the single-person attitude estimation network, improves the effects of the two stages, and solves the problems of gradient disappearance and gradient explosion by using the residual structure. The method of the invention is more competitive than other advanced multi-character posture estimation methods.

Description

technical field [0001] The invention relates to human body pose estimation technology, in particular to a multi-person pose estimation method based on mask perception depth reinforcement learning. Background technique [0002] With the deployment of a large number of multimedia sensors and the wide application of motion capture technologies such as fashion design, clinical analysis, human-computer interaction, behavior recognition, and sports rehabilitation, human body pose estimation has become a hot spot in the multimedia industry. [0003] Recently, significant progress has been made in single-person pose estimation by employing deep learning-based architectures. However, multi-person pose estimation, that is, judging the poses of multiple people in an image, especially estimating individuals in a crowd, remains a challenging task. The main difficulties of this task are as follows: First, the number of people in the image is unknown, and the people may appear in any posi...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
IPC IPC(8): G06K9/00G06N3/04
CPCG06V40/10G06N3/045
Inventor 田彦王勋吴佳辰
Owner 杭州云栖智慧视通科技有限公司
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products