Human body posture estimation method, device and equipment and storage medium

A technology of human posture and limbs, applied in the field of image processing, can solve problems such as low efficiency and high cost, and achieve the effects of shortening time-consuming, improving efficiency, and high-efficiency estimation

Active Publication Date: 2020-06-16
BEIJING BAIDU NETCOM SCI & TECH CO LTD
View PDF7 Cites 4 Cited by
  • Summary
  • Abstract
  • Description
  • Claims
  • Application Information

AI Technical Summary

Problems solved by technology

[0004] However, the method used in the prior art to obtain the depth information of the key points of the human body is costly and inefficient

Method used

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
View more

Image

Smart Image Click on the blue labels to locate them in the text.
Viewing Examples
Smart Image
  • Human body posture estimation method, device and equipment and storage medium
  • Human body posture estimation method, device and equipment and storage medium
  • Human body posture estimation method, device and equipment and storage medium

Examples

Experimental program
Comparison scheme
Effect test

no. 1 example

[0071] figure 1 It is a schematic flowchart of a method for estimating a human body pose according to the first embodiment of the present application. This embodiment is used for estimating the pose of a person in an image, and the method can be executed by a device for estimating a human body pose. The device can be realized by means of software and / or hardware, and can be integrated into electronic equipment, and the electronic equipment can be equipment such as a mobile terminal or a computer. like figure 1 As shown, a human body pose estimation method provided in this embodiment may include:

[0072] S110. Input the picture to be estimated into the pre-trained deep learning network, and obtain the depth map corresponding to the picture to be estimated output by the deep learning network and the key point heat map corresponding to each body part. The picture to be estimated may be an RGB picture.

[0073] Among them, the deep learning network is pre-trained so that the d...

no. 2 example

[0091] Figure 5 It is a schematic flowchart of a method for estimating human body pose according to the second embodiment of the present application. This embodiment is a further optimization of the above-mentioned embodiment, and it is used for estimating the pose of a person in an image. The method can be composed of a The human body posture estimation device can be implemented, and the device can be realized by software and / or hardware, and can be integrated into electronic equipment. like Figure 5 As shown, a human body pose estimation method provided in this embodiment may include:

[0092] S510. Input the picture to be estimated into the pre-trained deep learning network, and obtain the depth map corresponding to the picture to be estimated output by the deep learning network, the key point heat map corresponding to each limb part, and the key point connection corresponding to each limb part pair respectively Relationship heat map.

[0093] Among them, the deep lear...

no. 3 example

[0110] Figure 8 It is a schematic structural diagram of a human body pose estimation device according to the third embodiment of the present application, which can execute the human body pose estimation method provided in the embodiment of the present application, and has corresponding functional modules and beneficial effects for executing the method. like Figure 8 As shown, the device 800 may include:

[0111] The depth map and key point heat map output module 801 is used to input the picture to be estimated into the pre-trained deep learning network, and obtain the depth map corresponding to the picture to be estimated output by the deep learning network and the key point heat map corresponding to each body part ;

[0112] The key point information determination module 802 is used to determine the two-dimensional information of the key points of each limb part according to the heat map of each key point, and determine the depth information of the key points according to...

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

PUM

No PUM Login to view more

Abstract

The invention discloses a human body posture estimation method, device and equipment and a storage medium, and relates to the technical field of computers, in particular to the technical field of image processing. According to the specific implementation scheme, a to-be-estimated picture is input into a pre-trained deep learning network, a depth map corresponding to the to-be-estimated picture andkey point thermodynamic diagrams corresponding to all limb parts, which are output by the deep learning network, are obtained, two-dimensional information of the key points of the limb parts is determined according to the key point thermodynamic diagrams, depth information of the key points is determined according to the depth map, and the two-dimensional information and the depth information ofthe key points are output as a human body posture estimation result. The depth map and the key point thermodynamic diagram are output through the deep learning network, the three-dimensional information including the two-dimensional information and the depth information is obtained according to the depth map and the key point thermodynamic diagram, comprehensive understanding of the human body posture is achieved, and the accuracy of human body posture estimation is improved.

Description

technical field [0001] The present application relates to computer technology, in particular to the field of image processing, and in particular to a human body pose estimation method, device, equipment and storage medium. Background technique [0002] Human body pose estimation refers to locating the key points of the human body for a given image or video, so as to obtain the pose of the human body in the image or video. [0003] In the prior art, the key point information of the human body of the person in the picture is obtained through a deep learning model, and the key point information of the human body includes the two-dimensional coordinates of the key point of the human body. If it is necessary to obtain the depth information of the key points of the human body, it is necessary to use TOF (Time of Flight, infrared depth sensor), structured light or binocular imaging method to obtain the depth information of the key points of the human body. [0004] However, the me...

Claims

the structure of the environmentally friendly knitted fabric provided by the present invention; figure 2 Flow chart of the yarn wrapping machine for environmentally friendly knitted fabrics and storage devices; image 3 Is the parameter map of the yarn covering machine
Login to view more

Application Information

Patent Timeline
no application Login to view more
Patent Type & Authority Applications(China)
IPC IPC(8): G06K9/00G06T7/50G06N3/04
CPCG06T7/50G06T2207/20081G06T2207/20084G06V40/20G06V40/10G06N3/045
Inventor 宫延河赵晨
Owner BEIJING BAIDU NETCOM SCI & TECH CO LTD
Who we serve
  • R&D Engineer
  • R&D Manager
  • IP Professional
Why Eureka
  • Industry Leading Data Capabilities
  • Powerful AI technology
  • Patent DNA Extraction
Social media
Try Eureka
PatSnap group products

Browse by: Latest US Patents, China's latest patents, Technical Efficacy Thesaurus, Application Domain, Technology Topic.

© 2024 PatSnap. All rights reserved.Legal|Privacy policy|Modern Slavery Act Transparency Statement|Sitemap