The invention discloses a method of restoring a three-dimensional
human body posture from an unmarked
monocular image in combination with a
height map. The method comprises the following steps: 1) a
color image and a height image are used for training to obtain a deep convolutional network-based two-dimensional
joint point recognition model; 2) a video frame
image sequence and a camera parameter are inputted, and a
height map corresponding to each frame of image is calculated; 3) the video frame image and the
height map obtained in the second step are inputted, and the two-dimensional
joint point recognition model obtained through training the first step is used to obtain two-dimensional
joint point coordinates of a
human body in each frame of image; and 4) the two-dimensional joint point coordinates obtained in the third step are inputted, and the
human body three-dimensional posture is restored according to an optimization model. During the two-dimensional joint point recognition process, the
color image and the height image are used integrally, and the two-dimensional joint point recognition accuracy is improved; and
time sequence consistency constraints are added to the optimization model which can restore the three-dimensional human
body posture from the two-dimensional joint point, and thus the restored three-dimensional human
body posture is closer to the real human
body posture.