The invention discloses a method of restoring a three-dimensional 
human body posture from an unmarked 
monocular image in combination with a 
height map. The method comprises the following steps: 1) a 
color image and a height image are used for training to obtain a deep convolutional network-based two-dimensional 
joint point recognition model; 2) a video frame 
image sequence and a camera parameter are inputted, and a 
height map corresponding to each frame of image is calculated; 3) the video frame image and the 
height map obtained in the second step are inputted, and the two-dimensional 
joint point recognition model obtained through training the first step is used to obtain two-dimensional 
joint point coordinates of a 
human body in each frame of image; and 4) the two-dimensional joint point coordinates obtained in the third step are inputted, and the 
human body three-dimensional posture is restored according to an optimization model. During the two-dimensional joint point recognition process, the 
color image and the height image are used integrally, and the two-dimensional joint point recognition accuracy is improved; and 
time sequence consistency constraints are added to the optimization model which can restore the three-dimensional human 
body posture from the two-dimensional joint point, and thus the restored three-dimensional human 
body posture is closer to the real human 
body posture.