Hand pose estimation method, apparatus, and head-mounted display device

Abstract

This invention provides a hand pose estimation method, apparatus, and head-mounted display device, relating to the field of human-computer interaction technology. The method includes: determining the pixel position and relative distance of each hand joint point, and the curvature of each finger, based on a binocular image of the hand; determining optimization variables for the hand pose based on the curvature of each finger; generating an optimization function for the hand pose based on the optimization variables, the pixel position and relative distance of each hand joint point, and the curvature of each finger; and iteratively optimizing the hand pose using the optimization function to obtain the hand pose estimation result. This invention improves the accuracy of hand pose estimation by combining the pixel position and relative distance of each hand joint point, as well as the curvature of the fingers, to iteratively optimize the hand pose.

Images