The invention provides a self-supervised continuous 3D hand posture tracking method based on a lightweight
inertial measurement unit, and the method specifically comprises the following steps: firstly, obtaining a
hand motion signal by using a lightweight
consumer-level IMU, and extracting features by using a multi-stage neural network containing a bidirectional long-
short term memory (Bi-LSTM) module; the global displacement and orientation of the hand are processed through a
wrist posture
estimation module, and three-dimensional coordinates of
hand skeleton points are solved and calculated by means of a finger motion chain; secondly, a self-supervised completion network is realized by combining a random
mask and dual loss, and the features are processed to complete complete attitude reconstruction; and finally, combining
network output with
kinematics prior, generating a three-dimensional grid with reasonable
anatomy, solving the problem that joint deformation is inconsistent with torque, and realizing accurate acquisition of a three-dimensional hand posture. For a dynamic
hand motion tracking task, the method can adapt to a sparse IMU deployment scene and realize continuous high-precision tracking; the real-time performance demand of daily interaction can be met, and a low-cost solution can be provided for the fields such as
medical rehabilitation and
virtual interaction which have strict requirements on attitude precision.