The invention discloses a virtual character driving method based on real-time facial feature point detection and Kalman filtering, and the performance of virtual character driving is improved through the four aspects of multi-stage
data optimization, high-robustness feature point selection, a lightweight communication protocol and
time sequence association optimization. A two-stage filtering framework is combined with Kalman filtering and PD control, real-time denoising and
smoothing are carried out on coordinates of feature points,
jitter is effectively restrained, stability is improved, and therefore the problem of tracking
instability of a traditional method in a fast movement or shielding scene is solved. Then, by selecting high-stability feature points and combining improved dynamic mixed function design, the adaptability of the
system to complex scenes is enhanced, meanwhile, feature point detection errors are reduced, and cross-domain generalization performance is improved; then, a lightweight binary communication protocol and an efficient real-time driving architecture are designed,
data transmission efficiency and model calculation performance are optimized,
millisecond-level interaction requirements are met, the CPU
occupancy rate is reduced, and high-frame-rate operation of a mobile terminal is supported.