The invention discloses a
digital human rendering method based on
Gaussian splashing and multi-scale characteristic field
distillation, and belongs to the field of three-dimensional
human body digital reconstruction. According to the method,
feature extraction is carried out through a Vision
Transformer encoder, based on an SMPL model, through a cross-
modal parameter
estimation module and dynamic
human body modeling of three-dimensional
Gaussian splashing and
semantic feature rendering, three-dimensional
Gaussian is projected to a two-dimensional
image plane to calculate a
covariance matrix and
color mixing, and after a rendered
color image and an initial feature field image are output, a three-dimensional image is obtained. A student feature map is obtained through a
convolution acceleration module, a teacher feature map is obtained after
feature extraction is carried out through a two-dimensional basic model, the constructed model is trained, and optimization training is completed through comprehensive total
loss function calculation; according to the method, the problems of fuzzy
semantics, detail missing, low rendering efficiency and inaccurate
human body-scene separation in the existing method are effectively solved, so that more efficient, fine and robust
monocular or multi-view human body three-dimensional reconstruction is realized.