The invention discloses a
digital human live broadcast
microphone connection and video generation method based on
computer vision, and belongs to the technical field of
artificial intelligence, and the method comprises the following steps: 1, real-time vision capture and action expression driving: employing a
computer vision tool to carry out face key point detection, facial feature points of lips, eyes and the like of a live anchor or a
microphone-connected guest are accurately captured; and then a voice conversion model is matched,
microphone-connected audio features and lip key point movement are bound, precise synchronization of the sound and the lip is achieved, and for limb actions,
limb joint data can be collected through a
monocular camera in combination with a posture
estimation algorithm or a simple action capture device and mapped to a
digital human skeleton model. According to the
digital human live broadcast microphone connection and video generation method based on
computer vision, through multi-dimensional
technical innovation and systematic design, the problems of insufficient sense of reality, interaction lagging, poor scene adaptability and the like existing in current digital human application are effectively solved.