Intelligent question answering method and device based on H5, electronic equipment and storage medium

Abstract

The invention provides an H5-based intelligent question answering method and device, electronic equipment and a storage medium, and the method comprises the steps: receiving a control triggering message sent by a user based on an H5 control, the control triggering message at least comprising a target question; obtaining reply audio data corresponding to the target question; processing the reply audio data to obtain corresponding mouth shape data; and sending the reply audio data and the mouth shape data to a client UE, so that the client UE renders the mouth shape action of the digital virtual human based on the mouth shape data and the reply audio data to obtain a corresponding video stream, and sending the video stream to the H5 control for display. According to the method and the device, the electronic equipment and a storage medium, the problem of poor user experience caused by a certain error between the mouth shape action of a digital virtual person during speaking and the mouth shape action of a real person during speaking in the prior art can be solved.

Description

technical field [0001] The present invention relates to the field of computer technology, more specifically, to an H5-based intelligent question answering method, device, electronic equipment and storage medium. Background technique [0002] Digital Human (Digital Human) is a realistic three-dimensional human produced by virtual reality technology, combined with human-computer interaction, high-precision three-dimensional portrait simulation, AI, motion capture, facial expression capture and other technologies. Among them, the production of mouth movements when speaking is the focus and difficulty of digital virtual human performance. [0003] In the prior art, the facial expression capture equipment is often used to capture the mouth movements of real people when they speak, and then apply these mouth movements to digital virtual humans through 3D production tools, so that the digital virtual human can speak with mouth. Actions look like real people. However, in this way,...

AI Technical Summary

Problems solved by technology

[0004] In view of this, the present application provides an H5-based intelligent question-and-answer method, device, electronic equipment, and storage medium to solve the problem that there is a certain error between the mouth movements of the digital virtual human and the mouth movements of the real person in the prior art. , resulting in poor user experience

Images