Video processing method, device and system, terminal equipment and storage medium

Abstract

The embodiment of the invention discloses a video processing method and device, terminal equipment and a storage medium. The method comprises the steps of obtaining a to-be-processed video; obtaininga target audio clip and a face image sequence in the to-be-processed video; performing emotion analysis on the face image sequence to obtain emotion features; performing voice analysis on the target audio clip to obtain statement features which are used for representing keywords in the target audio clip; based on the emotional characteristics and the statement characteristics, determining reply contents and expression behaviors of the virtual character; and generating and outputting a reply video for the to-be-processed video, wherein the reply video comprises voice content corresponding to the reply content and a virtual character for executing the expression behavior. According to the embodiment of the invention, the emotional characteristics and the statement characteristics of the character can be obtained according to the speaking video of the character, and the virtual character video matched with the emotional characteristics and the statement characteristics is generated as thereply, so that the sense of reality and naturalness of human-computer interaction are improved.

Description

technical field [0001] The embodiments of the present application relate to the technical field of human-computer interaction, and more specifically, to a video processing method, device, system, terminal device, and storage medium. Background technique [0002] With the development of artificial intelligence-related technologies, the functions of robot customer service are becoming more and more powerful, and there are more and more scenarios that can be applied, which greatly improves the efficiency of customer service and saves human resources. However, the current robot customer service mostly communicates with users through text, the interaction method is relatively simple, and the accuracy of semantic understanding is not high. Although some robot customer service can communicate with users face to face, their facial expressions are relatively mechanical and lack vividness, which greatly reduces the user experience. Contents of the invention [0003] In view of the ...

AI Technical Summary

Problems solved by technology

However, the current robot customer service mostly communicates with users through text, the interaction method is relatively simple, and the accuracy of semantic understanding is not high

Although some robot customer service can communicate with users face-to-face, their facial expressions are relatively mechanical and lack vividness, which greatly reduces the user experience.

Images