Digital human and multi-person collaborative interaction method and device, and storage medium

Abstract

The present application relates to a digital person and a multi-person cooperative interaction method, device and storage medium, wherein the digital person is set to interact with a first dialogue object by default in one-to-one mode, to introduce a target object to a second dialogue object through the first dialogue object and the digital person; when the second dialogue object asks a question, an audio signal is collected based on a directional sound pickup device or a directional sound pickup device worn by the first dialogue object, the system performs sound source positioning, dialogue person identification and instruction keyword identification according to the audio signal, to identify an interaction instruction issued by the first dialogue object from the simultaneous speech of the first dialogue object and the second dialogue object; the digital person is controlled to enter an interaction state corresponding to the interaction instruction, to control the digital person and the multi-person to cooperatively interact. By introducing the interaction instruction and the interaction state, the digital person can correctly identify and respond to the speaking object in multi-person communication, realize natural communication of the digital person in a multi-person scene, and improve the naturalness and cooperativeness of the digital person interaction.

Images