3D AI Avatar Interaction via Active Speaker Recognition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing avatars are primarily two-dimensional and lack the ability to naturally communicate with humans, failing to provide a realistic and interactive experience.
Innovation Solution
An artificial intelligence avatar-based interaction service method that utilizes an unmanned information terminal with a microphone array and vision sensor, and an interaction service device that processes sound and image signals to recognize active speakers and generate responses, rendering a 3D AI avatar for natural interaction.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If two-dimensional avatars are used, then the system complexity is low, but the realism and natural communication ability are insufficient
Solution Approach 1:
The patent transitions from two-dimensional avatars to three-dimensional avatars, adding spatial depth and realism. The 3D avatar includes a head, body, and limbs that can be rendered in three-dimensional space, enabling more natural human-like appearance and interaction while maintaining manageable system complexity through structured modeling approaches.
Solution Approach 2:
The patent replaces traditional mechanical animation systems with AI-driven technologies. Deep learning models analyze user images and audio to automatically generate avatar expressions, gestures, and responses, substituting complex manual animation mechanisms with intelligent automated systems that achieve more natural communication.
2Reliability
If 3D rendering and AI processing are added, then the realism and interaction quality improve, but the processing time and computational resources increase
Solution Approach 1:
The system performs preliminary actions by pre-processing user images and audio data before generating avatar responses. The deep learning models are pre-trained on extensive datasets, allowing rapid inference during actual interaction.预处理 steps include image normalization, audio feature extraction, and response template preparation, which reduce real-time computational burden.
Solution Approach 2:
The patent uses copying by generating virtual representations of user expressions and gestures through deep learning. Instead of directly capturing every facial muscle movement and gesture in real-time, the system creates simplified digital copies of user states from images and audio, reducing the complexity of real-time rendering while maintaining interaction quality.
3Measurement precision
If multiple sensors and AI processing units are deployed, then the active speaker recognition accuracy improves, but the device complexity increases
Solution Approach 1:
The patent merges multiple sensing functions into an integrated system. The terminal device combines image capture, audio recording, and deep learning processing in a unified architecture, where the AI processing unit simultaneously handles image analysis, audio feature extraction, and speaker recognition. This consolidation reduces overall system complexity compared to separate dedicated systems while maintaining high recognition accuracy.
Data Source
AI summary
Artificial intelligence avatar-based interaction service is performed in a system including an unmanned information terminal and an interaction service device. A sound signal is collected from a microphone array mounted in the unmanned information terminal and an image signal collected from a vision sensor to the interaction service device. A sensing area is set based on the received sound signal and image signal by the interaction service device; recognizing an active speaker based on a voice signal of a user and an image signal of the user collected in the sensing area, by the interaction service device. A response for the recognized active speaker is generated to provide a 3D rendering an artificial intelligence avatar to which the response is reflected. The rendered artificial intelligence avatar is provided to the unmanned information terminal by the interaction service device.