Device for Creating Digital Persona
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing virtual character synthesis technologies lack a comprehensive framework to integrate appearance, voice, and personality characteristics, limiting their realism and interactive capabilities, especially in scenarios requiring high personalization and realism.
Innovation Solution
A device integrating a data collection module, personality training module, appearance video generation module, voice generation module, and lip synchronization module, utilizing large language models, face replacement, voice cloning, and lip synchronization technologies to create and interact with digital personas that mimic the appearance, voice, and personality of a target object.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If multiple technologies are combined to create and optimize virtual characters, then the realism and interactivity of virtual characters is improved, but the device complexity increases
Solution Approach 1:
The system is divided into five independent functional modules: data collection module, personality training module, appearance video generation module, voice generation module, and lip synchronization module. Each module handles a specific aspect of virtual character creation, allowing for modular development, easier maintenance, and independent optimization of each component while achieving comprehensive functionality through their integration.
2Adaptability or versatility
If existing virtual character synthesis technologies are used individually, then the appearance, voice or personality characteristics can be generated, but a comprehensive framework to integrate these different elements is lacking
Solution Approach 1:
The patent merges five separate technologies (data collection, personality training, appearance video generation, voice generation, and lip synchronization) into a single integrated framework. The modules are connected through a unified processing flow where output from one module serves as input to the next, creating a cohesive system that comprehensively generates virtual characters with consistent appearance, voice, and personality characteristics.
3Reliability
If virtual characters are created with natural interactive capabilities, then the personalization and realism are improved, but the difficulty of creating such characters increases
Solution Approach 1:
The system performs preliminary data collection and processing before the main generation process. The data collection module gathers and pre-processes raw data about the target individual, and the personality training module pre-trains the virtual character's personality model. These preliminary actions prepare all necessary materials in advance, making the subsequent generation process more efficient and reducing the overall difficulty of creating highly personalized and realistic virtual characters.
Data Source
AI summary
A device for creating digital persona, which includes a data collection module responsible for collecting personality data of a target object, a personality training module utilizing a large language model and the personality data to train and generate a virtual personality model with personality characteristics of the target object, thereby generating a virtual personality consistent with the personality characteristics of the target object, an appearance video generation module and voice generation module respectively utilizing face replacement and voice cloning technologies to extract the pictures and sounds from the personality data to generate a virtual personality model with the appearance and voice characteristics of the target object, a lip synchronization module, utilizing lip synchronization technology to ensure that the mouth shape and voice of the digital persona are synchronized, and an interactive module, providing an interactive interface that allows users to interact with the virtual personality and receive responses from it.