Avatar Mouth Shape Processing for Real-Time Voice Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems struggle to synchronize the display of avatars' mouth movements with voice data in real-time, leading to delays and inaccuracies in virtual environments.
Innovation Solution
An electronic device employs multiple processing circuits with varying speeds to identify voice data features and generate mouth shapes, allowing for synchronized and accurate display of avatars' mouth movements based on voice information.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single processing circuit is used to process voice data and generate mouth shapes, then the device complexity is reduced, but the synchronization accuracy and processing speed deteriorate
Solution Approach 1:
The patent divides the processing circuit into multiple specialized circuits (first processing circuit for feature value identification, second processing circuit for mouth shape identification) that work in parallel. Each circuit is optimized for its specific function, enabling simultaneous processing of different aspects of voice data without interfering with each other, thus improving synchronization accuracy while maintaining manageable device complexity.
Solution Approach 2:
The patent introduces a control circuit that acts as an intermediary to coordinate between the first processing circuit (feature extraction) and the second processing circuit (mouth shape generation). The control circuit manages data flow and timing synchronization between these circuits, ensuring that mouth shapes are generated and displayed in precise synchronization with voice data without requiring a single complex processing unit.
2Productivity
If high-speed processing circuits are used for real-time voice processing, then the processing speed is improved, but the energy consumption increases
Solution Approach 1:
The patent segments the processing workload across multiple specialized circuits, each handling specific tasks (feature extraction, mouth shape generation, synchronization). This division allows the system to use high-speed processing only where necessary while using lower-power circuits for other tasks, reducing overall energy consumption compared to using a single high-performance processor for all operations.
Solution Approach 2:
Each processing circuit is designed to autonomously perform its specific function with minimal intervention from the main processor. The first processing circuit independently extracts feature values, the second circuit independently generates mouth shapes, and the control circuit independently manages synchronization. This self-service capability reduces the need for continuous high-power processing and allows circuits to enter low-power states when not actively processing.
Data Source
AI summary
An electronic device may comprise a display, a memory storing instructions, and at least one processor comprising processing circuitry. The instructions, when executed individually and/or collectively by the at least one processor, may cause the electronic device to: identify a first processing speed of each of a plurality of processing circuits for processing the voice data; with regard to mouth shape identification of the voice data, identify a second processing speed of each of the plurality of processing circuits; obtain voice information from the outside of the electronic device while displaying an avatar; obtain a plurality of feature values of the voice information using a first processing circuit identified on the basis of the first processing speed; obtain information for generating mouth shapes on the basis of the plurality of feature values, using a second processing circuit identified based on the second processing speed; and display, through the display, the avatar including the mouth shapes generated based on the information.