Digital Human Mode Switching for Unstable Video Links
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Digital human communication experiences frame freezing and deformation due to poor communication quality, primarily caused by channel instability and large video data transmission issues.
Innovation Solution
Switch from video driving to audio driving when network quality deteriorates, using video data for driving when connection is normal and switching to audio driving when connection is abnormal, ensuring smooth display and avoiding frame freezing or deformation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If video data is transmitted for driving the digital human model, then the expression and action of the digital human can completely follow the actual human movement, but the channel stability deteriorates due to large data volume and wireless transmission issues
Solution Approach 1:
The patent dynamically changes the driving data source parameter based on network conditions. When network quality is good, video data is used for high-precision driving; when network quality deteriorates, the system switches to audio stream driving, changing the parameter of driving data type to maintain system reliability while adapting to channel conditions
Solution Approach 2:
The patent implements a dynamic switching mechanism between video driving and audio driving modes. The system continuously monitors network quality and dynamically adjusts the driving source, transitioning from static single-mode driving to dynamic multi-mode driving based on real-time channel conditions
2Ease of operation
If video driving is used to improve viewing experience, then the digital human display is more realistic, but frame freezing and deformation occur when network quality deteriorates
Solution Approach 1:
The patent prepares multiple driving modes (video driving and audio driving) in advance to cushion against network quality deterioration. By having audio driving as a pre-prepared backup scheme, the system can smoothly transition when video transmission fails, preventing frame freezing and deformation before they occur
3Reliability
If audio driving is used instead of video driving, then channel stability is maintained, but the expression and action following accuracy is reduced
Solution Approach 1:
The patent makes the digital human driving system universal by supporting multiple driving modes (both video driving and audio driving). The system can function effectively in different network conditions by selecting the appropriate driving mode, making it adaptable to various channel qualities without losing core functionality
Data Source
AI summary
A digital human communication method and apparatus. In a process in which a media server drives a digital human model based on video data captured by a first terminal device, in response to a communication connection to the first terminal device being abnormal, the media server switches to drive, by using an audio stream captured by the first terminal device, the digital human model to generate a video stream to be sent to a second terminal device.