Artificial Frame Generation for Video Call Continuity
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Network connectivity issues during video calls in advanced wireless communication systems, such as 4G LTE and 5G NR, can lead to interruptions and dropped frames, affecting the continuity of video calls and causing inconvenience to users, even if they do not experience connectivity issues themselves.
Innovation Solution
A method and apparatus that determine if a video call connection is interrupted, generate artificial frames based on received decoded frames and audio feeds, and establish a facial model call to maintain video call continuity, switching back to traditional video calls when connectivity is restored.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional video call methods are used, then video communication can be established, but connection interruptions and frame drops occur during network connectivity issues
Solution Approach 1:
The system performs preliminary actions by capturing and storing video frames before network interruptions occur. When connectivity is lost, these pre-captured frames are reused to generate artificial video feeds, preventing the harmful effect of connection interruptions and maintaining continuous video call experience.
Solution Approach 2:
The system creates copies of previously received video frames and uses these copies to generate artificial video feeds during network interruptions. Instead of relying on real-time video transmission that may be interrupted, the system replicates and reuses video frame data to maintain the appearance of continuous video communication.
2Reliability
If artificial frames are generated to maintain video call continuity, then connection interruptions are mitigated, but system complexity increases
Solution Approach 1:
The system applies partial action by generating artificial frames only during network interruptions rather than continuously. Video frame capture and processing are performed selectively based on network conditions, reducing unnecessary processing complexity while maintaining reliability when needed.
Solution Approach 2:
The system segments the video call operation into distinct modes: normal real-time video transmission mode and artificial frame generation mode during interruptions. This segmentation allows the system to use simpler processing during normal operation and only activate the more complex artificial frame generation when necessary, managing overall system complexity.
3Reliability
If video frames are captured and stored for artificial frame generation, then video continuity is maintained during interruptions, but memory usage increases
Solution Approach 1:
The system captures and stores video frames partially - only when network conditions are good and only for the duration needed to bridge expected interruption periods. The frame buffer maintains a limited set of recent frames rather than storing extensive video sequences, balancing memory usage with the ability to maintain continuity during typical network interruptions.
Data Source
AI summary
The present disclosure relates to methods and devices for wireless communication of an apparatus, e.g., a UE. In one aspect, the apparatus may determine whether a connection of a video call is interrupted, the video call including a plurality of decoded frames. The apparatus may also determine, if the connection of the video call is interrupted, whether one or more decoded frames of the plurality of decoded frames are suitable for artificial frame generation. The apparatus may also generate one or more artificial frames based on the one or more decoded frames and an audio feed from a transmitting device. Additionally, the apparatus may determine whether the one or more artificial frames are suitable for a facial model call. The apparatus may also establish a facial model call based on a combination of the one or more artificial frames and the audio feed from the transmitting device.