Predictive Video Frame Replacement During Network Interruption
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Network interruptions during media streaming, such as handovers in radio access networks, result in incomplete media data delivery, leading to disruptions like black screens or duplicated frames, which degrade user experience.
Innovation Solution
User equipment devices employ artificial intelligence and machine learning to predictively generate replacement media data when network interruptions are detected, avoiding retransmissions and ensuring seamless playback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If retransmission of lost media data is requested, then data completeness is improved, but latency and resource consumption increase
Solution Approach 1:
The system performs preliminary actions by detecting network degradation conditions and proactively generating replacement media data before actual packet loss occurs. This predictive approach allows the destination device to prepare compensatory content in advance, eliminating the need for reactive retransmission requests and reducing associated latency.
Solution Approach 2:
The patent introduces an intermediary mechanism (replacement media data generation) between the network transmission and playback components. When network issues are detected, this intermediary process creates substitute content that mediates the gap caused by packet loss, allowing seamless playback without direct retransmission cycles.
2Reliability
If retransmission of lost media data is requested, then data completeness is improved, but resource consumption increases
Solution Approach 1:
The destination device performs self-service by autonomously generating replacement media data when network problems are detected. Instead of relying on source device retransmission, the destination device independently creates compensatory content using local computational resources, eliminating the need for additional network round-trips and reducing overall system resource consumption.
Solution Approach 2:
The replacement media data generation acts as an intermediary solution that resolves the conflict between data completeness and resource consumption. By introducing this local content generation mechanism, the system avoids the high resource cost of retransmission protocols while maintaining playback continuity.
3Adaptability or versatility
If network handover is performed, then network connectivity is maintained, but media data delivery timing is disrupted
Solution Approach 1:
The system detects handover conditions and performs preliminary generation of replacement media data before the handover completes. This advance preparation ensures that even though handover disrupts timing, the destination device already has compensatory content ready to maintain seamless playback during and after the handover transition.
4Productivity
If packet loss occurs, then network throughput is maintained, but media data completeness deteriorates
Solution Approach 1:
The patent converts the harmful effect of packet loss into a beneficial opportunity by using the lost packets as a trigger signal. When packet loss is detected, the system activates replacement media data generation, transforming the negative event into a catalyst for maintaining playback continuity through locally generated compensatory content.
Data Source
AI summary
An example device for presenting media data includes a memory configured to store media data; and one or more processors implemented in circuitry and configured to: receive a first set of media data of a media bitstream; in response to determining that a second set of media data of the media bitstream following the first set of media data will not be received within a period of time, predictively generate replacement media data for the second set of media data using at least a subset of the first set of media data; and present the first set of media data and the replacement media data.


