Cloud Gaming Frame Prediction Model Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud gaming systems often experience latency issues due to internet connectivity problems, leading to a lag between player inputs and the updating of the game view, making the game feel unresponsive.
Innovation Solution
A method and device that utilize a prediction model, such as a machine learning model, to predict subsequent video frames based on previously rendered frames and player inputs, reducing the need for real-time frame rendering and transmission.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If video frames are rendered and transmitted in real-time from the server, then the game view is updated according to player inputs, but network latency and bandwidth limitations cause lag between player inputs and displayed action
Solution Approach 1:
The system performs preliminary rendering of multiple future video frames at the server before they are actually needed for display. These pre-rendered frames are stored and then transmitted to the client device, where they are displayed in sequence. This allows the client to show frames that were rendered in advance, effectively hiding the rendering time and reducing the perceived latency between player input and displayed action.
Solution Approach 2:
The patent introduces a temporal dimension to the rendering process by rendering frames for multiple future time points simultaneously rather than sequentially in real-time. This allows the system to prepare frames ahead of time and transmit them over the network, decoupling the rendering timing from the display timing and reducing the impact of network latency.
2Manufacturing precision
If high-resolution video frames are transmitted continuously over the network, then the game view quality is maintained, but bandwidth consumption increases
Solution Approach 1:
Instead of transmitting video frames continuously at full resolution, the system transmits pre-rendered frames at periodic intervals that are optimized for network bandwidth. The frames are rendered in advance at the server and transmitted in batches, allowing the client to display them locally without requiring continuous high-bandwidth transmission. This periodic transmission approach maintains visual quality while reducing overall bandwidth consumption.
Data Source
AI summary
A method of generating video frames for a cloud-based video game includes obtaining, via a communications network, a plurality of frames of a video game rendered at a cloud device; obtaining a player input received at an input device, the input device being used to play the video game, the player input being received in response to the display of at least one of the obtained video frames; inputting at least one of the obtained video frames and the player input to a prediction model; and synthesizing, based on the output of the prediction model, a subsequent frame for output at a display, and outputting the synthesized video frame at the display.