Cloud Gaming Rendering Context Management for Network Jitter
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In instruction cloud game scenarios, network jitter leads to accumulation of rendering instruction streams, causing high transmission and processing delays, which result in poor user experience due to delayed rendering of the latest frame.
Innovation Solution
A rendering method where a server generates and stores rendering contexts before and during network jitter, allowing for the transmission of context differences after recovery, enabling the electronic device to synchronize with the server and reduce the volume of rendering instruction streams needed for execution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If rendering instruction streams are transmitted continuously during network jitter, then network bandwidth utilization is improved, but transmission and processing delays increase significantly
Solution Approach 1:
The patent segments the rendering instruction stream into two parts: rendering contexts (state information) and actual rendering instructions. By separating the context establishment from the instruction transmission, the system can efficiently handle network jitter without accumulating excessive data, thus reducing transmission and processing delays while maintaining bandwidth utilization.
Solution Approach 2:
The patent generates and stores rendering contexts in advance before network jitter occurs. These pre-generated contexts are stored on the server and can be quickly retrieved and transmitted to the terminal device when needed, eliminating the need to regenerate contexts during network interruptions and reducing overall transmission delays.
2Reliability
If all rendering instruction streams are sent during network recovery, then rendering completeness is improved, but processing time on terminal increases
Solution Approach 1:
The patent extracts the rendering context information from the rendering instruction streams and handles it separately. The terminal device receives and processes only the essential context differences during network recovery, rather than processing all accumulated rendering instructions, significantly reducing processing time while maintaining rendering completeness through the extracted context information.
Solution Approach 2:
The patent uses rendering contexts as copies or representations of the rendering state. Instead of transmitting all original rendering instruction streams during recovery, the system transmits context differences that replicate the necessary rendering state information, reducing the amount of data to be processed while maintaining completeness.
3Loss of time
If rendering contexts are stored and transmitted, then transmission delays are reduced, but device complexity increases
Solution Approach 1:
The patent implements a universal rendering context management mechanism that serves multiple functions: context generation, context storage, context transmission, and context restoration. This multi-functional approach consolidates what would otherwise require separate complex systems into a unified framework, managing the added complexity through standardized processes rather than multiple specialized components.
Data Source
AI summary
Before a network jitter occurs, a server receives operation instructions from an electronic device, generates a plurality of first rendering instruction streams based on the operation instructions, sends the plurality of first rendering instruction streams to the electronic device, and generates and stores one or more first rendering contexts for one or more first rendering instruction streams in the plurality of first rendering instruction streams. When the network jitter occurs, the server generates a second rendering instruction stream based on received operation instructions, and generates and stores a second rendering context based on the second rendering instruction stream. After the recovery from the network jitter, the server sends a set of rendering context differences to the electronic device. In this way, network transmission traffic after the recovery from the network jitter is reduced, transmission and processing delays are also reduced, and user experience is improved.