Cloud Gaming Frame Resolution Enhancement via Terminal Super-Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In cloud gaming, reducing video frame resolution to maintain fluency results in a poor display effect, especially in terminals with poor network states.
Innovation Solution
A method where the terminal transmits network delay information to the cloud game server, allowing it to generate and adjust video frames, and then the terminal enhances the resolution of these frames to improve clarity without compromising fluency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the cloud game server reduces the resolution of video frames to ensure fluency in poor network states, then the fluency of the cloud game is improved, but the display effect of the cloud game deteriorates
Solution Approach 1:
The patent segments the video processing into two distinct stages: first, the cloud game server transmits video frames at reduced resolution to ensure fluency; second, the terminal device performs local super-resolution enhancement on received frames to improve display quality. This segmentation allows each stage to optimize for its specific goal without compromising the other.
Solution Approach 2:
The patent introduces a spatial dimension transformation through super-resolution technology, converting low-resolution video frames into high-resolution frames by generating additional pixel information. This dimensional transformation occurs at the terminal device, adding a post-processing layer that enhances visual quality without affecting transmission fluency.
2Manufacturing precision
If the cloud game server transmits high resolution video frames, then the display effect is improved, but the network bandwidth consumption increases
Solution Approach 1:
Instead of transmitting high-resolution frames and reducing them at the terminal, the patent inverts the traditional approach by transmitting low-resolution frames and enhancing them at the terminal through super-resolution technology. This inversion shifts the computational burden from the network transmission stage to the terminal processing stage.
Solution Approach 2:
The patent introduces super-resolution technology as an intermediary process between the transmitted video frames and the final display. This intermediary technology acts as a bridge, transforming low-resolution input frames into high-resolution output frames, thereby decoupling the relationship between transmission resolution and display resolution.
3Manufacturing precision
If the terminal adjusts the resolution of video frames locally, then the clarity of the cloud game picture is improved, but the device complexity increases
Solution Approach 1:
The patent enables the terminal device to perform self-service by implementing local super-resolution enhancement capabilities. The terminal uses its own computational resources to process and enhance received video frames, making the system self-sufficient in improving display quality without requiring additional external processing equipment.
Data Source
AI summary
This application discloses a video frame playing method performed by a computer device. According to an embodiment of this application, the computer device transmits network delay information to a cloud game server. The cloud game server then generates a plurality of first video frames based on the network delay information for rendering a target virtual scene at the computer device. After acquiring the plurality of first video frames, the computer device adjusts a resolution of the first video frames to obtain corresponding second video frames when resolutions of the plurality of first video frames meet resolution adjustment conditions, resolutions of the second video frames being higher than those of corresponding first video frames. Finally, the computer device plays a plurality of the second video frames.