Cloud Game Video Cropping and Split Rendering for Low-Latency Streaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud games experience running freezes on terminal devices due to network latencies, which degrade user experience.
Innovation Solution
A cloud game processing method where the cloud game server renders and crops the background image based on the terminal device's field of view, performs compression, and sends a processed video stream, while the terminal device generates and superimposes the game character, sharing rendering tasks to mitigate network latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the cloud server performs all rendering tasks for the cloud game scene, then the game image quality is improved, but the network bandwidth requirement increases causing running freezing
Solution Approach 1:
The patent segments the rendering tasks into two parts: the cloud server renders the background environment (static or slowly changing elements), while the terminal device renders the game character and items (dynamic elements requiring frequent updates). This division reduces the amount of data that needs to be transmitted over the network, as the terminal only needs to receive background images and then locally generate and superimpose the character models, thereby resolving the bandwidth bottleneck while maintaining overall image quality.
2Quantity of substance
If the terminal device performs all rendering tasks locally, then the network bandwidth consumption is reduced, but the game image quality deteriorates
Solution Approach 1:
The patent introduces an intermediary approach where the cloud server provides pre-rendered background images and environmental data to the terminal device. The terminal then uses these provided resources as a foundation and locally generates only the necessary dynamic elements (character models, items). This intermediary strategy allows the terminal to perform limited rendering tasks without compromising overall image quality, as the high-quality background from the cloud server serves as the base layer.
3Manufacturing precision
If the video stream resolution is increased to improve visual quality, then the image clarity is improved, but the data transmission amount increases causing network latency
Solution Approach 1:
The patent extracts and separates the background rendering task from the complete game scene rendering. By having the cloud server render only the background environment and transmit these background images to the terminal, the system removes the need to transmit high-resolution data for all game elements. The terminal then locally generates the character models at appropriate resolutions, thereby maintaining image clarity for critical elements while significantly reducing the total data transmission amount and associated network latency.
Data Source
Figure 1
Figure 2~3
Figure 4
AI summary
A cloud game processing method is provided. A cloud game server includes a rendering module and a video stream processing module. The method includes: The rendering module performs rendering on a background in a cloud game scene to obtain a video stream of a background image of a cloud game; the video stream processing module crops an image in the video stream of the background image of the cloud game to obtain a target video stream of the cloud game, where a size of a game background image in the target video stream matches a field of view of a game character corresponding to a terminal device; and after performing compression and encoding processing on the target video stream, the video stream processing module sends the processed target video stream to the terminal device, where the terminal device is configured to locally generate the game character and/or an item of the game character, and superimpose the game character and/or the item of the game character on the background image in the processed target video stream, to present, to a user, the game scene of the cloud game from a perspective of the game character.