Cloud Game Image Rendering via Server-Terminal Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In cloud game scenarios, the quality of rendered images is compromised due to lossy compression on servers, leading to image quality loss and increased latency during transmission and rendering.
Innovation Solution
Shift part of the image element rendering from the server to the terminal, allowing the terminal to receive rendering instructions and data from the server, and determine the display mode for image elements, thereby reducing the need for lossy compression and enhancing image quality while maintaining low latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Quantity of substance
If the server renders and compresses all image elements, then the network transmission bandwidth is reduced, but the image quality deteriorates due to lossy compression
Solution Approach 1:
The patent segments image elements into two categories: complex background elements rendered and compressed by the server, and simple foreground UI elements rendered locally by the terminal without compression. This segmentation allows different processing strategies for different parts of the image, preserving quality for critical elements while managing bandwidth for the overall system.
Solution Approach 2:
The patent applies different quality standards to different regions of the image. High-quality lossless rendering is applied to foreground UI elements that require precision, while background elements accept lower quality compressed rendering. This local quality differentiation resolves the contradiction by optimizing overall system performance while preserving quality where it matters most.
2Power
If the server renders all image elements, then the server processing load is high, but the terminal rendering capability is underutilized
Solution Approach 1:
The rendering workload is segmented between server and terminal based on element complexity. The server handles complex background scene rendering while the terminal handles simple foreground UI element rendering. This segmentation balances the processing load across the system, utilizing both server and terminal capabilities effectively.
Solution Approach 2:
Instead of the server rendering all elements (excessive server action), the patent applies partial server rendering only where necessary for complex elements. This reduces server processing load while enabling the terminal to contribute its rendering capabilities, improving overall system productivity.
3Manufacturing precision
If the terminal renders all image elements, then the image quality is maintained, but the network latency increases due to transmitting all rendering instructions
Solution Approach 1:
The patent extracts simple foreground UI element rendering from the server's rendering instruction set and handles it locally at the terminal. By taking out these simple rendering tasks from the network communication flow, the system maintains high image quality for these elements without incurring network latency, while still transmitting compressed background elements efficiently.
Data Source
AI summary
Embodiments of this application disclose an image frame display method performed by a computer device. The method includes: receiving a first rendering instruction transmitted by a server, and rendering at least one first image element based on the first rendering instruction; receiving at least one second image element transmitted by the server, the at least one second image element being rendered by the server; receiving an interactive instruction transmitted by the server; and displaying an image frame based on the at least one first image element, the at least one second image element, and the interactive instruction.