Partial-Image Super-Resolution Processing for Low-Delay Cloud Gaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In cloud gaming, the transmission of game scene images over finite network bands results in video quality deterioration and resolution reduction due to lossy compression encoding, and conventional super-resolution processes cause significant delay, making real-time gaming difficult.
Innovation Solution
The system performs super-resolution processing in units of partial images, integrating scene information from the server, and executes scene analysis and enhancement processes in parallel with compression encoding to minimize delay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a conventional super-resolution process is executed on the entire frame, then the image quality is enhanced, but the processing time becomes too long for real-time gaming
Solution Approach 1:
The patent divides the frame into multiple partial images (tiles) and processes each partial image independently through the super-resolution process. This segmentation allows parallel processing of multiple regions simultaneously, reducing the total processing time while maintaining image quality enhancement for each region.
Solution Approach 2:
Instead of processing the entire frame at once, the patent applies super-resolution processing to only a portion of the frame (one partial image at a time). This partial action approach reduces the computational burden per processing cycle, enabling real-time processing while still delivering quality enhancement in the processed regions.
2Quantity of substance
If lossy compression encoding is used to transmit game images over network, then the transmission bandwidth is reduced, but the video quality deteriorates
Solution Approach 1:
The patent accepts the quality degradation caused by lossy compression as an inevitable harm, but then applies super-resolution processing to convert this harm into a benefit by reconstructing and enhancing the degraded image quality, ultimately delivering better visual quality than the original compressed image.
Solution Approach 2:
The patent changes the processing parameters by applying super-resolution algorithms that modify the image data to restore high-frequency details and enhance quality. This parameter transformation allows the system to overcome the quality loss from compression while maintaining efficient bandwidth utilization.
3Manufacturing precision
If the client terminal executes super-resolution process on low-resolution images, then the display resolution is enhanced, but the processing delay increases
Solution Approach 1:
The patent segments the frame into multiple partial images that can be processed in parallel. By dividing the work into smaller independent units, the system can process multiple regions simultaneously, reducing the overall processing delay while still achieving high display resolution through super-resolution enhancement.
Solution Approach 2:
The patent performs scene analysis and identifies suitable regions for super-resolution processing in advance, before the actual enhancement process. This preliminary action allows the system to optimize processing priorities and prepare data structures that accelerate the subsequent super-resolution processing, reducing overall delay.
Data Source
AI summary
A client terminal includes a data acquiring section, a super-resolution processing section 48, and a display control section. The data acquiring section of the client terminal acquires video data in units of partial image which is smaller than one frame. The super-resolution processing section of the client terminal executes a super-resolution process in units of partial image acquired by the data acquiring section. The display control section of the client terminal sequentially outputs, to a display panel, partial images having undergone the super-resolution process at the super-resolution processing section.