Super-Resolution Processing for Cloud Gaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In cloud gaming, the transmission of game scene images from a server to a client terminal often results in reduced video quality due to lossy compression encoding, and conventional super-resolution processes are delayed, making real-time gaming difficult.
Innovation Solution
An image processing apparatus and server system that perform a super-resolution process based on scene information, where the server generates and transmits scene information along with the image, allowing the client terminal to enhance image resolution efficiently, and the process is optimized by performing operations in units of partial images to reduce delay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If a super-resolution process is executed to enhance image quality, then image resolution is improved, but processing time increases causing delay
Solution Approach 1:
The patent divides the image into multiple blocks and processes each block independently through parallel computation. This segmentation allows the super-resolution process to be distributed across multiple processing units, significantly reducing overall processing time while maintaining high image resolution output.
Solution Approach 2:
The patent performs scene analysis and identifies suitable candidates for super-resolution processing before the actual enhancement. By pre-processing and selecting only necessary image blocks that benefit from super-resolution, the system avoids unnecessary computation on already high-quality regions, thereby reducing total processing time while maintaining output resolution quality.
2Quantity of substance
If lossy compression encoding is applied to transmit images over network, then transmission bandwidth is reduced, but video quality deteriorates
Solution Approach 1:
The patent accepts the degraded quality from lossy compression as input and uses super-resolution processing to recover and enhance the image quality. By treating the compressed, lower-quality image as the starting point for enhancement rather than trying to prevent compression, the system converts the harmful effect of compression into an opportunity to demonstrate superior quality recovery capabilities.
Solution Approach 2:
The patent changes the resolution parameter of the transmitted image by generating super-resolution output at higher resolutions than the input. This parameter transformation allows the system to work with lower-resolution compressed images for transmission while delivering high-resolution enhanced images to the display, effectively decoupling transmission bandwidth requirements from final output quality.
3Productivity
If scene analysis is performed prior to super-resolution process, then processing efficiency is improved, but additional processing steps increase delay
Solution Approach 1:
The patent integrates scene analysis functionality into the existing video processing pipeline, allowing the same processing infrastructure to serve multiple purposes. By making the scene analysis component reusable across different processing stages and compatible with existing hardware, the system achieves improved processing efficiency without requiring separate dedicated analysis infrastructure that would increase overall delay.
Solution Approach 2:
The patent combines the scene analysis step with the super-resolution processing pipeline rather than executing them as separate sequential operations. By merging these functions into a unified processing flow where analysis results directly guide subsequent enhancement operations, the system improves overall processing efficiency while minimizing the additional delay that would result from completely separate analysis and processing stages.
Data Source
AI summary
A client terminal includes a super-resolution processing section and a display control section. The super-resolution processing section 48 of the client terminal executes a super-resolution process for an inputted image on the basis of scene information indicating a feature in the image. The display control section of the client terminal outputs, to a display panel, the image having undergone the super-resolution process at the super-resolution processing section. The scene information is acquired in a process prior to a super-resolution process for a super-resolution process target image.