Cloud Gaming Image Upscaling via Feature Data Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing image transmission systems in cloud gaming services face challenges in generating images on terminals that are similar to the original high-resolution images, as images downscaled from the cloud server and upscaled on the terminal often do not accurately replicate the original image quality.
Innovation Solution
An image transmission/reception system that includes an image transmission apparatus generating downscaled image data and additional data representing features of the original image, which is then used by the image reception apparatus to upscale the image, utilizing machine learning models and feature quantity data to generate an image that is higher in resolution and more similar to the original.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If image data representing a downscaled image is transmitted from the cloud server to the terminal, then traffic between the cloud server and the terminal is reduced, but the generated image on the terminal is not quite similar to the original image
Solution Approach 1:
The patent segments the image data into two parts: image data representing the downscaled image and additional data representing feature quantities of the original image. This segmentation allows the terminal to reconstruct a high-resolution image similar to the original by combining both data types, while still transmitting only the downscaled image data primarily, thus reducing traffic.
Solution Approach 2:
The additional data acting as an intermediary carries feature quantity information from the original image to the terminal. This intermediary data enables the terminal's upscaling processing to accurately reconstruct the original image quality without requiring the transmission of the complete original image data, thereby maintaining image similarity while reducing traffic.
2Device complexity
If the terminal generates an image solely on the basis of the received image data representing the downscaled image, then processing complexity is reduced, but the generated image is not quite similar to the original image
Solution Approach 1:
The cloud server performs preliminary action by extracting and preparing additional data representing feature quantities of the original image before transmission. This preliminary preparation enables the terminal to achieve accurate image reconstruction without complex processing, as the feature quantity data provides direct guidance for the upscaling process.
3Manufacturing precision
If the cloud server transmits the original image data, then the terminal can display an image similar to the original, but traffic between the cloud server and the terminal increases
Solution Approach 1:
The patent extracts only the essential feature quantity information from the original image and transmits it as additional data separately from the main image data. This extraction allows the terminal to reconstruct the original image quality without transmitting the complete original image data, thus maintaining image similarity while significantly reducing traffic.
Data Source
AI summary
An image transmission/reception system, an image transmission apparatus, an image reception apparatus, an image transmission/reception method, and a program, generate, from image data representing a downscaled image, a higher resolution image than the downscaled image and is more similar to an original image. An encoding process section generates image data representing a downscaled image obtained by downscaling the original image. An additional data generation section generates additional data on the basis of the original image, the additional data being unidentifiable by the image data alone. A data transmission section transmits the image data and the additional data. A data reception section receives the image data and the additional data. An upscaling section generates an upscaled image on the basis of the image data and the additional data, the upscaled image being higher in resolution than the downscaled image. A display control section causes the upscaled image to be displayed.