Image Transmission System Adaptive Data Sampling
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In cloud gaming and image transmission systems, increasing image data transmission frequency improves frame rate and smoothness but increases traffic, and reducing transmission frequency while estimating missing images can lead to display of false moving images, especially during sudden scene switches or introduction of new objects.
Innovation Solution
An image transmission/reception system that includes an image generation unit, an image data transmission unit, a transmission control unit, an alternative image generation unit, and a display control unit, which determines the possibility of successful estimation based on feature amounts to decide whether to transmit second image data, using parameters like feature points, edge strength, and object presence to minimize traffic while preventing false image display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If image data transmission frequency is increased, then frame rate and smoothness of moving image are improved, but traffic between cloud server and terminal increases
Solution Approach 1:
The system transmits image data selectively rather than continuously at full frequency. The transmission control unit determines whether to transmit based on estimation success possibility, applying partial transmission action to reduce traffic while maintaining acceptable frame rates through intelligent sampling of image data transmissions
2Quantity of substance
If image data transmission frequency is reduced to decrease traffic, then traffic is reduced, but the terminal cannot accurately estimate missing images leading to false moving images
Solution Approach 1:
The system implements feedback through the transmission control unit that monitors estimation success possibility based on feature amounts. This feedback mechanism adjusts transmission decisions dynamically - when estimation reliability is high, transmission is reduced; when reliability is low (sudden scene switches or new objects), transmission increases to maintain image accuracy and prevent false images
3Quantity of substance
If the terminal estimates missing images based on transmitted image data, then traffic is reduced, but estimation fails during sudden scene switches or introduction of new objects
Solution Approach 1:
The system dynamically adjusts transmission behavior based on scene characteristics. The transmission control unit evaluates feature amounts and estimation success possibility in real-time, making the system adaptive to different scenarios - maintaining low transmission during stable scenes while automatically increasing transmission when scene changes or new objects appear, thus balancing traffic reduction with estimation accuracy
Data Source
AI summary
An upscaling unit generates a first to-be-displayed image on the basis of first image data. An alternative image generation unit generates an alternative image by estimating, on the basis of the first image data, a second to-be-displayed image to be generated on the basis of second image data. A display control unit displays, after displaying the image generated on the basis of the first image data, any one of the image generated on the basis of the second image data and the alternative image, depending on whether or not reception of the second image data has succeeded. A transmission control unit controls whether or not to transmit, to a terminal, the second image data on the basis of a possibility of successful estimation of the second to-be-displayed image on the basis of the first image data by the alternative image generation unit.