Cloud Desktop Frame Interpolation for Smooth Low-Rate Display
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
The instability of the transmission frame rate in cloud desktops leads to insufficient display smoothness due to network congestion, causing the front-end display frame rate to decrease synchronously with the back-end transmission frame rate.
Innovation Solution
Implement backward frame interpolation in the cloud desktop terminal to construct predicted frames based on received image frames, displaying them before the next frame is received, thereby increasing the display frame rate without affecting bandwidth or introducing delay.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the front-end display frame rate keeps consistent with the back-end transmission frame rate, then the system maintains simple synchronization, but the display smoothness becomes insufficient when network congestion occurs
Solution Approach 1:
The patent applies preliminary action by constructing predicted frames in advance between received image frames. When the terminal receives an image frame, it proactively generates predicted frames using interpolation algorithms before the next actual frame arrives, ensuring smooth display continues even when transmission frame rate drops due to network congestion.
Solution Approach 2:
The patent changes the display frame rate parameter independently from the transmission frame rate parameter. By introducing frame interpolation, the system can display at a higher frame rate (e.g., 60fps) even when receiving frames at a lower rate (e.g., 30fps), decoupling these two parameters to maintain display smoothness regardless of network conditions.
2Productivity
If backward frame interpolation is performed to construct predicted frames, then the display frame rate increases autonomously, but the terminal processing complexity increases
Solution Approach 1:
The patent uses copying by creating predicted frames that are interpolated versions of actual frames. Instead of transmitting more data or using complex real-time rendering, the terminal copies and interpolates pixel data from existing frames to generate intermediate predicted frames, achieving higher display frame rates with relatively simple processing.
3Reliability
If frame interpolation is used to improve display smoothness, then more frames are displayed, but bandwidth requirements may increase
Solution Approach 1:
The patent applies self-service by having the terminal generate predicted frames locally using interpolation algorithms rather than requiring the server to transmit additional frames. The terminal uses its own processing capabilities to create intermediate frames, eliminating the need for increased bandwidth while achieving smoother display.
Data Source
Figure 1~2
Figure 3a~3b
Figure 3c~4
AI summary
Embodiments of this application provide a cloud desktop display method, a cloud desktop terminal, and a storage medium. In this embodiment of this application, the cloud desktop terminal is modified. After an image frame sent by a cloud desktop server is received, the image frame can be displayed; backward frame interpolation prediction may be performed on the basis of the image frame and a preceding reference frame to construct a predicted frame that can be interposed before the next image frame; and on this basis, the prediction frame can be displayed before the next image frame is received. In this way, the cloud desktop terminal may actively perform backward frame interpolation while normally displaying the image frame acquired from the cloud desktop server, so that a display frame rate is autonomously increased in the cloud desktop terminal when the transmission frame rate of the cloud desktop server is insufficient, improving display fluency of the cloud desktop without increasing a bandwidth and a delay.