Cloud Gaming Video Frame Interpolation to Reduce Server Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Cloud gaming servers face high processing overhead due to rendering and encoding each frame of game pictures, leading to reduced service processing capability and increased resource consumption.
Innovation Solution
A video processing method that involves obtaining an original video sequence, interpolating unrendered frames based on existing frames, encoding the target sequence, and transmitting it to a terminal device for decoding and rendering, thereby reducing the server's rendering burden and resource consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Manufacturing precision
If the cloud gaming server renders and encodes each frame of game picture, then the game picture quality is maintained, but the processing resources and service processing capability are excessively consumed
Solution Approach 1:
The patent segments the frame processing tasks between server and terminal. The server processes only key frames (I-frames) or selected frames, while the terminal processes intermediate frames through motion compensation and rendering. This division reduces server processing burden while maintaining overall video quality.
Solution Approach 2:
The patent applies partial action by having the server encode only a subset of frames (key frames) rather than all frames. The terminal then generates intermediate frames using motion estimation and compensation techniques, achieving acceptable quality with reduced server processing requirements.
2Reliability
If the cloud gaming server renders each frame of game picture, then the video frame completeness is ensured, but the processor overhead becomes excessive
Solution Approach 1:
The server performs preliminary encoding of key frames and transmits them to the terminal in advance. The terminal then uses motion compensation algorithms to generate intermediate frames locally, ensuring frame completeness while reducing server processor overhead.
Solution Approach 2:
The terminal device performs self-service by generating intermediate frames through motion estimation and compensation using data received from the server. This transfers processing burden from the server to the terminal, reducing server energy consumption while maintaining video completeness.
3Manufacturing precision
If the server performs full rendering and encoding, then the video quality is maintained, but the resource consumption increases
Solution Approach 1:
The terminal creates copies of motion information and pixel data from key frames to generate intermediate frames. Instead of the server rendering all frames, the terminal copies essential data and synthesizes remaining frames locally, reducing server energy consumption while maintaining video quality.
Solution Approach 2:
The server performs partial rendering and encoding only for key frames rather than all frames. The terminal supplements with motion-compensated frame generation, achieving acceptable video quality with significantly reduced server resource consumption.
Data Source
AI summary
A video processing method is provided, including obtaining an original video sequence, the original video sequence comprising P video frames obtained through rendering, P being an integer greater than or equal to 2; obtaining a target video sequence according to the original video sequence, the target video sequence comprising the P video frames and Q unrendered video frames interpolated based on at least two video frames of the P video frames, Q being an integer greater than or equal to 1; encoding the target video sequence to obtain a video encoding sequence; and transmitting the video encoding sequence to a terminal device, the terminal device decoding the video encoding sequence to obtain a video sequence that needs to be rendered.