Video Frame Compensation via Interpolation to Reduce Processor Load
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current video transmission technologies face challenges in maintaining real-time video quality due to frame loss during online video playback, leading to artifacts on the screen and playback stalls, as direct discarding of lost frames increases processor load and affects playback speed.
Innovation Solution
A video processing method and apparatus that involves obtaining a video frame queue, detecting lost frames, and compensating for them by inserting compensation frames, ensuring the total quantity of frames remains unchanged without additional encoding/decoding calculations, thus preventing playback stalls and ensuring smooth video watching.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If tandem encoding/decoding is performed to compensate for lost video frames, then video quality is improved, but processor load increases significantly
Solution Approach 1:
The patent uses frame interpolation by copying and transforming existing video frames to generate compensation frames. Instead of performing complex encoding/decoding operations, the system creates intermediate frames by blending adjacent frames through mathematical operations, significantly reducing processor load while maintaining video quality.
Solution Approach 2:
The patent replaces the mechanical encoding/decoding process with a mathematical frame interpolation process. By substituting the complex codec operations with simpler pixel-level blending operations, the system achieves frame compensation with much lower computational overhead.
2Power
If lost video frames are directly discarded, then processor load is reduced, but playback quality deteriorates with artifacts and stalls
Solution Approach 1:
The patent performs frame interpolation in advance during the video processing stage, before playback occurs. By pre-generating compensation frames and inserting them into the video stream, the system ensures smooth playback without artifacts or stalls while maintaining low processor load during actual playback operations.
Solution Approach 2:
The patent introduces compensation frames as intermediary elements between lost video frames. These intermediate frames serve as placeholders that maintain the temporal and spatial continuity of the video sequence, preventing playback stalls and visual artifacts without requiring complex real-time processing.
3Loss of information
If frame loss compensation is implemented through retransmission, then complete video data is achieved, but real-time playback quality is adversely affected
Solution Approach 1:
The patent uses temporary compensation frames that are generated on-the-fly and discarded after use. These frames are created quickly through simple interpolation operations and serve their purpose of maintaining playback continuity, then are discarded without requiring long-term storage or complex processing, enabling real-time playback quality.
Data Source
AI summary
A video processing method, video processing apparatus, and a computer storage medium are also disclosed for implementing a solution for compensating for lost video frames that are lost during transmission. Lost video frame detection and compensation is implemented by separately numbering each video frame, at a data layer of transmission, with no need to perform additional encoding/decoding calculation, and without increasing a load of a server during lost frame compensation. A lost video frame is compensated for by inserting a compensation video frame after the lost video frame is detected, so as to ensure that a total quantity of video frames is not changed, thereby avoiding stalling at the playback end during a playback process because the quantity of video frames decreases, and ensuring smooth watching during video playback.