Frame Interpolation for Display Freeze in Terminal Devices
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Terminal devices experience display anomalies such as freeze or jump when drawing and rendering expire, leading to lost frames and poor user experience.
Innovation Solution
The method involves frame interpolation to compensate for lost frames caused by expired drawing and rendering, by interpolating and displaying additional frames based on input events and Vsync signals, ensuring smooth display even when drawing and rendering exceed Vsync periodicity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the terminal device draws and renders frames based on Vsync signals, then the display follows the standard refresh rhythm, but when drawing and rendering duration exceeds Vsync periodicity, lost frames occur causing display freeze or jump
Solution Approach 1:
The system performs preliminary action by detecting when drawing and rendering duration exceeds Vsync periodicity before the actual frame loss occurs. It calculates the expected completion time of current frame drawing and rendering, compares it with the next Vsync signal timing, and proactively prepares compensation measures (such as pre-rendering or frame skipping adjustment) to prevent display freeze or jump, thus resolving the contradiction between maintaining display stability and avoiding frame loss.
2Manufacturing precision
If the terminal device waits for drawing and rendering to complete before displaying the next frame, then each frame is fully rendered, but display smoothness deteriorates when drawing and rendering take too long
Solution Approach 1:
The system applies dynamics by making the frame rendering process adaptive rather than static. It dynamically adjusts the frame rendering strategy based on real-time detection of drawing and rendering duration. When the duration is within normal range, it waits for complete rendering; when it exceeds Vsync periodicity, it dynamically switches to compensation modes (such as partial rendering with interpolation or selective frame skipping) to maintain display refresh speed, thus resolving the contradiction between frame rendering completeness and display refresh speed.
3Speed
If the terminal device performs frame interpolation to compensate for lost frames, then display smoothness improves, but system complexity increases due to additional processing
Solution Approach 1:
The system applies local quality by making the frame interpolation processing selective rather than universal. It performs frame interpolation compensation only in specific local situations where drawing and rendering duration exceeds Vsync periodicity and frame loss is detected. In normal situations where no frame loss occurs, it uses standard rendering without additional interpolation processing. This localized application of frame interpolation resolves the contradiction between display smoothness and processing complexity by applying the complex processing only where necessary.
Data Source
AI summary
Embodiments of this application provide a data processing method and a related apparatus. The method includes: obtaining an input event corresponding to the sliding operation; drawing and rendering an Nth frame based on a first move event, where the first move event is extracted based on a timestamp of a first Vsync signal and from the input event corresponding to the sliding operation; displaying the Nth frame; drawing and rendering, when duration of the drawing and the rendering of the Nth frame is greater than a Vsync periodicity, an (N+1)th frame based on a second move event after the drawing and the rendering of the Nth frame are completed, where the second move event is extracted based on a first timestamp and from the input event corresponding to the sliding operation, and the first timestamp is a sum of the timestamp of the first Vsync signal and the Vsync periodicity.