UI Frame Interpolation for High-Refresh Sliding Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High refresh rates in terminal devices lead to increased power consumption and issues like jitter, freezing, and blurry displays due to the high computational load of drawing and rendering multiple images, especially during operations like fling gestures.
Innovation Solution
Implement frame interpolation by determining a policy based on user input to interpolate frames between adjacent images, reducing the load on UI and render threads, and avoiding abnormal displays.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the refresh rate is increased to improve display smoothness, then the display smoothness is improved, but the power consumption increases exponentially
Solution Approach 1:
The system performs frame interpolation by generating intermediate frames between adjacent original frames in advance, before the high refresh rate display requires them. This preliminary generation of interpolated frames allows the system to maintain high refresh rate smoothness while reducing real-time computational load, as the interpolation is done proactively rather than reactively during critical display moments.
Solution Approach 2:
The patent introduces an intermediary frame interpolation mechanism that acts as a mediator between the original frames and the high refresh rate display requirements. By inserting interpolated frames as intermediaries between adjacent original frames, the system achieves smoother display without requiring all frames to be rendered at full resolution in real-time, thus reducing power consumption while maintaining perceived smoothness.
2Productivity
If multiple images are drawn and rendered per unit time to meet high refresh rate requirements, then the display smoothness is improved, but the processing load increases exponentially
Solution Approach 1:
The system performs frame interpolation by generating intermediate frames between adjacent original frames in advance, before the high refresh rate display requires them. This preliminary generation of interpolated frames allows the system to maintain high refresh rate smoothness while reducing real-time computational load, as the interpolation is done proactively rather than reactively during critical display moments.
Solution Approach 2:
The patent introduces an intermediary frame interpolation mechanism that acts as a mediator between the original frames and the high refresh rate display requirements. By inserting interpolated frames as intermediaries between adjacent original frames, the system achieves smoother display without requiring all frames to be rendered at full resolution in real-time, thus reducing power consumption while maintaining perceived smoothness.
3Use of energy by moving object
If frame interpolation is performed to reduce processing load, then the power consumption is reduced, but the display smoothness may be compromised
Solution Approach 1:
The system applies local quality by performing frame interpolation selectively rather than uniformly across all frames. The interpolation is applied locally between adjacent original frames where needed, while maintaining the original frames at their full quality. This localized approach allows the system to reduce overall processing load and power consumption while preserving display smoothness in critical areas where interpolation is most effective.
Data Source
Figure 1(a)
Figure 1(b)
Figure 1(c)
AI summary
A method for performing frame interpolation in an interface display process and a terminal device are provided, and relate to the field of electronic technologies, to improve interface display effect, reduce a power consumption speed of the terminal device, and improve user experience under a high refresh rate requirement. In the method, in a process in which an interface starts to slide in a direction for display with animation effect, the terminal device determines a specific frame interpolation policy based on a fling direction, interface information of a display interface, sliding display information, information about a plurality of image frames corresponding to the sliding interface, and the like. In this way, the terminal device interpolates one or more combined frames between the plurality of frames according to the determined frame interpolation policy, to reduce layer drawing and rendering loads of a user interface (user interface, UI) thread and a render thread per unit of time. This reduces power consumption of the terminal device, and avoids jitter, freezing, and blurry display in the interface display process, thereby bringing good user experience to a user.