UI Frame Interpolation for Smooth Fling Display at Lower Power
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
High refresh rates in terminal devices lead to increased power consumption and potential issues like jitter, freezing, and blurry displays due to the high data processing demands.
Innovation Solution
Implement frame interpolation in the interface display process by determining a frame interpolation policy based on user input, such as fling direction and interface information, to interpolate combined frames, reducing the need for layer drawing and rendering, thereby decreasing power consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Speed
If the refresh rate of the terminal device is increased to improve display smoothness, then the display smoothness is improved, but the power consumption increases exponentially
Solution Approach 1:
The patent applies partial action by performing frame interpolation selectively during fling operations rather than continuously. The system determines whether to interpolate frames based on specific conditions (fling detection, frame rate thresholds), executing the computationally intensive interpolation process only when necessary to maintain display smoothness at high refresh rates, thereby reducing overall power consumption while preserving display quality during critical moments
Solution Approach 2:
The patent dynamically changes the frame rate parameter based on device state and performance conditions. It adjusts between different frame rates (e.g., 60Hz, 120Hz, 240Hz) and selectively applies frame interpolation at specific frame rates, allowing the system to optimize the balance between display smoothness and power consumption by modifying operational parameters rather than maintaining a fixed high refresh rate
2Loss of time
If the refresh rate is increased to reduce frame rendering time, then the frame rendering time is reduced, but the terminal device experiences jitter, freezing, and blurry display
Solution Approach 1:
The patent performs preliminary action by pre-calculating and preparing interpolated frames before they are needed for display. When a fling operation is detected, the system proactively generates intermediate frames in advance, ensuring that smooth transition frames are ready to be displayed without causing jitter or freezing during the actual fling operation, thus maintaining display stability while reducing effective rendering time
Solution Approach 2:
The patent introduces an intermediary process (frame interpolation) that generates intermediate frames to bridge the gap between discrete key frames. This intermediary mechanism smooths out transitions during high-speed fling operations, preventing the jitter and freezing that would otherwise occur when the system cannot render frames fast enough to match the high refresh rate requirement
3Use of energy by moving object
If frame interpolation is performed to reduce drawing and rendering load, then the power consumption is reduced, but the interface display effect may deteriorate
Solution Approach 1:
The patent applies local quality by performing frame interpolation selectively in specific local conditions rather than universally. It activates frame interpolation only during fling operations and only when specific frame rate thresholds are met, maintaining high display quality in critical scenarios while conserving power in normal operation, thus achieving a localized optimization that balances power consumption and display effect
Data Source
AI summary
In a method performed by a terminal device for performing frame interpolation in an interface display process, when a fling operation performed by a user on a display interface is received, the terminal starts display a sliding interface, which is a view in a first area of the display interface. The terminal device obtains input information that represents a fling direction, interface information of the display interface, sliding display information, and information about a plurality of image frames corresponding to the sliding interface. Based on the input information, the terminal device determines a frame interpolation policy based on the input information. The terminal device then performs, based on the information about the plurality of image frames, splicing and combination by using the frame interpolation policy to obtain one or more to-be-interpolated frames located between the plurality of image frames.