Image Processing Vertical Sync Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing electronic devices experience latency issues in man-machine interaction, particularly in touch response times, leading to reduced fluency and user experience.
Innovation Solution
A method for image processing based on vertical synchronization signals that allows for simultaneous layer drawing, rendering, and composing within a single synchronization period, utilizing vertical synchronization signals to trigger these processes without waiting for subsequent signals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the electronic device waits for the arrival of the vertical synchronization signal to execute the Compose operation, then the display timing is synchronized, but the response latency increases and fluency deteriorates
Solution Approach 1:
The patent applies preliminary action by executing the Compose operation in advance before the vertical synchronization signal arrives. The system determines whether to execute the Compose operation based on predicted timing, allowing the rendering pipeline to prepare frames ahead of time. This eliminates the waiting period for Vsync while maintaining display synchronization through predictive scheduling mechanisms.
2Loss of time
If the electronic device executes rendering and composing operations continuously without waiting for synchronization signals, then the response latency decreases and fluency improves, but the display timing synchronization may be compromised
Solution Approach 1:
The patent implements dynamics by making the rendering and composing operations adjustable and flexible rather than fixed to specific synchronization intervals. The system dynamically determines when to execute Compose operations based on real-time conditions, workload analysis, and predicted Vsync timing. This allows the system to optimize between continuity and synchronization based on current system state, achieving both low latency and maintained sync reliability.
Data Source
Figure 1A
Figure 1B
Figure 2
AI summary
Embodiments of this application relate to the field of image processing and display technologies, and provide a method for image processing based on vertical synchronization signals and an electronic device, to shorten a response latency of the electronic device and improve fluency (such as a touch latency) of the electronic device. A specific solution includes: drawing, by the electronic device, one or more first layers in response to a first vertical synchronization signal, and rendering the one or more first layers, and after rendering the one or more first layers, performing layer composing on the rendered one or more first layers to obtain a first image frame; and refreshing and displaying the first image frame in response to a second vertical synchronization signal.