Touch Display Input Prediction for Frame Synchronization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing touch display devices face challenges in synchronizing input event reception with frame generation, leading to inefficient power consumption and suboptimal user touch feedback experiences due to reliance on Vsync signals and variable frame rates.
Innovation Solution
The operating system delivers input events, including predicted events, to applications before the start of frame generation, synchronizing input event reception with frame generation without relying on Vsync signals, using methods such as predicting frame start times or receiving notifications from applications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If the OS delivers input events triggered by Vsync signal, then the frame generation is synchronized, but the input event reception cannot be synchronized with frame generation due to variable frame rates
Solution Approach 1:
The operating system predicts the start time of frame generation in advance and delivers input events to the application before the actual frame generation starts. This preliminary delivery ensures that input events are synchronized with frame generation even when frame rates vary, resolving the contradiction between reliability of synchronization and adaptability to variable frame rates.
2Speed
If the application retrieves input events directly from the touch sensor, then input event reception is immediate, but the application is always woken up and interrupted by each input event causing more power consumption
Solution Approach 1:
The operating system performs preliminary action by predicting frame start times and preparing input events in advance. The application only needs to wake up at predicted frame start times to receive events, rather than being continuously interrupted by each touch event. This reduces power consumption while maintaining fast response through advance preparation of input data.
Solution Approach 2:
The operating system acts as an intermediary between the touch sensor and the application. Instead of the application directly retrieving events from the sensor (causing continuous interruptions), the OS collects events, predicts frame timing, and delivers them at appropriate times. This intermediary role reduces application wake-ups while ensuring timely delivery.
3Stability of the object's composition
If the OS delivers input events according to Vsync signal, then the display refresh is synchronized, but the application frame generation may not synchronize with input event delivery due to different frame rates
Solution Approach 1:
The system performs preliminary prediction of frame generation start times by the application, which may differ from display refresh timing. By delivering input events based on predicted application frame times rather than Vsync timing, the system ensures both display stability (Vsync continues to drive display) and application frame synchronization (events delivered when application needs them).
Solution Approach 2:
The system dynamically adjusts the timing of input event delivery based on the application's actual frame generation rate. Instead of fixed Vsync-triggered delivery, the OS predicts and adapts to variable application frame rates, making the event delivery dynamic and synchronized with application needs while maintaining display refresh stability.
Data Source
AI summary
A touch display device control method, applied to a touch display device installed with an application and comprising a touch sensor, comprising: (a) receiving a first input event from the touch sensor, by an operating system of the touch display device; and (b) the operating system delivering the first input event or a predicted input event to the application before and responding to a start operation of a first frame generation required by the application. A touch display device which uses the touch display device control method is also disclosed.