Display Touch Trajectory Prediction for Consistent Stylus Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing display apparatuses experience input lag (delay) when recognizing touches via a stylus pen, which varies depending on the location on the screen, leading to inconsistent user experience.
Innovation Solution
A display apparatus and method that adjusts the length of a predicted trajectory based on coordinate information and refresh rate, using processors to obtain input points and display a continuous trajectory in the next frame, accounting for buffering and display times to maintain consistent latency across the screen.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If the display apparatus displays touch trajectory in the next frame after detecting a touch, then the trajectory is displayed, but input lag occurs and varies depending on touch location
Solution Approach 1:
The patent applies preliminary action by calculating and displaying a predicted trajectory in advance before the actual touch trajectory is fully determined. The processor predicts where the touch will go based on initial touch information and displays this prediction immediately, rather than waiting for the complete trajectory. This reduces the perceived input lag by showing the user what will happen next, while still maintaining accuracy as the full trajectory is confirmed in subsequent frames.
2Stability of the object's composition
If the display apparatus uses a fixed refresh rate to update frames, then the display is stable, but the delay time varies depending on where the touch is detected on the screen
Solution Approach 1:
The patent applies local quality by adjusting the predicted trajectory length based on the local position where the touch is detected. Different regions of the screen have different buffering times due to the scanout process, so the patent calculates the specific position of the touch and adjusts the predicted trajectory length accordingly. This ensures that regardless of where on the screen the touch occurs, the predicted trajectory compensates for the local buffering time, maintaining consistent perceived latency across all screen regions while preserving the stable fixed refresh rate.
3Measurement precision
If the display apparatus displays the complete touch trajectory, then accuracy is maintained, but the latency is perceptible to the user
Solution Approach 1:
The patent applies preliminary action by displaying a predicted trajectory that anticipates the user's next movement. Instead of waiting for the complete touch trajectory to be formed before displaying anything, the system predicts the trajectory based on initial touch information and displays it immediately. This gives the user immediate visual feedback that reduces perceived latency, while the system continues to track the actual trajectory to maintain accuracy.
Solution Approach 2:
The patent applies feedback by continuously comparing the predicted trajectory with the actual touch trajectory and adjusting accordingly. The system displays the predicted trajectory as feedback to the user, then refines this prediction as more touch data becomes available. This creates a dynamic feedback loop that improves both the responsiveness (reducing perceived latency) and accuracy of the trajectory display.
Data Source
AI summary
A display apparatus includes: a memory storing one or more instructions; a display panel comprising a touch sensor; and at least one processor, wherein the one or more instructions, when executed by the at least one processor, cause the display apparatus to: obtain a first input point corresponding to a first touch on a screen, obtain a second input point corresponding to a second touch on the screen, control the display panel to display a touch trajectory based on the first input point and the second input point in a next frame subsequent to the second frame, obtain a predicted trajectory based on the first input point and the second input point, display the predicted trajectory with an adjusted length with the touch trajectory in the next frame such that the touch trajectory and the predicted trajectory with the adjusted length form a continuous trajectory in the next frame.