Touch Prediction Software for Latency Compensation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Touch screens experience latency issues, which can impede user interactions and reduce productivity, as the processing of touch inputs is not instantaneous, leading to lag that affects the accuracy and responsiveness of user commands.

Innovation Solution

Incorporating touch prediction software that compensates for latency by predicting subsequent touch positions based on sensed positions and characteristics, such as the number of contact points and trajectory, allowing for improved user interaction by selecting between sensed and predicted positions to enhance the touch screen's responsiveness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If touch input processing is performed through multiple hardware and software components, then the touch screen can recognize different types of touches and provide comprehensive functionality, but latency and lag occur that reduce responsiveness and user experience

Engineering Contradiction:
Improvetouch recognition capabilityVSAvoidprocessing latency
Core Design Contradiction:
Adaptability or versatilityVSLoss of time

Solution Approach 1:

The patent applies preliminary action by predicting future touch positions before the actual touch occurs. The system analyzes current touch position, velocity, and acceleration to calculate where the touch will be in the next time interval, and pre-prepares the corresponding UI state. This allows the display to show the touch feedback at the predicted position rather than waiting for the actual touch to be processed, effectively compensating for processing latency.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the touch processing pipeline includes noise filtering and multiple processing stages, then measurement accuracy of touch positions is improved, but the processing time increases causing perceivable lag

Engineering Contradiction:
Improvetouch position accuracyVSAvoiduser interaction speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent introduces an intermediary prediction layer between the touch sensing hardware and the UI rendering system. Instead of directly processing raw touch data through the complete pipeline, the system inserts a prediction module that generates predicted touch positions based on motion patterns. This intermediary allows the UI to respond to predicted positions while the full processing pipeline continues to refine actual touch measurements in the background, decoupling response speed from processing accuracy.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Speed

If the system uses sensed touch positions directly for display feedback, then the response is timely, but the feedback appears lagged to users due to processing delays in the touch pipeline

Engineering Contradiction:
Improvedisplay response speedVSAvoidperceived touch accuracy
Core Design Contradiction:
SpeedVSMeasurement precision

Solution Approach 1:

The system performs preliminary calculation of predicted touch positions using motion physics models before the actual touch processing completes. By calculating where the touch will be based on current velocity and acceleration vectors, the system can display feedback at the correct perceived position while the full measurement pipeline continues to process. This creates the appearance of instantaneous response while maintaining accurate touch measurement through the complete processing chain.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS10452188B2Predictive compensation for a latency of an input device
Publication Date: 2019.10.22 MICROSOFT TECHNOLOGY LICENSING LLC
  • US10452188B2 patent drawing
  • US10452188B2 patent drawing
  • US10452188B2 patent drawing

AI summary

A computer configured to selectively use prediction to compensate for a latency of an input device. The input device may be a touch screen. Processing of touch inputs may lead to a latency between the user performing a touch input and the touch screen display responding to the touch input. A touch screen component predicts a subsequent position of a touch contact point based on the sensed positions of the touch contact point. The component may be a software component that provides a predictive output that can be selectively used based on a characteristic of a touch input. The component may be generic such that it may be applied on multiple types of computers equipped with different types of touch sensing hardware configured with any suitable settings. The component's output may be used to control the touch screen display.