Touch Apparatus With Local Predictive Feedback for Remote Displays
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing touch-sensitive systems experience significant latency when interacting with remote devices, particularly for interactions like writing or drawing, due to round trip delays in encoding, transmitting, and processing interaction data, leading to an unsatisfying user experience.
Innovation Solution
An interactive device generates a predictive interaction indication by imaging the remote device's output area corresponding to the interaction location, determining an interaction indication based on pre- and post-interaction images, and displaying this indication before the updated remote output is received, thereby reducing perceived latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If interaction data is transmitted to a remote device for processing, then the remote system can be controlled, but significant latency is introduced between the physical interaction and the visual indication of the interaction
Solution Approach 1:
The system performs preliminary actions by capturing interaction data locally and preparing visual feedback locally before the remote device processes the interaction. The local device captures the interaction at the touch surface, generates a visual indication immediately, and then transmits both the interaction data and the pre-generated visual indication to the remote device. This preliminary local processing eliminates the waiting time that would otherwise occur while awaiting remote device processing.
Solution Approach 2:
The local touch-sensitive display acts as an intermediary between the user and the remote device. Instead of directly transmitting interaction data to the remote device and waiting for processing, the local display intercepts the interaction, generates a visual indication locally, and transmits this intermediate visual feedback to the remote device. This intermediary approach allows the user to see immediate visual feedback without waiting for the remote device's processing cycle.
2Speed
If the scan rate of the touch-sensing apparatus is increased to reduce latency, then the responsiveness improves, but the complexity of the system increases
Solution Approach 1:
The system extracts the visual indication generation function from the remote device and performs it locally at the touch-sensitive display. By taking out this processing step from the remote device and executing it locally, the system achieves faster visual feedback without requiring the remote device to operate at higher scan rates, thus avoiding the complexity increase that would result from accelerating the remote device's processing.
3Productivity
If faster processors are used to carry out touch decoding faster, then the touch signal processing speed increases, but the cost and complexity of the device increases
Solution Approach 1:
The local touch-sensitive display performs self-service by generating visual indications locally based on captured interactions without requiring high-speed processing at the remote device. The local device independently handles the visual feedback generation, reducing the processing burden and speed requirements of the remote device, thereby avoiding the need for expensive, high-speed processors at the remote end.
Data Source
AI summary
An interactive device is described that is configured to: display an output of a remote device, wherein an output delay exists between the output being generated by the remote device and the output being displayed on the interactive device, generate an interaction data in dependence on an interaction with the interactive device at a location, transmit the interaction data to the remote device, display an updated output of the remote device, the updated output being generated by the remote device subsequent to receiving the interaction data, wherein the interactive device being further configured to: generate an interaction image of an area of the updated output of the remote device corresponding to the location of the interaction, determine an interaction indication in dependence on the interaction image, displaying an interaction indication on the interactive device at a location of one or more further interactions with the interactive device.