Touch Intermediary Machine for Multi-Device Input Routing
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional touchscreen interfaces are inadequate for handling multiple interactions simultaneously, especially when multiple computing devices are connected, leading to issues like ignored touch interactions and difficulties in configuring layouts and mapping interactions to devices.
Innovation Solution
A method and apparatus that utilize an interaction analyser to receive and process user interactions on a touchscreen display panel, comparing them to predetermined known interactions, and if not recognized, determine the associated client devices and send the information for proper handling, allowing for seamless interaction with multiple computing devices through a single interface.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If conventional touchscreen interfaces are used with multiple connected computing devices, then the system can display multiple images simultaneously, but the interface cannot handle multiple interactions at once leading to ignored touch interactions and incorrect routing
Solution Approach 1:
The patent introduces an intermediary component (interaction analyser or TIM) that sits between the touchscreen interface and multiple computing devices. This intermediary captures touch interactions, analyzes them to determine intent, and routes them to the appropriate computing device, enabling reliable handling of multiple simultaneous interactions across multiple devices without requiring changes to the conventional touchscreen interface itself.
Solution Approach 2:
The system implements feedback mechanisms where the interaction analyser receives information about displayed images from computing devices, uses this feedback to determine which device should receive specific touch interactions, and continuously adjusts routing based on the current display state. This feedback loop ensures that interactions are consistently routed to the correct device even as the display configuration changes.
2Productivity
If multiple computing devices are connected to a single touchscreen display panel, then diverse information can be viewed simultaneously, but configuring the layout and mapping interactions to devices becomes difficult
Solution Approach 1:
The interaction analyser automatically performs layout configuration and interaction mapping without requiring manual setup. It monitors which computing devices are connected, determines their optimal layout positions on the touchscreen, and automatically establishes the mapping between touch locations and target devices. This self-configuration capability eliminates the complexity of manual layout and interaction mapping while maintaining high information viewing efficiency.
Solution Approach 2:
The system performs preliminary actions by pre-establishing interaction patterns and layout configurations before user interactions occur. The interaction analyser pre-processes information about connected devices and their display content, preparing the routing logic in advance so that when users interact with the touchscreen, the correct device is immediately identified and activated without requiring real-time configuration decisions.
3Device complexity
If the touchscreen interface directly controls multiple computing devices without an interaction analyser, then the system architecture is simpler, but some touch interactions are ignored and users can drag objects across device boundaries incorrectly
Solution Approach 1:
The interaction analyser serves as a necessary intermediary layer that prevents loss of touch interaction information. It captures all touch interactions, analyzes their intent based on the current display layout, and routes them to the appropriate computing device. This intermediary layer adds minimal complexity while completely preventing the information loss that occurs with direct control, where touch interactions could be ignored or incorrectly routed across device boundaries.
Data Source
Figure 1a
Figure 1b
Figure 2
AI summary
A number of computing devices (13) are controlled from a touchscreen display system (11) using a Touch Intermediator Machine (TIM) (12) receiving information indicating the location of one or more touches on a connected touchscreen panel (11). The TIM (12) determines whether the pattern of touches received matches one of a pre-programmed set of interface manipulation gestures. If so, the TIM (12) alters the user interface presented on the connected touchscreen display system (11) depending on the gesture detected. If not, the TIM (12) determines the connected computing device (13) associated with the location of the touch received and updated co-ordinates of the touch received within an area on the touchscreen display system (11) associated with the connected computing device (13). The TIM (12) transmits information to the relevant connected computing device (13) regarding the touch received. The computing device (13) processes the information to determine the pattern of touches received and responds to the pattern of touches received according to predetermined instructions for user interaction.