Command Translation Module for Touchscreen Gesture Compatibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote access systems face limitations due to incompatibility between traditional I/O devices and touchscreen-based devices, as operating systems designed for mouse clicks and keystrokes cannot interpret touchscreen gestures like finger taps and swipes, hindering cross-platform application execution.
Innovation Solution
A networked computing system and method that translate motion-based user input from touchscreen devices to native I/O operations supported by application host computers, using a command translation module within a virtual interface driver to convert iOS-specific I/O commands into Windows-specific commands, enabling cross-platform application execution.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If traditional I/O devices (mouse, keyboard) are used to access applications on host computers, then compatibility with host computer operating systems is maintained, but functionality on touchscreen devices is lost
Solution Approach 1:
A command translation module is introduced as an intermediary component between the touchscreen client device and the host computer operating system. This module translates touchscreen gestures (tap, swipe, pinch) into equivalent traditional I/O commands (mouse clicks, scroll wheel movements), enabling the host system to interpret and execute gestures from touchscreen devices without requiring changes to the host OS.
2Ease of operation
If touchscreen gestures are directly supported by the host computer operating system, then ease of operation on touchscreen devices is improved, but device complexity increases
Solution Approach 1:
Instead of modifying the host computer's operating system to directly support touchscreen gestures, a separate command translation module is deployed on the client device. This intermediary translates gestures before transmission to the host, keeping the host OS simple and unchanged while still enabling gesture support.
Solution Approach 2:
The gesture translation functionality is segmented from the host operating system and placed on the client device. This allows the host OS to remain simple and platform-specific, while the client device handles the complexity of translating various touchscreen gestures into universal commands compatible with the host system.
3Adaptability or versatility
If motion-based user input is translated to native I/O operations, then adaptability between different device types is improved, but processing complexity increases
Solution Approach 1:
The command translation module serves as an intermediary that handles all translation processing on the client device side. It receives raw touchscreen gesture data, translates it into equivalent traditional I/O commands, and transmits these simplified commands to the host computer, thereby isolating the processing complexity from the host system.
Solution Approach 2:
The system changes the parameter representation of user input from motion-based gestures (tap, swipe, pinch coordinates and movements) into traditional I/O command parameters (mouse position, click events, scroll delta). This parameter transformation enables compatibility between different input modalities without requiring fundamental changes to the host system's command processing architecture.
Data Source
AI summary
A system that translates motion-based user input between a client device and an application host computer. In various embodiments, the system and methods enable an application host computer, application server, or cloud server that supports a first type of input/output (I/O) devices (e.g., mouse, keyboard, and display) to interpret I/O commands from a client device that supports a second type of I/O devices (e.g., touchscreen display), wherein the I/O commands of the client device support motion-based user input. The operations of the interpreted I/O commands are then returned from the application host computer, application server, or cloud server to the client device and rendered on the display thereof. The system and methods enable cross-platform application execution by translating I/O operations that are native to the user's remote device to I/O operations that are native to the application host computer, application server, or cloud server.