Remote Display Management for Touch Input Conflict Resolution
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remotely displayed applications on touch-screen devices often obscure input fields due to the activation of native control elements, making user input difficult, as they are not formatted for touch-screen input and require manual activation rather than automatic triggering.
Innovation Solution
A system where a remote computing device notifies a client device to modify the application display to avoid obscuration by active native control elements, determining the type of control element receiving focus and activating a matching native control element, and transmitting confirmation and update messages, including status information and user interaction notifications.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If native control elements are activated on the client device for touch-screen input, then ease of operation is improved, but the remoted application display is obscured
Solution Approach 1:
The patent applies dimensionality change by moving the application display to a different spatial dimension (remote server) while keeping the control elements in the local dimension (client device). This allows the application window to be displayed remotely on the server while control elements remain accessible locally on the touch-screen device, eliminating the obscuration problem while maintaining ease of operation.
Solution Approach 2:
The system segments the user interface into two distinct parts: the application display (rendered remotely on the server) and the control elements (activated locally on the client device). This segmentation allows each component to function in its optimal environment without interfering with the other, resolving the contradiction between display visibility and input accessibility.
2Loss of information
If the application display is modified to avoid obscuration, then visibility of the remoted application is improved, but device complexity increases
Solution Approach 1:
The patent introduces an intermediary component (the remote server) that handles the complexity of display management. The server receives input from local control elements, manages the application display state, and sends updated display data back to the client. This intermediary approach improves display visibility while preventing the complexity from accumulating on the client device.
Solution Approach 2:
The system creates a copy of the application display environment on the remote server, allowing the full application interface to be rendered there while the client device only needs to handle simple control element activation. This copying approach maintains full display visibility without requiring the client device to manage complex display modifications.
3Adaptability or versatility
If manual activation of control elements is required, then device compatibility is improved, but productivity decreases
Solution Approach 1:
The system implements self-service by automatically detecting when a control element should be activated based on user interaction with the remote application display. The client device monitors the display state and automatically triggers the appropriate native control elements without requiring manual user activation, thereby improving productivity while maintaining device compatibility through automatic adaptation.
Solution Approach 2:
The patent establishes a feedback loop where the client device continuously monitors the remoted application display state and automatically activates control elements in response to detected focus changes or user interactions. This feedback mechanism enables automatic control element activation that adapts to different device types, improving both productivity and device compatibility simultaneously.
Data Source
AI summary
In some remote application execution environments, a client device (e.g., to which application output is sent and where user interaction is performed) may include native control elements for touch input such as virtual keyboards, virtual pickers and the like. When the server device detects an editable/control field of a remoted application receiving focus, the server may instruct the client to activate a native control element for user interaction. The client may determine the manner in which to modify an application display to resolve potential display conflicts. For example, a native control element may obscure or hide portions of the remoted application on the client display. Modifying the application display may include panning the display, zooming into or out of portions of the display, adapting the display for scrolling, and the like. The remote computing device may also transmit values for populating a native control element.