Contextual Zoom for Touchscreen Virtualized Applications
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Touch-enabled devices struggle to accurately interpret touch gestures for virtualized applications designed for desktop environments, particularly due to the lack of precision in selecting small interface elements without a mouse, leading to difficulties in navigating legacy applications on mobile devices.
Innovation Solution
A system with a client agent application on a user device communicating via a remote presentation protocol with a virtualization server, implementing a contextual zoom feature that allows users to zoom in on specific areas of interest, enabling precise interaction with touchscreen interfaces by calculating and applying a zoom factor to display a zoomed overlay of clickable elements.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If virtualized applications designed for desktop environments are accessed on touch-enabled devices, then users can access legacy applications remotely, but the precision of selecting small interface elements deteriorates due to lack of mouse support
Solution Approach 1:
The patent introduces a pointer simulation mechanism that acts as an intermediary between the touchscreen and the virtualized application interface. A virtual pointer is displayed on the touchscreen to indicate the current touch location, and touch gestures are translated into simulated mouse pointer movements and clicks within the virtualized application environment. This mediator enables precise selection of small interface elements by providing visual feedback and translating touch coordinates into application-specific pointer actions.
Solution Approach 2:
The patent replaces the physical mouse mechanism with a software-based pointer simulation system. Instead of relying on a physical pointing device, the system uses touchscreen coordinate mapping and virtual pointer rendering to achieve equivalent functionality. The touch gestures are converted into pointer movements and click events that mimic mouse behavior, allowing users to interact with small interface elements on desktop virtualization interfaces using only their fingers.
2Ease of manufacture
If small interface elements are displayed for desktop applications, then application functionality is preserved, but ease of operation on touchscreen deteriorates
Solution Approach 1:
The patent replaces the need for physical mouse manipulation with a virtual pointer system that responds to touch gestures. The virtual pointer is rendered on the touchscreen surface and moves according to touch input, providing visual feedback that replaces the mechanical mouse cursor. This substitution maintains the original application interface design while enabling touchscreen operation through software-mediated pointer control.
Solution Approach 2:
The virtual pointer serves as an intermediary layer between the touchscreen input and the application interface. It translates touch coordinates into application-specific pointer positions and simulates click events at the appropriate locations. This mediator enables users to operate small interface elements by providing a visual indicator of touch location and translating finger taps into precise application commands.
3Measurement precision
If zoom functionality is added to improve touchscreen precision, then selection accuracy improves, but device complexity increases
Solution Approach 1:
The patent introduces a temporal dimension to the interaction model by implementing gesture duration and sequence recognition. Instead of relying solely on spatial zooming, the system interprets the timing and sequence of touch gestures to determine user intent. Long presses, double taps, and gesture sequences are distinguished based on their temporal characteristics, enabling precise interpretation of user actions without requiring interface magnification.
Data Source
AI summary
Methods and systems for bound based contextual zoom are disclosed. Legacy WINDOWS desktop and web applications were designed for a mouse or other high-precision pointing device, and as such, small controls and closely grouped controls/icons were commonly designed/used on the screen. Interacting with such applications remoted to a touch-based device (e.g., a smartphone or tablet) is difficult. Bound based contextual zoom overcomes at least some of these limitations by permitting a user to zoom in on an area of interest within an application or desktop, and for a period of time long enough to complete the touch interaction. The area zoomed might be a group of controls on a ribbon bar, the minimize/maximize/close buttons in the top-right corner of a window, a group of form input controls, or any other natural cluster of related user interface (UI) elements. The size of the area zoomed and the zoom factor applied are calculated to allow a user to complete their task without overly obscuring the rest of the application/desktop.