Touch Screen Emulation for Virtual Machines
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current virtualization systems face difficulties in emulating touch screen interactions for virtual machines, as touch screen keyboards cannot be displayed within the VM window and gestures are not accurately translated, leading to an unsatisfactory user experience.
Innovation Solution
A mechanism is introduced where a VM client on a touch device captures touch gestures and sends offset information to the VM hypervisor, allowing the VM to emulate a touch screen keyboard and accurately interpret gestures, enabling seamless interaction within the VM window.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Area of stationary object
If the VM window is launched into full screen size, then the VM can be displayed without obstruction, but the touch screen keyboard provided by the touch device OS cannot be displayed within the VM window
Solution Approach 1:
The patent extracts the keyboard display function from the touch device OS and relocates it within the VM window. The VM client captures touch events and the hypervisor emulates a touch screen keyboard that is rendered inside the VM window boundaries, separating the keyboard functionality from the host OS display layer.
Solution Approach 2:
The patent implements nesting by placing the emulated touch screen keyboard inside the VM window, which itself is displayed within the host device interface. This creates a nested structure where the keyboard is contained within the VM's display boundaries, allowing full-screen VM operation while maintaining keyboard accessibility.
2Adaptability or versatility
If the VM window is re-sized to allow display of both the VM window and the touch screen keyboard, then both can be displayed, but the process is cumbersome and does not result in an aesthetically pleasing view
Solution Approach 1:
The patent performs preliminary action by automatically configuring the keyboard display within the VM window before the user needs to interact. The system pre-establishes the keyboard's position and integration within the VM's display space, eliminating the need for manual window resizing or configuration by the user.
3Extent of automation
If touch gestures are translated to mouse and keyboard events, then the VM can receive input commands, but some gestures like zoom gestures are interpreted by the touch device instead of being forwarded to the VM
Solution Approach 1:
The patent implements feedback by having the VM client capture touch gestures, send offset information to the hypervisor, and receive processed events back. This feedback loop allows the system to intercept gestures before the touch device interprets them, translate them accurately to VM-appropriate events, and ensure proper delivery to the VM application.
Solution Approach 2:
The patent introduces an intermediary layer consisting of the VM client and hypervisor between the touch device and the VM. This intermediary captures touch gestures, translates them to appropriate VM events, and forwards them to the VM, preventing direct interpretation by the touch device while maintaining accurate gesture translation.
Data Source
AI summary
A mechanism for touch screen emulation for a virtual machine is disclosed. A method of the invention includes providing an emulation of a touch screen device to a virtual machine (VM) managed by a hypervisor for emulation of the touch screen device by the VM, receiving touch gesture information related to a touch gesture received in the session window of the VM that is managed by the hypervisor, sending an interrupt to the VM that informs the VM of detected touch screen activity in the session window of the VM on the touch screen device, wherein in response to the interrupt the VM receives the touch gesture information in order to utilize in determining screen coordinates of the touch gestures within the session window of the VM.