Virtual Mouse Device Simulation for Remote Desktop Multi-Pen Support
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing remote desktop solutions only support a single mouse device, limiting the ability to utilize multiple interactive pen devices from a short-throw projector in interactive whiteboard systems, especially in network-based configurations where physical connections and driver installations are undesirable.
Innovation Solution
The method intercepts and processes raw input function calls to simulate multiple virtual mouse devices, allowing multiple pen devices from a client projector to be recognized and used by applications within a remote desktop session without requiring additional drivers or physical connections, by establishing a remote desktop services virtual channel and using hooking techniques to intercept and modify API calls.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple pen devices are connected to a client projector in a remote desktop session, then the interaction capabilities are enhanced, but the operating system unifies them into a single system pointer, making it impossible to use them as separate mouse devices
Solution Approach 1:
The patent creates virtual mouse device copies for each physical pen device. Instead of directly using the physical devices, the system generates virtual representations that can be independently controlled and assigned to different applications, while the physical devices remain connected to the client projector.
Solution Approach 2:
The patent introduces a translation layer that acts as an intermediary between the physical pen devices and the host operating system. This layer captures input from multiple pens on the client side and translates them into separate virtual mouse device inputs on the host side, allowing individual device control without requiring changes to the host OS.
2Reliability
If driver installation is required on the host system to recognize multiple mouse devices, then device recognition is improved, but the complexity of software installation and configuration increases
Solution Approach 1:
The patent places the device recognition and translation logic on the client side (projector) rather than requiring host-side drivers. The client captures multiple pen inputs and translates them into virtual mouse device formats that the host OS can recognize without additional drivers, eliminating complex installation requirements.
Solution Approach 2:
The patent replaces the traditional driver-based hardware recognition mechanism with a software-based virtual device approach. Instead of installing drivers to recognize physical hardware, the system creates virtual mouse devices through software translation, eliminating the need for host-side driver installation while maintaining reliable device recognition.
3Reliability
If physical connections are made between the projector and host PC for multiple device support, then device functionality is improved, but the network-based configuration becomes more complex and less desirable
Solution Approach 1:
The patent replaces physical connection requirements with network-based communication. Multiple pen devices are connected to the projector via its existing interfaces, and the projector translates and transmits the inputs over the network to the host PC, eliminating the need for additional physical connections between the projector and host.
Solution Approach 2:
The patent makes the projector serve multiple functions: it acts as both the display device and the input device host. The projector captures inputs from multiple pen devices and handles the translation and transmission over the network, allowing the same network connection used for display to also carry input data without requiring separate physical connections.
Data Source
AI summary
A computer (host), which is communicating with an interactive whiteboard projector (client) through a remote desktop connection, launches third-party applications supporting multiple mice (i.e. drawing pens) and provides these applications with virtual mouse device and input event signals for each pen device connected on the projector. The applications will behave as if the host system were configured with multiple installed mice, though no added driver or physical connected hardware is present.