Host Streaming Unit Dynamic Input Emulation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Users experience input limitations when streaming applications that require keyboard and mouse interactions, as these are not always supported by remote devices, leading to a suboptimal user experience.
Innovation Solution
A computer streaming system that dynamically provides emulated native input support for remote user devices by detecting unsupported user interfaces and offering on-screen keyboards and joystick-controlled mouse functionality, switching back to native input when support is detected.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If the system uses native input control for streamed applications, then the remote user device can interact with content using its native input methods, but the user experience deteriorates when the remote device cannot provide required input capabilities
Solution Approach 1:
The system introduces an intermediary layer that translates between the application's required input methods and the remote device's available input methods. When the remote device lacks native support for required inputs (e.g., keyboard for text entry), the system provides alternative input interfaces that bridge this capability gap, allowing the user to interact with the application as if native support were present.
Solution Approach 2:
The system dynamically changes the input parameters and methods available to the user based on the detected application requirements and remote device capabilities. When text input is required but not natively available, the system transforms the interaction paradigm by providing on-screen keyboards or alternative input methods, effectively changing the input parameters to match both application needs and device capabilities.
2Ease of operation
If the system provides emulated native input support for all applications, then user interaction capability is maintained, but system complexity increases
Solution Approach 1:
The system dynamically adjusts the level of emulated input support based on real-time detection of application requirements and device capabilities. Rather than providing static comprehensive emulation for all applications, the system activates specific emulation layers only when and where needed, reducing overall system complexity while maintaining user interaction capability for supported scenarios.
Solution Approach 2:
The system applies emulated native input support selectively to specific applications or input scenarios rather than globally. When a particular application requires keyboard input and the remote device lacks this capability, the system provides localized emulation for that specific interaction context, rather than implementing comprehensive input emulation across all applications, thereby reducing overall system complexity.
3Ease of operation
If the system detects and responds to unsupported user interfaces dynamically, then user experience is maintained, but processing overhead increases
Solution Approach 1:
The system performs preliminary detection of application input requirements and remote device capabilities at the start of the streaming session or when applications are launched. By anticipating which input methods will be needed before actual interaction occurs, the system can pre-configured appropriate emulation layers or alternative input interfaces, reducing the need for continuous dynamic detection and response during user interaction, thereby lowering processing energy consumption.
Data Source
AI summary
A computer streaming system includes a remote user device and a host streaming unit. The host streaming unit determines input methods suitable for the remote user device to interact with content streamed to the remote user using a selected application. The host streaming unit detects whether a user interface of the selected application is supported by the remote user device and dynamically institutes emulated native input support for the remote user device when the host streaming unit detects the user interface of the selected application is not supported by the remote user device. Additionally, the host streaming unit dynamically dismisses emulated native input support for the remote user device when the host streaming unit detects the user interface of the selected application is supported by the remote user device, causing the remote user device to return to native input control. Also provided is a method of streaming a computer application.