External Application Streaming for Cross-Device App Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face limitations in seamless cross-device functionality due to incompatibilities between different types of devices, leading to lost functionality and suboptimal user experiences, particularly in application operation and user interface compatibility.
Innovation Solution
Application streaming is enabled through wireless transmission of a virtualized remote display from one device to another, allowing control of applications on a second device via a graphical user interface on the first device, using encoded virtualized remote displays and distinct communication links for pairing and data transfer.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If application streaming is implemented across different device types, then cross-device compatibility and user experience consistency are improved, but network bandwidth consumption and system complexity increase
Solution Approach 1:
The patent introduces a display stream generator as an intermediary component that captures the display output of the application on the second device and transforms it into a streamable format. This intermediary layer enables compatibility between different device types by mediating the display protocol differences, allowing the first device to receive and display the application interface without requiring native application support on each device type.
Solution Approach 2:
The system creates a visual copy of the application interface by capturing the display stream from the second device. Instead of running the application natively on each device type, the patent copies the visual output of the application and transmits it to the first device, where it is displayed through a virtualized remote display. This copying approach ensures consistency across different device types while avoiding the complexity of porting applications to each platform.
2Ease of operation
If real-time application control is enabled through wireless streaming, then user interaction capability is improved, but latency and bandwidth requirements increase
Solution Approach 1:
The display stream generator operates by periodically capturing and transmitting display frames at optimized intervals rather than continuously streaming every pixel change. This periodic transmission reduces bandwidth consumption and latency by sending updates only when necessary, while still maintaining real-time user interaction capability. The system balances the trade-off between update frequency and resource consumption.
Solution Approach 2:
The patent dynamically adjusts streaming parameters such as frame rate, resolution, and compression level based on network conditions and user interaction patterns. When user interaction is detected, the system increases the streaming quality and update frequency to reduce latency. During idle periods, it reduces the parameter values to conserve bandwidth, thereby optimizing the balance between real-time responsiveness and resource efficiency.
3Adaptability or versatility
If virtualized remote display is implemented on the first device, then application accessibility is improved, but memory and processing resources on the first device increase
Solution Approach 1:
The patent extracts the heavy computational workload of application execution and display rendering from the first device and relocates it to the second device. The first device only receives the encoded display stream and presents it through a lightweight virtualized remote display interface. This extraction approach allows the first device to access applications without requiring substantial memory or processing resources, as the resource-intensive operations are performed remotely on the second device.
Data Source
AI summary
The technology provides a system capable of pairing, via at least one wireless connection, a first client device (102,602) to a second client device (302,604), allowing the client devices to directly communicate; generate, by one or more processors of the second client device (402), and communicate, via the at least one wireless connection, an encoded virtualized remote display of an application where the application is running on the second client computing device (302,604); streaming the application on the first client device (102,602) including presenting on a graphical user interface (GUI) (106,1200,1900,2300,2500) a virtualized remote display (1502,1902,2302), based on an encoded virtualized remote display, of the application on the first client device (102,602) to enable a user of the first client device (102,602) to control the application running on the second client device (302,604).