Composition Control for Remote Desktop Latency Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In remote computing systems, the traditional methods for managing the transport and composition of media and image sequences across distributed servers and client devices often result in suboptimal user experiences due to bandwidth limitations and latency, leading to inefficiencies in content delivery and composition.
Innovation Solution
A network of transport and composition control elements dynamically reconfigures to manage the composition of remote desktops and applications, anticipating user preferences and administrative policies, and optimizing interactivity by requesting changes directly from nodes rather than relying on round-trip network delays, allowing for efficient management of diverse content streams and improving user interface responsiveness.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional round-trip network communication is used for composition control, then system reliability is maintained, but latency increases and responsiveness deteriorates
Solution Approach 1:
The patent implements preliminary action by having the client device determine display composition information locally before network transmission is needed. The client proactively calculates occlusion coordinates and composition data based on local window manager events, eliminating the need to wait for server responses. This preliminary local processing resolves the contradiction by maintaining system reliability through structured communication while dramatically reducing latency through advance local decision-making.
2Ease of operation
If distributed composition control is implemented at client end, then responsiveness is improved, but device complexity increases
Solution Approach 1:
The patent applies segmentation by dividing the composition control functionality into distinct modular components: a display composition module that determines overall layout, an occlusion detection module that identifies hidden regions, and a coordinate calculation module that computes transmission parameters. This modular segmentation enables the client device to handle composition control locally with improved responsiveness while keeping each component's complexity manageable and well-defined.
3Productivity
If occluded portion transmission is optimized, then network efficiency is improved, but manufacturing precision of composition control increases
Solution Approach 1:
The patent implements local quality by applying different processing precision to different regions of the display composition. Instead of uniformly processing all screen regions, the system specifically identifies occluded portions and calculates their coordinates with high precision only when necessary for accurate composition reconstruction. This selective precision approach improves network efficiency by transmitting only essential occluded region data while maintaining sufficient composition control accuracy for user experience.
Data Source
AI summary
A method for communicating an image stream, one embodiment comprising negotiating, between a server and client, an MTCC identifying: a window as a portion of a display of the client, and an occluded portion of the window defined by the client; generating, by the server, complying with the MTCC, a sequence of image frames each comprising pixel data in a portion of the frame identified by the occluded portion; transmitting an encoding of a first frame of the sequence not including an encoding of the pixel data in the portion of the first frame; identifying, by the server, an event associated with the sequence; and transmitting, before communication between the server and the client regarding the event, by the server, information of the event in conjunction with an encoding of a second frame of the sequence including an encoding of the pixel data in the portion of the second frame.