Remote Display Tile Encoding for Network Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing methods for remote display systems face challenges such as increased complexity, cost, and performance degradation due to high network traffic and latency, especially when handling complex graphics and video streams, and they often require a client CPU for rendering, leading to poor user experience and increased maintenance costs.
Innovation Solution
An adaptive pull-based method that synchronizes frame buffer access and display encoding with the refresh rate of a remote display endpoint, using a remote display controller to generate display timing and optimize network usage, allowing early data requests during congestion and minimizing latency by encoding and decoding images just in time for display, while also providing alternative configurations for graphics subsystems and dedicated network connections.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If graphic commands are transmitted across the network to a remote system, then the user interface can be separated from the processing components, but the network traffic and system latency increase significantly
Solution Approach 1:
The patent segments the frame buffer into multiple tiles that can be independently encoded and transmitted. This allows selective transmission of only changed regions rather than entire frames, reducing network traffic and latency while maintaining remote display functionality
Solution Approach 2:
The patent implements predictive pre-fetching where the remote display controller predicts which tiles will be needed next and requests them in advance. This preliminary action reduces waiting time and latency by ensuring data is ready before it's needed for display
2Device complexity
If the frame buffer is accessed and transmitted without synchronization to network conditions, then the display updates can be simple, but the network congestion causes increased latency and poor user experience
Solution Approach 1:
The patent implements dynamic adaptation where the encoding and transmission process adjusts based on real-time network conditions. The system monitors network status and dynamically modifies tile selection, encoding quality, and transmission timing to optimize performance under varying network latency conditions
Solution Approach 2:
The patent incorporates feedback mechanisms where the remote display controller monitors network conditions and sends information back to the host system. This feedback loop enables the system to adapt encoding and transmission parameters based on actual network performance, reducing latency impact
3Adaptability or versatility
If a client CPU is required for rendering at the remote system, then the remote display can function independently, but the equipment cost and maintenance requirements increase
Solution Approach 1:
The patent extracts the rendering function from the remote client system and consolidates it at the host system. By transmitting already-rendered tile data instead of requiring remote rendering capabilities, the solution eliminates the need for client CPUs while maintaining remote display independence
Solution Approach 2:
The patent uses a display controller at the remote system that copies tile data from the host system's frame buffer directly to the display output. This copying approach enables remote display functionality without requiring complex client-side processing hardware
Data Source
AI summary
A method of transmitting encoded computer display images between computers over a nondeterministic network is disclosed. During a display session in which images are transmitted from a host to a client, the client requests sections of encoded image updates at a predetermined time in advance of when the requested at least one section is to be transmitted by the display controller. When the requested section is received, a time value is compared to a display controller timing value and, if the difference between the compared times is outside of an acceptable range, the client adjusts a predetermined time at which time the client requests image sections from the host.