Remote Display Graphics Native Rendering Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Traditional display mirroring techniques are processor-intensive, suffer from high latency, and result in low image quality due to data encoding and resolution mismatches between source and target devices, making them unsuitable for applications requiring low latency and high quality, such as video games and web browsing.
Innovation Solution
The system transmits higher-level graphical instructions from the source device to the target device, allowing native execution and rendering, which reduces processing load, minimizes data loss, and adapts to the target device's configuration, thereby improving image quality and reducing bandwidth consumption.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If traditional display mirroring techniques are used to transmit display data from source device to target device, then display sharing functionality is achieved, but processor load increases and latency increases
Solution Approach 1:
The patent extracts only the essential graphical commands from the complete display data stream. Instead of transmitting entire frames or encoded video data, the system identifies and transmits only the critical rendering instructions needed to reproduce the display output on the target device, significantly reducing data volume and transmission time
Solution Approach 2:
The display data is segmented into hierarchical components: graphical commands are separated from full frame data. The system divides the rendering pipeline into command generation at the source and command execution at the target, allowing independent optimization of each stage and reducing the bottleneck in data transmission
2Quantity of substance
If display data is encoded to reduce data size for transmission, then bandwidth consumption decreases, but image quality deteriorates due to lossy compression
Solution Approach 1:
The patent replaces the traditional encoding-compression-decoding mechanical process with a command-interpretation system. Instead of compressing pixel data through lossy algorithms, the source device generates graphical commands that describe what to render, and the target device executes these commands to produce the visual output, eliminating compression artifacts entirely
Solution Approach 2:
Rather than compressing the final rendered image data and decompressing it at the target device (traditional approach), the system inverts the process by transmitting the rendering instructions themselves and letting the target device perform the rendering locally, thereby avoiding compression/decompression cycles and their associated quality losses
3Device complexity
If display data is transmitted at fixed resolution from source device, then transmission process is simplified, but image quality on target device with different resolution deteriorates
Solution Approach 1:
The system introduces dynamic resolution adaptation by including display configuration parameters in the transmitted graphical commands. The target device's actual display resolution is detected and used to adjust rendering parameters on-the-fly, allowing the same command set to produce optimal results across devices with different screen characteristics without complicating the core transmission mechanism
Data Source
AI summary
Images displayed on a source device may be displayed on a target device. The source device may send the target device graphical commands and information to be processed natively at the target device, rather than duplicating the screen of a source device at the target device. Graphical elements to be used by the target device may be sent with the graphical commands or may be sent during out-of-band configuration exchanges between the source and target devices to reduce latency during display sharing.