Remote User Interface Compression for Bandwidth Efficiency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote terminal user interfaces are limited by high bandwidth requirements, making them unsuitable for dynamic displays due to the need to transmit entire video frames, which restricts their flexibility and detail.
Innovation Solution
Compressing the interactive user interface prior to transmission, allowing it to be decompressed independently of video content at the client side, reducing bandwidth needs and enabling more detailed and dynamic displays without modifying client device hardware, and allowing positioning and scaling to be handled by the video client.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If remote terminal user interfaces transfer the entire video frame buffer from the second device to the first device for remote rendering, then the interface is more flexible as to client device type and uses a lower complexity mechanism, but the bandwidth requirement becomes relatively high which limits dynamic displays
Solution Approach 1:
The patent segments the video frame buffer transmission by identifying and transmitting only the changed portions (dirty rectangles) rather than the entire frame buffer. This segmentation allows dynamic displays to be transmitted with reduced bandwidth while maintaining compatibility with various client device types through the standardized remote terminal interface protocol.
2Quantity of substance
If protocol-specific remote user interfaces are used, then bandwidth efficiency is improved and dynamic user interfaces are supported, but the interface is limited to servicing very specific client devices rather than standardized client devices
Solution Approach 1:
The patent makes the remote terminal interface universal by implementing a standardized protocol that can service multiple client device types. The interface uses common video compression techniques and standardized communication protocols, allowing the same infrastructure to serve diverse client devices while maintaining bandwidth efficiency through optimized transmission of only changed frame portions.
3Device complexity
If the entire video frame buffer is transmitted for remote rendering, then the mechanism complexity is reduced and client device flexibility is improved, but the display detail and dynamics are limited due to high bandwidth needs
Solution Approach 1:
The patent applies preliminary action by pre-processing the video frame buffer to identify changed portions (dirty rectangles) before transmission. This preliminary identification allows the system to transmit only the necessary data for maintaining pixel-accurate dynamic displays, achieving high display detail without the complexity of transmitting entire high-resolution frames continuously.
Data Source
AI summary
An interactive user interface, such as a remote terminal user interface, is compressed prior to transmission to a video client. The compression may be performed independently of any other video that may be simultaneously transmitted to the video client. At the client side, two compressed video streams (remote user interface and video content) may be decompressed independently of each other. In some cases, technology already existing in some client devices, such as picture-in-picture (PiP) capability, may be leveraged to decompress the received compressed remote user interface without needing to modify the hardware of those client devices.