Remote Rendering via Instructions for Wireless Bandwidth Optimization
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current Wi-Fi peer-to-peer remote display technologies face challenges with high power consumption, high wireless bandwidth requirements, and low quality graphics due to pixel domain compression using H.264 CODEC, which are exacerbated by increasing demands for higher resolution content and display refresh rates, pushing the limits of 802.11 ac and 802.11ad protocols.
Innovation Solution
The solution involves sending video as encoded content and rendering instructions to the sink device, allowing it to render the display itself, with pre-built resources sent upon application startup and text rendered on demand, thereby reducing the need for the source device to send rendered content and optimizing wireless bandwidth usage.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If pixel domain compression using H.264 CODEC is used for remote display, then video transmission is enabled, but power consumption increases and wireless bandwidth requirements increase
Solution Approach 1:
The patent segments the display content into different types (graphics, text, video) and processes each type differently. Graphics and text are rendered at the sink device using received instructions, while only video content is compressed and transmitted. This segmentation avoids applying H.264 compression to all content, reducing overall bandwidth and power consumption.
Solution Approach 2:
The patent extracts the rendering function from the source device and relocates it to the sink device. By sending rendering instructions instead of pre-rendered frames, the system removes the need for H.264 compression of static content, thereby reducing power consumption and bandwidth usage at the source device.
2Reliability
If pixel domain compression using H.264 CODEC is used for remote display, then video transmission is enabled, but wireless bandwidth requirements increase
Solution Approach 1:
The patent segments display content into graphics/text and video components. Graphics and text are transmitted as rendering instructions with minimal data, while only video content undergoes H.264 compression. This segmentation significantly reduces the total amount of data transmitted over the wireless connection.
Solution Approach 2:
Instead of the traditional approach where the source device renders and compresses all content then transmits it, the patent inverts the process by transmitting raw rendering instructions and having the sink device perform the rendering. This reversal eliminates unnecessary compression and transmission of data that can be regenerated at the destination.
3Manufacturing precision
If higher resolution content and display refresh rate are used, then display quality is improved, but the limits of 802.11 ac and 802.11ad protocols are pushed
Solution Approach 1:
The patent extracts static rendering elements (graphics, text layouts) from the video stream and handles them separately through instruction-based rendering. This extraction reduces the resolution-dependent data burden on the wireless protocol, allowing high-resolution content to be displayed without proportionally increasing bandwidth requirements.
Solution Approach 2:
The patent changes the data transmission parameter from compressed pixel data to rendering instructions. This parameter change allows the system to adapt to different resolutions without retransmitting entire frames, enabling high-resolution display while maintaining protocol capacity within limits.
4Quantity of substance
If rendering instructions are sent to sink device instead of pre-rendered content, then bandwidth usage is reduced, but device complexity increases
Solution Approach 1:
The patent enables the sink device to serve its own rendering needs by executing received instructions locally. This self-service approach transfers the rendering burden from the source device to the sink device, reducing bandwidth requirements while distributing processing complexity to the device that has direct access to the display hardware.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
Methods, systems, and devices are described for remote display of content in a wireless network. A source device capable of displaying content may identify one or more rendering instructions for content to be displayed remotely on a sink device. The source device may transmit the one or more rendering instructions to the sink device via a wireless peer-to-peer connection. The sink device may receive the one or more rendering instructions and may execute the one or more rendering instructions to render a display of at least part of the content. Further, the source device may receive data from the sink device via the wireless peer-to-peer connection. The identifying of the one or more rendering instructions by the source device may thus include identifying at least one rendering instruction based at least in part on the received data.