Multi-Pixel Cache Encoding for Lossless Frame Bandwidth Reduction
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern computing systems face inefficiencies in processing, encoding, and delivering display frames in virtual and remote computing environments due to the lack of metadata in graphics processing, leading to increased bandwidth usage and resource consumption.
Innovation Solution
Implementing a multi-pixel caching scheme for lossless encoding, using a combination of lossy and lossless compression algorithms, and employing a run-length encoding (RLE) method to optimize the encoding of display frame data, reducing bandwidth requirements while maintaining quality.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of energy
If traditional graphics processing is used without metadata, then device complexity is reduced, but bandwidth usage increases
Solution Approach 1:
The patent extracts metadata (draw commands, content type, modified region information) from the graphics processing pipeline and transmits it separately to the remote device. This allows the local device to send only essential information while the remote device reconstructs the display frame using the extracted metadata, significantly reducing bandwidth usage without requiring complex processing at the local end.
Solution Approach 2:
The patent introduces metadata as an intermediary between the graphics processing unit and the display output. This metadata layer acts as a mediator that carries essential information about draw commands, content types, and modified regions, enabling efficient remote rendering without transmitting the entire high-resolution frame, thus reducing bandwidth while maintaining processing simplicity.
2Manufacturing precision
If lossless encoding is implemented, then image quality is maintained, but bandwidth usage increases
Solution Approach 1:
The patent applies different encoding strategies to different regions of the display frame based on their importance. Critical regions that require lossless encoding (such as text and UI elements) are identified using metadata about modified regions and content types, while less critical areas can use more compressed formats. This selective approach maintains image quality where needed while reducing overall bandwidth consumption.
3Productivity
If multi-pixel caching is implemented, then encoding efficiency is improved, but device complexity increases
Solution Approach 1:
The patent implements multi-pixel caching that stores previously processed pixel data and metadata in advance. By caching draw commands, content type information, and modified region data from previous frames, the system can quickly reconstruct similar frames without reprocessing all pixels, significantly improving encoding efficiency while the caching mechanism remains relatively simple.
4Measurement precision
If metadata is transmitted with each frame, then remote rendering accuracy is improved, but bandwidth usage increases
Solution Approach 1:
The patent transmits only the essential metadata needed for accurate remote rendering (draw commands, content type, modified regions) rather than complete frame data. This partial transmission approach provides sufficient information for the remote device to reconstruct the display frame with high accuracy while using minimal bandwidth, avoiding the excessive action of sending entire high-resolution frames.
Data Source
AI summary
Systems and methods are provided for encoding a multi-pixel caching scheme for lossless encoders. The systems and methods can include obtaining a sequence of pixels, determining repeating sub-sequences of the sequence of pixels consisting of a single repeated pixel and non-repeating sub-sequences of the sequence of pixels, responsive to the determination, encoding the repeating sub-sequences using a run-length of the repeated pixel and encoding the non-repeating sub-sequences using a multi-pixel cache, wherein the encoding using a multi-pixel cache comprises, encoding non-repeating sub-sequences stored in the multi-pixel cache as the location of the non-repeating sub-sequences in the multi-pixel cache, and encoding non-repeating sub-sequences not stored in the multi-pixel cache using the value of the pixels in the non-repeating sub-sequences.