Remote Graphics Encoding with Caching and Progressive Rendering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current network systems face challenges in efficiently sharing and rendering graphical resources across networks due to bandwidth constraints and the need for frequent updates, especially with sophisticated graphical interfaces, leading to lag and system overload.

Innovation Solution

The solution involves efficiently encoding graphic objects for display on a remote device by determining appropriate encoding mechanisms, using metadata for data compression, resource caching, and progressive rendering, which allows for the selection of resources to be sent based on visibility and system limitations, thereby reducing bandwidth usage and improving responsiveness.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of energy

If graphic primitives and operations are sent to client for rendering, then network bandwidth consumption is reduced, but processing intensity and system lag increase

Engineering Contradiction:
Improvenetwork bandwidth consumptionVSAvoidprocessing speed
Core Design Contradiction:
Loss of energyVSProductivity

Solution Approach 1:

The patent applies preliminary action by pre-processing graphic data on the server side before transmission. The server performs encoding and compression operations in advance, converting complex graphic primitives into optimized representation formats. This reduces the processing burden on client devices while maintaining visual quality, thereby resolving the contradiction between bandwidth savings and processing speed.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent utilizes parameter changes by dynamically adjusting graphic representation parameters based on network conditions and device capabilities. It transforms graphic data between different encoding formats (e.g., bitmap, vector, hybrid) and adjusts compression levels, allowing the system to optimize the balance between bandwidth consumption and rendering performance according to real-time requirements.

Inventive Principle:
Principle #35Parameter changes

2Quantity of substance

If immediate presentation mode is used for graphic rendering, then memory usage is reduced, but graphic information is lost for background windows

Engineering Contradiction:
Improvememory usageVSAvoidgraphic information retention
Core Design Contradiction:
Quantity of substanceVSLoss of information

Solution Approach 1:

The patent applies local quality by implementing selective rendering strategies where different portions of the graphic display are handled differently. Visible foreground windows are rendered with high quality using immediate mode, while background or obscured windows are maintained in a compressed or simplified representation. This local differentiation reduces overall memory usage while preserving necessary graphic information where needed.

Inventive Principle:
Principle #3Local quality

3Manufacturing precision

If frequent graphic updates are sent to maintain sophisticated graphical interfaces, then visual quality is improved, but network throughput and system performance deteriorate

Engineering Contradiction:
Improvevisual qualityVSAvoidsystem throughput
Core Design Contradiction:
Manufacturing precisionVSProductivity

Solution Approach 1:

The patent extracts and transmits only the essential or changed portions of graphic data rather than complete frames. By identifying and sending only delta changes, newly added elements, or significantly modified regions, the system maintains high visual quality for sophisticated graphical interfaces while dramatically reducing the amount of data transmitted over the network, thus preserving system throughput.

Inventive Principle:
Principle #2Taking out (Extraction)

4Device complexity

If entire bitmaps are transmitted over network, then graphic rendering is simplified, but bandwidth consumption increases significantly

Engineering Contradiction:
Improverendering complexityVSAvoidbandwidth consumption
Core Design Contradiction:
Device complexityVSLoss of energy

Solution Approach 1:

The patent applies segmentation by dividing graphic data into multiple components or layers (e.g., background layers, foreground objects, animated elements, static elements). Each segment is processed and transmitted independently with appropriate compression and encoding strategies. This allows the client to reconstruct the complete image with reduced bandwidth consumption compared to transmitting entire uncompressed bitmaps.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS8244051B2Efficient encoding of alternative graphic sets
Publication Date: 2012.08.14 MICROSOFT TECHNOLOGY LICENSING LLC
  • US8244051B2 patent drawing
  • US8244051B2 patent drawing
  • US8244051B2 patent drawing

AI summary

Embodiments provide for efficient encoding and rendering of remote graphic displays by applying one or more of the following: (1) field encoding for identifying fields of a graphics set such that commonalities of various fields across different graphics languages are identified; (2) resource caching, which treats heterogeneous resources in a homogeneous way when it comes to storing them; (3) determining the type of encoding for remoting items within a graphics set based upon the types of compression mechanisms supported by a remote device; (4) improving responsiveness by rendering with partially sent resources; (5) a mechanism for determining what portions (if any) of a graphics set should be sent to a remote device and in what order; and (6) use of dedicated resources already on a remote device in order to eliminate the transfer of a resource between a local device and the remote device when rendering such resource.