Remote Display Tile Encoding for Mixed Text and Image Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current remote computing methods face bottlenecks due to the inefficiencies in encoding and transmitting display data, particularly when dealing with mixed content that includes both image and text data, as they often require high CPU overhead or result in large data volumes, which can lead to delays in updating the remote computer display.

Innovation Solution

A method that divides the remote computer display data into tiles and applies a colour reduction algorithm to determine whether each tile represents image or text data, using lossy compression for image data and lossless compression for text data, thereby optimizing the encoding process by employing a hybrid approach combining JPEG and RLE (JRLE) for efficient data transmission.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If lossless compression is used for all display data, then data accuracy is maintained, but data volume and transmission time increase

Engineering Contradiction:
Improvedisplay data accuracyVSAvoidtransmission time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The display data is divided into multiple tiles, and each tile is independently analyzed and encoded. This segmentation allows different compression methods to be applied to different regions, enabling selective use of lossless and lossy compression based on content type, thereby reducing overall transmission time while maintaining accuracy where needed.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different encoding quality levels are applied to different regions of the display based on their content characteristics. Text regions use lossless compression to maintain sharpness and readability, while image regions use lossy compression to reduce data volume. This local differentiation resolves the contradiction by maintaining accuracy only where necessary.

Inventive Principle:
Principle #3Local quality

2Quantity of substance

If high compression encoding is used, then data volume is reduced, but CPU overhead increases

Engineering Contradiction:
Improvedata volumeVSAvoidCPU overhead
Core Design Contradiction:
Quantity of substanceVSUse of energy by moving object

Solution Approach 1:

The compression method is dynamically selected based on the content type of each tile. The system analyzes each tile to determine whether it contains text or image data, then applies the appropriate compression algorithm. This dynamic approach optimizes the balance between CPU overhead and data volume reduction by avoiding unnecessary complex processing for simple content.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

Instead of applying high compression to all data, the system applies compression selectively only where it provides benefit. Text regions receive minimal processing with lossless compression, while only image regions receive the more computationally intensive lossy compression, reducing overall CPU overhead while still achieving data volume reduction.

Inventive Principle:
Principle #16Partial or excessive action

3Productivity

If colour reduction algorithm is applied to distinguish image and text data, then encoding efficiency is improved, but processing complexity increases

Engineering Contradiction:
Improveencoding efficiencyVSAvoidprocessing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The display is divided into tiles that are processed independently. This segmentation simplifies the complexity by breaking down the large-scale complex analysis into smaller, manageable units. Each tile can be analyzed using the colour reduction algorithm without overwhelming system resources, maintaining encoding efficiency while controlling processing complexity.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The colour reduction algorithm automatically analyzes each tile and determines its content type without requiring manual intervention or complex external analysis. The tiles self-identify their content characteristics through the algorithm, enabling efficient automated encoding decisions while keeping the processing logic relatively simple and self-contained.

Inventive Principle:
Principle #25Self-service

Data Source

PatentEP2652951B1Method and system for encoding display data
Publication Date: 2016.04.20 REALVNC LTD
  • EP2652951B1 patent drawingFigure 1
  • EP2652951B1 patent drawingFigure 2
  • EP2652951B1 patent drawingFigure 3a~3b

AI summary

A remote computer having a processor and a display, said remote computer being connected via a network to a local computer having a processor and a display, wherein the processor of the remote computer is configured to divide at least part of the remote computer display into a grid having a plurality of tiles; determine whether each tile represents image data or text data; encode each tile representing text data using a lossless compression; encode each tile representing image data using a lossy compression, and transmit display data comprising said lossy encoded image data and said lossless encoded text data from said remote computer to said local computer, whereby a user is able to view said remote computer display on said local computer display.