Server GUI Element Segmentation for Encoding Efficiency

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for rendering graphical user interfaces over communication networks face scalability issues and reduced encoding efficiency, particularly when dealing with an increasing number of connected clients, as they require rendering the entire interface at the server, which hampers compression and efficiency.

Innovation Solution

The approach involves separating the element shape and text of graphical user interface elements, with the server encoding shape data into video data and transmitting it separately from the client-encoded text data, allowing for efficient compression and synchronization upon detection of changes, thereby reducing the processing load and improving encoding efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If the entire graphical user interface is rendered at the server within a framebuffer, then the graphical user interface can be provided to clients over the network, but the encoding efficiency is reduced and scalability is limited

Engineering Contradiction:
Improveencoding efficiencyVSAvoidserver processing load
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent segments the graphical user interface into two distinct components: element shape data (visual representation) and element text data (textual content). This segmentation allows each component to be processed and transmitted independently, enabling more efficient encoding strategies. The element shape data is encoded using video encoding while element text data is transmitted separately, avoiding the inefficiency of encoding the entire interface as a single framebuffer image.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent extracts the element text data from the overall graphical user interface rendering process. Instead of including text as part of the rendered framebuffer image, the text data is separated and transmitted independently. This extraction allows the text to be handled more efficiently and enables the server to reduce its processing load by not rendering text as part of the video stream.

Inventive Principle:
Principle #2Taking out (Extraction)

2Adaptability or versatility

If the entire graphical user interface is rendered at the server, then complete interface functionality is provided, but scalability with increasing number of clients is reduced

Engineering Contradiction:
ImprovescalabilityVSAvoidserver processing throughput
Core Design Contradiction:
Adaptability or versatilityVSProductivity

Solution Approach 1:

By segmenting the GUI into shape and text components, the patent enables independent processing and transmission of each component to multiple clients. This segmentation reduces the server's processing burden per client and allows for more efficient resource utilization, thereby improving scalability to support an increasing number of connected clients.

Inventive Principle:
Principle #1Segmentation

3Productivity

If element shape and element text are provided separately, then encoding efficiency is improved, but the system complexity increases

Engineering Contradiction:
Improvecompression ratioVSAvoiddata transmission structure
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the GUI into element shape data and element text data, which are then encoded and transmitted through different channels. The element shape data is compressed using video encoding achieving high compression ratios, while element text data is transmitted separately. This segmentation strategy improves overall encoding efficiency despite the increased structural complexity.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS11537777B2Server for providing a graphical user interface to a client and a client
Publication Date: 2022.12.27 HUAWEI TECH CO LTD
  • US11537777B2 patent drawing
  • US11537777B2 patent drawing
  • US11537777B2 patent drawing

AI summary

The invention relates to a server for providing a graphical user interface to a client over a communication network. The graphical user interface comprises a graphical user interface element, the graphical user interface element being formed by an element shape and an element text, the element shape being represented by element shape data, the element text being represented by element text data. The server comprises an encoder configured to encode the element shape data into video data, a detector configured to detect a change associated with the graphical user interface element within the graphical user interface, and a communication interface configured to separately transmit the video data and the element text data over the communication network, the element text data being transmitted upon detection of the change associated with the graphical user interface element for providing the graphical user interface to the client.