Variable End-Point UI Rendering Bandwidth Optimization

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current streaming technologies waste network bandwidth and computing resources by encoding video content and UI control components at high resolutions, even though users may not notice lower resolution UI control components, and UI control components are often re-rendered unnecessarily, leading to inefficiencies in bandwidth and resource usage.

Innovation Solution

Streaming video content and UI control components separately, with the server determining the optimal rendering location based on hardware capability, resolution, and bandwidth, allowing for different resolutions to be used for each component, and enabling UI control components to be rendered on the endpoint device to reduce bandwidth usage.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Manufacturing precision

If video content components and UI control components are rendered together at the server at maximum resolution, then the combined UI quality is improved, but network bandwidth consumption increases

Engineering Contradiction:
ImproveUI rendering qualityVSAvoidnetwork bandwidth consumption
Core Design Contradiction:
Manufacturing precisionVSLoss of energy

Solution Approach 1:

The patent divides the combined UI into separate video content components and UI control components, rendering them at different resolutions. Video content is rendered at maximum resolution while UI control components are rendered at lower resolution, allowing the system to maintain overall UI quality while reducing total bandwidth consumption.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Different parts of the UI are rendered at different resolutions based on their importance and visibility. Video content components receive high-resolution rendering while UI control components (buttons, menus, etc.) are rendered at lower resolution, optimizing bandwidth usage while maintaining user experience.

Inventive Principle:
Principle #3Local quality

2Manufacturing precision

If UI control components are rendered at the server, then rendering quality is improved, but computing resources and bandwidth are wasted

Engineering Contradiction:
ImproveUI control component rendering qualityVSAvoidbandwidth usage
Core Design Contradiction:
Manufacturing precisionVSQuantity of substance

Solution Approach 1:

The patent extracts UI control components from the server-side rendering process and relocates them to client-side rendering. The server sends only the necessary data or templates for UI control components, which are then rendered locally at the endpoint device, eliminating the bandwidth waste of transmitting high-resolution UI control renders.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The endpoint device is empowered to render its own UI control components locally using received data or templates. This self-service approach eliminates the need for the server to render and transmit UI control components, significantly reducing bandwidth consumption while maintaining functional quality.

Inventive Principle:
Principle #25Self-service

3Manufacturing precision

If the server renders all UI components at maximum resolution, then the combined UI presentation quality is improved, but computing resources are wasted

Engineering Contradiction:
Improvecombined UI presentation qualityVSAvoidcomputing resources
Core Design Contradiction:
Manufacturing precisionVSUse of energy by moving object

Solution Approach 1:

The patent segments the rendering workload between video content components (rendered at maximum resolution) and UI control components (rendered at lower resolution or client-side). This segmentation allows the server to focus computing resources on video content while reducing resources spent on UI control rendering.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The server allocates different rendering qualities to different UI components based on their requirements. Video content receives maximum resolution rendering while UI control components receive lower resolution rendering, optimizing computing resource usage while maintaining acceptable overall UI quality.

Inventive Principle:
Principle #3Local quality

4Reliability

If UI control components are re-rendered frequently, then the UI remains updated, but unnecessary re-rendering increases bandwidth and resource usage

Engineering Contradiction:
ImproveUI update freshnessVSAvoidbandwidth and resource usage
Core Design Contradiction:
ReliabilityVSLoss of energy

Solution Approach 1:

The patent extracts UI control component rendering from the server's frequent re-rendering cycle. Instead of re-rendering all UI components on the server, only the necessary update data is transmitted to the endpoint device, which then renders UI control components locally, reducing unnecessary re-rendering operations.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The endpoint device performs self-service rendering of UI control components using received update data. This eliminates the need for the server to repeatedly render and retransmit UI control components, reducing bandwidth usage and server resource consumption while maintaining UI update freshness.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS12102917B2Variable end-point user interface rendering
Publication Date: 2024.10.01 GOOGLE LLC
  • US12102917B2 patent drawing
  • US12102917B2 patent drawing
  • US12102917B2 patent drawing

AI summary

Methods and systems for rendering distinct components of a combined user interface (UI) are described herein. A processing device receives a user request for a media item to be presented via a combined UI including one or more video content components and one or more UI control components. The processing device generates a rendering of the video content components and transmits a first stream including the rendering of the video content components to an endpoint device, wherein the first stream is encoded to a first resolution and wherein the rendering of the video content components is to be merged with a rendering of the UI control components into the combined UI at the endpoint device, the combined UI having a second resolution.