Predictive Graphics Processing for Latency Reduction

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Interactive computing systems with lightly resourced client devices and fully resourced remote devices face latency issues due to network communication and computing-intensive operations, leading to a sluggish user experience in gaming and XR applications.

Innovation Solution

Implement predictive graphics processing by speculatively generating image and audio content based on predicted user inputs, allowing remote computing devices to perform computing-intensive operations ahead of actual user interactions, thereby reducing perceived latency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Power

If computing-intensive operations are performed on remote computing devices, then processing capability is improved, but network latency increases

Engineering Contradiction:

Improveprocessing capabilityVSAvoidnetwork latency

Core Design Contradiction:

PowerVSLoss of time

Solution Approach 1:

The system speculatively generates image and audio content for multiple predicted user inputs before the actual inputs occur. By performing computing-intensive operations in advance based on predicted scenarios, the system prepares content that can be immediately transmitted when the actual user input matches the prediction, thereby reducing perceived latency while maintaining high processing capability on remote devices.

Inventive Principle:

Principle #10Preliminary action

2Speed

If speculative processing of multiple scenarios is performed, then response speed is improved, but computing resource utilization increases

Engineering Contradiction:

Improveresponse speedVSAvoidcomputing resource utilization

Core Design Contradiction:

SpeedVSUse of energy by moving object

Solution Approach 1:

The system generates content for multiple predicted scenarios beyond what is strictly necessary for the current state. By speculatively processing several possible future inputs simultaneously, the system ensures that when a user input occurs, the corresponding content is already prepared or can be quickly assembled, thereby improving response speed while managing computing resource utilization through selective speculative processing.

Inventive Principle:

Principle #16Partial or excessive action

3Ease of manufacture

If client devices have fewer computing resources, then device cost is reduced, but processing capability deteriorates

Engineering Contradiction:

Improvedevice costVSAvoidprocessing capability

Core Design Contradiction:

Ease of manufactureVSPower

Solution Approach 1:

The system extracts computing-intensive graphics processing operations from the client device and relocates them to the remote computing device. By separating the heavy processing tasks from the client device, lightweight client devices with fewer computing resources can be manufactured at lower cost, while the remote device handles the demanding processing requirements for generating image and audio content.

Inventive Principle:

Principle #2Taking out (Extraction)

Data Source

PatentUS20220319090A1System, devices and/or processes for predictive graphics processing

Publication Date: 2022.10.06 ARM LTD

AI summary

Disclosed subject matter relates generally to predictive graphics processing for interactive content.