Input and Display Latency Measurement for Remote Gaming
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Remote play and cloud gaming experience is degraded by increased latency due to multiple communication links, with no effective method to identify the specific device contributing to high latency, leading to unfair online gaming and user frustration.
Innovation Solution
A processing apparatus and method to determine latency contributions of input and display devices by capturing images of user inputs and output changes, using imaging units and control units to timestamp and calculate latency times.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If multiple communication links are used for remote play and cloud gaming, then gaming accessibility and flexibility are improved, but latency increases and user experience degrades
Solution Approach 1:
The patent segments the latency measurement process by identifying and measuring latency contributions from specific devices (input device, display unit, communications unit) separately. This allows the system to isolate which component is causing high latency in the multi-link gaming setup, enabling targeted optimization while maintaining the flexibility of remote play and cloud gaming configurations.
2Adaptability or versatility
If multiple communication links are used for remote play and cloud gaming, then gaming flexibility is improved, but it becomes difficult to identify the specific device contributing to high latency
Solution Approach 1:
The patent implements a feedback mechanism where the processing apparatus measures and reports latency contributions from different devices back to the user. This feedback loop enables users to see which specific device (input device, display unit, or communications unit) is causing high latency, allowing them to make informed decisions about device selection while maintaining gaming flexibility across multiple communication links.
3Device complexity
If no latency measurement method is provided, then device complexity remains low, but fair selection between devices with different latency characteristics becomes impossible
Solution Approach 1:
The patent enables devices to self-measure and report their own latency characteristics to the processing apparatus. Each device (input device, display unit, communications unit) participates in the latency measurement process by providing timing information, allowing the system to automatically determine latency contributions without requiring complex external measurement equipment or manual testing procedures.
Data Source
AI summary
A method performed by a processing apparatus for determining a first latency is provided. The method includes processing one or more captured images comprising an input device operated by a user to determine a first reference time at which the user operated the input device to provide an input signal to the processing apparatus. The method includes receiving the input signal. The method includes determining a first latency between the determined first reference time at which the user operated the input device to provide the input signal and a time at which the input signal is received by the processing apparatus.