Microcontroller Latency Measurement via Visual Signal Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional methods for measuring end-to-end latency in online gaming are not accurate due to the need for manual identification of gaming inputs and corresponding image changes, and they require manual analysis of video results.

Innovation Solution

A system that automatically measures latency by using a microcontroller to send signals to a gamepad, detecting visual changes on a display, and calculating the time difference between button press and image change, while also considering audio delays, allowing for precise measurement of end-to-end latency and lip sync delay.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual identification and analysis methods are used to measure latency, then device complexity is reduced, but measurement precision deteriorates

Engineering Contradiction:
Improvelatency measurement accuracyVSAvoidmeasurement system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

A sensor acts as an intermediary between the display and the measurement system. The sensor detects visual changes on the display and converts them into electrical signals that can be precisely timed and measured by the microcontroller, enabling accurate latency measurement without complex manual analysis

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces manual identification and analysis with an automated sensor-based detection system. The sensor automatically detects visual changes and the microcontroller automatically calculates latency, substituting the mechanical/manual process with an electronic automation system that achieves higher precision

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If automated sensor-based measurement is implemented, then measurement precision improves, but device complexity increases

Engineering Contradiction:
Improvelatency measurement accuracyVSAvoidmeasurement system complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The measurement system is designed to measure multiple types of latency (end-to-end latency, lip sync delay, audio latency) using the same basic sensor and microcontroller architecture. This multi-functionality justifies the initial complexity investment by providing comprehensive measurement capabilities across different latency types

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system measures different latency parameters (visual latency, audio latency, lip sync delay) by changing the detection parameters rather than the fundamental measurement mechanism. The same sensor and microcontroller setup can measure different parameters by adjusting what is being detected and how the time difference is calculated

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If multiple sensors and devices are added for comprehensive measurement, then measurement precision improves, but ease of operation deteriorates

Engineering Contradiction:
Improvecomprehensive latency measurementVSAvoidsystem setup complexity
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent combines multiple measurement functions (visual latency detection, audio latency detection, lip sync measurement) into a single integrated system. The microcontroller coordinates all sensors and calculations, merging what would otherwise be separate measurement devices into one unified system that simplifies operation despite comprehensive capabilities

Inventive Principle:
Principle #5Merging (Combining)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables accurate and automated measurement of latency, allowing administrators to optimize gaming systems for improved user experience by adjusting settings to meet predefined latency thresholds, thereby enhancing online gaming performance.

Implementation Method 1

A sensor located on a display sends an electrical signal to a microcontroller whenever a color change (e.g., black to white) is sensed

Methodology Applied
Scientific EffectLight sensing: Photoelectric Effect

Data Source

PatentUS11192024B1Accurate end-to-end latency measurement
Publication Date: 2021.12.07 ELECTRONIC ARTS INC
  • US11192024B1 patent drawing
  • US11192024B1 patent drawing
  • US11192024B1 patent drawing

AI summary

Various aspects of the subject technology relate to systems, methods, and machine-readable media for measuring latency. The method includes receiving, at a microcontroller, a first signal from a first device at a first time. The first device may include a device under test (DUT) having a gaming system. The method also includes comparing, through the microcontroller, a timing of a second signal with the first signal. The second signal may either be sent to a second device, or received from the second device. The second signal may be either sent or received at a second time. The method also includes calculating, through the microcontroller, a latency of the first device based on a difference in the timing of the first signal and the second signal.