EMG Signal Prediction for Cloud Gaming Latency Reduction

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for controlling computer programs, such as games, face latency issues due to the delay between user input intention and actual input detection, which can be exacerbated in cloud gaming environments where data transfer times add to the overall response time.

Innovation Solution

A method utilizing electromyography (EMG) signals and actuation movement signals to predict user inputs, allowing for the pre-execution and pre-transfer of probable program sequences, thereby reducing latency by anticipating and preparing for user actions before physical input is made.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of time

If conventional input devices are used to detect user input, then the system structure remains simple, but latency occurs between user input intention and actual input detection

Engineering Contradiction:
ImprovelatencyVSAvoidsystem structure
Core Design Contradiction:
Loss of timeVSDevice complexity

Solution Approach 1:

The patent applies preliminary action by detecting electromyography signals that precede actual muscle contraction and input device actuation. The system performs preliminary detection of neural electrical activity in muscles, allowing the computer program to prepare and pre-calculate outcomes before the user physically interacts with the input device. This reduces the perceivable latency between input intention and system response.

Inventive Principle:
Principle #10Preliminary action

2Speed

If probable program sequences are executed in advance based on predicted user input, then response time is improved, but computational resources are consumed for preparing sequences that may not be needed

Engineering Contradiction:
Improveresponse timeVSAvoidcomputational resources
Core Design Contradiction:
SpeedVSUse of energy by moving object

Solution Approach 1:

The patent applies partial action by executing only a subset of probable program sequences in advance based on the predicted user input from electromyography signals. Rather than preparing all possible program sequences, the system selectively pre-calculates and prepares only those sequences that are most likely to be needed, thereby reducing unnecessary computational resource consumption while still improving response time for the anticipated user actions.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If electromyography signals are used to predict user input, then input detection accuracy is improved, but the complexity of signal processing increases

Engineering Contradiction:
Improveinput detection accuracyVSAvoidsignal processing complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies the intermediary principle by using electromyography signals as an intermediate measurement that bridges the gap between user input intention and actual input device actuation. The EMG signals serve as a mediator that provides early indication of user intent, allowing the system to predict and prepare for upcoming inputs. This intermediary measurement approach improves input detection accuracy without requiring direct modification of the input device itself.

Inventive Principle:
Principle #24Intermediary (Mediator)

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach significantly reduces perceivable latency by enabling early detection and preparation of user inputs, enhancing the operational quality and player experience in both conventional and cloud gaming scenarios by predicting and preparing for user actions before they occur.

Implementation Method 1

detecting electromyography signals and/or actuation movement signals of a user

Methodology Applied
Scientific EffectElectromyography:

Data Source

PatentUS20240286025A1Method for monitoring a computer program, and computer program product
Publication Date: 2024.08.29 DEUTSCHES ZENTRUM FÜR LUFT UND RAUMFAHRT E V
  • US20240286025A1 patent drawing
  • US20240286025A1 patent drawing

AI summary

A method for controlling a computer program with the aid of an input device for detecting electromyography signals and/or actuation movement signals of a user. Probable program sequences are selected from possible program sequences. The selected probable program sequences are executed, at least in part, in advance, and an effective program sequence is selected from the program sequences that have been executed, at least in part, in advance and is made operational. The probable program sequences are selected taking a predicted user input and/or detected electromyography signals into account, and the effective program sequence is selected taking detected electromyography signals and/or detected actuation movement signals into account. Moreover, the invention relates to a computer program product that includes program code sections, via which such a method may be carried out when the computer program product is executed on a computer.