Game Controller Involuntary Reaction Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current videogame consoles lack the ability to dynamically adapt game elements to a user's emotional response, relying primarily on voluntary inputs and failing to effectively incorporate involuntary physical reactions for enhanced gameplay experience.

Innovation Solution

Integration of a system that utilizes MEMS accelerometers and gyroscopic sensors in hand-held controllers, combined with camera and microphone inputs, to detect and analyze involuntary user reactions such as sudden movements and facial expressions, allowing the game to adjust its environment and intensity of scares based on the player's emotional response.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the game system uses multiple sensors (accelerometers, gyroscopes, camera, microphone) to detect user emotional responses, then the ability to detect involuntary physical reactions is improved, but the device complexity increases

Engineering Contradiction:
Improvedetection accuracy of involuntary physical reactionsVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The game controller is designed to perform multiple functions: it serves as both a voluntary control device and an involuntary reaction detector. The same accelerometer and gyroscope sensors that track controller orientation are also used to detect sudden involuntary movements, eliminating the need for separate dedicated sensors and reducing overall system complexity.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent combines multiple detection modalities (accelerometer data, gyroscope data, camera facial expression analysis, and microphone audio analysis) into a unified emotional response detection system. These diverse data streams are merged and processed together to comprehensively assess user emotional state, improving detection accuracy while leveraging existing components.

Inventive Principle:
Principle #5Merging (Combining)

2Adaptability or versatility

If the game dynamically adjusts audio-visual output based on user emotional response, then the adaptability of the game is improved, but the processing requirements and system complexity increase

Engineering Contradiction:
Improvegame adaptability to user emotional stateVSAvoidsystem complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The game system dynamically adjusts audio-visual output in real-time based on continuously monitored user emotional responses. The scare intensity, audio volume, and visual effects are modified on-the-fly rather than being fixed, allowing the game to adapt to the user's emotional state and maintain optimal engagement levels.

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system implements a closed-loop feedback mechanism where user involuntary reactions are continuously detected, analyzed, and fed back to adjust game parameters. This feedback loop enables the game to respond to user emotional state in real-time, creating an adaptive experience that evolves based on player response without requiring complex manual intervention.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If the system analyzes user reactions within a predetermined period after audio-visual events, then the timing precision for emotional response detection is improved, but the processing time requirements increase

Engineering Contradiction:
Improvetiming precision of reaction detectionVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system establishes a predetermined analysis period window in advance of detecting and evaluating user reactions. By pre-defining the time window for reaction analysis, the system can efficiently process data within known temporal bounds, reducing unnecessary processing while maintaining accurate timing for emotional response detection.

Inventive Principle:
Principle #10Preliminary action

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables a more immersive gaming experience by dynamically tailoring game elements to the player's emotional state, increasing engagement and fear levels by adjusting scare intensity based on involuntary physical responses, thereby enhancing the overall interactive experience.

Implementation Method 1

hand-held controllers that comprise microelectromechanical (MEMs) accelerometers

Methodology Applied
Scientific EffectAccelerometer: Accelerometer

Implementation Method 2

hand-held controllers that comprise microelectromechanical (MEMs) accelerometers and/or gyroscopic sensors

Methodology Applied
Scientific EffectGyroscope: Gyroscope

Data Source

PatentEP2674836B1User interface and method of user interaction
Publication Date: 2016.04.20 SONY COMP ENTERTAINMENT EURO LTD
  • EP2674836B1 patent drawingFigure 1
  • EP2674836B1 patent drawingFigure 2
  • EP2674836B1 patent drawingFigure 3

AI summary

A method of user interaction with an entertainment device comprises generating an audio-visual output for use with audio-visual reproduction equipment, initiating an audio-visual event as part of the generated audio-visual output, receiving input data from one or more game control devices associated with the entertainment device, analysing the received input data to evaluate an involuntary physical response by a user interacting with the or each game control device occurring within a predetermined period associated with the initiation of the audio-visual event, and adjusting subsequently generated audio-visual output responsive to the evaluation of the user's involuntary physical response.