Gaze Tracking for Multiplayer Character Control and Narrative Choices

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing interactive content systems, particularly in multiplayer digital games, face challenges in allowing users to control characters and interactions within virtual environments effectively, especially for newer players who lack muscle memory or proficiency with various input devices.

Innovation Solution

Implement gaze-tracking technology to allow players to control game characters and interactions by focusing on displayed objects, with selections and audio/visual content being determined by the player's gaze, enabling multiplayer interactions and character control through eye movements.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If traditional controllers (handheld, voice, gesture) are used for character control, then player input capability is provided, but ease of operation deteriorates for newer players who lack muscle memory and proficiency

Engineering Contradiction:
Improveease of character controlVSAvoidcontroller complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent replaces traditional mechanical and voice-based control systems with an optical detection system (eye tracking). Instead of requiring physical controllers, voice commands, or gestures, the system detects player intent through eye movement and gaze direction, substituting complex mechanical interaction with optical sensing and neural processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The eye tracking system leverages the player's natural visual attention and gaze patterns to control characters. The system automatically detects what the player is looking at and infers intent without requiring explicit commands, allowing the player's natural eye movements to directly serve as control input.

Inventive Principle:
Principle #25Self-service

2Ease of operation

If gaze tracking is implemented for player control, then ease of operation improves, but device complexity increases due to eye tracking hardware and processing requirements

Engineering Contradiction:
Improveease of character controlVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The eye tracking system serves multiple functions simultaneously: it detects player gaze direction for character control, identifies objects of interest for narrative branching, and potentially tracks player attention for gameplay analytics. This multi-functionality justifies the added hardware complexity by providing diverse capabilities from a single sensing system.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary processing layer that translates raw eye tracking data into meaningful control commands and narrative decisions. This intermediary system bridges the gap between the simple eye movement input and the complex game response, managing the complexity transition from sensing to action.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Ease of operation

If eye movement control is used instead of traditional controllers, then accessibility for newer players improves, but measurement precision requirements increase for accurate gaze detection

Engineering Contradiction:
Improveaccessibility of game controlVSAvoidgaze detection precision
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The system performs preliminary calibration and warm-up routines to establish baseline eye movement patterns and detect stable fixation points before requiring precise control actions. This preliminary action reduces the precision burden during actual gameplay by pre-establishing the player's visual characteristics and environmental reference points.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The eye tracking system incorporates feedback mechanisms that monitor detection confidence and adjust tracking parameters in real-time. When precision is compromised due to eye movement variability or environmental factors, the system provides feedback through UI cues or adjusts sensitivity, maintaining accessibility while managing precision requirements.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12379779B2Using gaze tracking to effect player choices in multi player interactive narratives
Publication Date: 2025.08.05 SONY INTERACTIVE ENTERTAINMENT LLC
  • US12379779B2 patent drawing
  • US12379779B2 patent drawing
  • US12379779B2 patent drawing

AI summary

The present disclosure is directed to controlling outcomes in a game that includes multiple different users playing respective roles of specific virtual characters. The multiple different users may be present at a same physical location, or the different users may be located at different physical locations when movement of their eyes is tracked. Here, a user may choose one of a set of provided selections by simply looking at the chosen selection for a period of time or by looking at the chosen selection and performing an action or gesture. This functionality allows multiple different users to control actions performed by different specific characters via an online multiplayer system. Depending on what a first user looks at, that first user or a second user may be provided with a corresponding set of selections or audio/visual content via respective gaming devices operated by the first and the second user.