Eye Tracking Input Attribution for Multi-User Touch Screens

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing computing systems face difficulties in determining which user is providing input when multiple users interact with a single input mechanism, such as a touch screen, as they struggle to differentiate between users and accurately attribute inputs.

Innovation Solution

A system that utilizes a camera, processor, and software modules to capture and process image data, detect physical features, and track user focus, allowing the identification of the user providing input by analyzing eye direction and other physical attributes, thereby distinguishing between multiple users interacting with a single input device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a single input mechanism is used for multiple users, then device simplicity and ease of operation are improved, but the ability to accurately identify which user is providing input deteriorates

Engineering Contradiction:
Improveease of operationVSAvoidinput attribution accuracy
Core Design Contradiction:
Ease of operationVSMeasurement precision

Solution Approach 1:

The patent introduces an eye tracking system as an intermediary mechanism between the user and the input device. The camera captures eye position data, which serves as a mediator to determine which user is providing input to the touch screen, thereby resolving the ambiguity of multi-user interaction without requiring separate input devices for each user

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces traditional mechanical input attribution methods (such as physical controllers assigned to specific users) with an optical sensing system. The eye tracking camera substitutes for mechanical user identification, using light reflection and image processing to detect eye position and determine input attribution

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If eye tracking is used to identify users, then input attribution accuracy is improved, but device complexity increases

Engineering Contradiction:
Improveinput attribution accuracyVSAvoiddevice complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent implements a multi-functional system where the camera serves multiple purposes: it acts as both the eye tracking sensor for user identification and a general imaging device. The processing system performs both eye position analysis and standard input processing, reducing the need for separate dedicated components and thereby mitigating the increase in device complexity

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The system uses the existing touch screen display to present calibration patterns and guide users through the eye tracking calibration process. The display device serves itself by providing the necessary visual information for calibration without requiring external equipment, thereby reducing overall system complexity

Inventive Principle:
Principle #25Self-service

3Reliability

If color and infrared cameras are used for eye tracking, then detection reliability in low-light conditions is improved, but energy consumption increases

Engineering Contradiction:
Improvedetection reliabilityVSAvoidenergy consumption
Core Design Contradiction:
ReliabilityVSUse of energy by moving object

Solution Approach 1:

The patent employs periodic switching between color and infrared camera modes based on lighting conditions. The system does not continuously operate both cameras simultaneously but alternates or activates only the appropriate camera type for current conditions, thereby maintaining detection reliability while reducing overall energy consumption

Inventive Principle:
Principle #19Periodic action

Solution Approach 2:

The system dynamically changes operational parameters by switching between different camera types (color vs. infrared) depending on ambient light levels. This parameter change allows the system to maintain reliable eye tracking performance across varying lighting conditions while optimizing energy usage by selecting the most efficient camera mode for each situation

Inventive Principle:
Principle #35Parameter changes

Data Source

PatentUS11650659B2User input processing with eye tracking
Publication Date: 2023.05.16 SONY INTERACTIVE ENTERTAINMENT LLC
  • US11650659B2 patent drawing
  • US11650659B2 patent drawing
  • US11650659B2 patent drawing

AI summary

A system determines which user of multiple users provided input through a single input device. A mechanism captures images of the one or more users. When input is detected, the images may be processed to determine which user provided an input using the input device. The images may be processed to identify each users head and eyes, and determine the focus point for each user's eyes. The user which has eyes focused at the input location is identified as providing the input. When the input mechanism is a touch screen, the user having eyes focused on the touch screen portion which was touched is identified as the source of the input.