Gaze-Based Workflow Adaptation in Extended Reality

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In the extended reality (XR) domain, modifying workflows is a cumbersome process due to lengthy reviews and approvals, which is unrealistic given the dynamic nature of XR, leading to missed opportunities for improving workflow efficiency based on in-the-field observations and real-time user context.

Innovation Solution

The system adapts workflows by using gaze tracking to identify real-time user context, creating triggers for actions based on user gaze, allowing for dynamic synchronization and suggestion of task alternatives to improve workflow efficiency and completion speed.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If workflows are modified through traditional review and approval processes, then workflow changes are formally validated, but the process becomes cumbersome and time-consuming

Engineering Contradiction:
Improveworkflow validationVSAvoidworkflow modification time
Core Design Contradiction:
ReliabilityVSLoss of time

Solution Approach 1:

The system enables workflows to adapt automatically through gaze-based triggers without requiring manual review and approval. The workflow system serves itself by detecting user gaze patterns and autonomously modifying task sequences, eliminating the need for external validation processes while maintaining reliability through predefined trigger conditions.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent transforms static workflows into dynamic, adaptive processes that respond to real-time user context. Workflows automatically adjust based on gaze-based triggers detecting user confusion or engagement, allowing continuous optimization without formal modification cycles.

Inventive Principle:
Principle #15Dynamics

2Productivity

If workflows are adapted dynamically based on real-time user context, then workflow efficiency improves, but the system complexity increases

Engineering Contradiction:
Improveworkflow efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent replaces complex manual workflow management with automated gaze-based detection systems. Optical tracking technology substitutes for manual observation and decision-making processes, using eye movement patterns as natural triggers for workflow adaptations without requiring complex intervention mechanisms.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The system monitors changes in gaze parameters (duration, frequency, direction) to trigger workflow adaptations. By establishing threshold-based rules for gaze patterns, the system translates complex behavioral data into simple trigger conditions that drive automated workflow modifications.

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If gaze tracking is implemented to detect user context, then real-time workflow adaptation is enabled, but the measurement and detection difficulty increases

Engineering Contradiction:
Improveworkflow adaptabilityVSAvoidgaze detection complexity
Core Design Contradiction:
Adaptability or versatilityVSDifficulty of detecting and measuring

Solution Approach 1:

The patent introduces gaze tracking technology as an intermediary between user behavior and workflow control. The eye tracking system serves as a mediator that translates natural eye movements into actionable trigger signals, bridging the gap between unconscious user behavior and conscious workflow adaptations without requiring direct user input.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11593725B2Gaze-based workflow adaptation
Publication Date: 2023.02.28 AT&T INTELLECTUAL PROPERTY I L P
  • US11593725B2 patent drawing
  • US11593725B2 patent drawing
  • US11593725B2 patent drawing

AI summary

A method for gaze-based workflow adaptation includes identifying a workflow in which a user is engaged, where the workflow comprises a plurality of tasks that collectively achieves a desired goal, creating a trigger for a given task of the plurality of tasks, wherein the trigger specifies an action to be automatically taken in response to a gaze of the user meeting a defined criterion, monitoring a progress of the workflow, monitoring the gaze of the user, and sending a signal to a remote device in response to the gaze of the user meeting the defined criterion, wherein the signal instructs the remote device to take the action.