Eye-Tracking Workflow Gating for Task Condition Verification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing workflow control systems lack the ability to ensure that tasks are performed correctly and safely, as they do not effectively verify if users have acknowledged critical information or are in a suitable state to perform tasks, leading to potential errors and risks.

Innovation Solution

A system and method that captures eye data to monitor task performance, checks if users have looked at and acknowledged relevant objects, and determines their state of attention and fitness for duty, using gaze direction and motion patterns to assess task conditions and allow or block task execution based on predefined criteria.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If eye data capture and analysis systems are implemented to verify task performance and user state, then workflow safety and quality are improved, but device complexity and implementation cost increase

Engineering Contradiction:
Improveworkflow safetyVSAvoidsystem complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary eye-tracking system that captures eye data and serves as a mediator between the user and the workflow control system. This intermediary processes eye movements, fixations, and gaze patterns to generate objective metrics about user attention and task performance, thereby improving workflow safety without requiring direct complex integration between all system components.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces subjective mechanical assessment methods (such as manual observation or self-reporting) with optical eye-tracking technology. By using optical sensors to capture eye data and automatically analyze user state and task performance, the system achieves more reliable and objective measurements while reducing the need for manual intervention and complex mechanical monitoring apparatus.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If comprehensive eye data analysis is performed to determine user state and task acknowledgment, then measurement precision of user attention is improved, but data processing requirements and computational load increase

Engineering Contradiction:
Improveattention detection accuracyVSAvoiddata processing load
Core Design Contradiction:
Measurement precisionVSLoss of information

Solution Approach 1:

The patent extracts only the most relevant features from comprehensive eye data, such as fixation duration, saccade patterns, and gaze location relative to critical information. By selectively extracting these key metrics rather than processing all raw eye tracking data, the system achieves high measurement precision for user attention while minimizing computational load and data processing requirements.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by focusing analysis on specific critical moments or regions during task performance, such as when users are expected to acknowledge safety information or perform critical steps. Rather than continuously analyzing all eye movements throughout the entire workflow, the system concentrates computational resources on moments and areas most relevant to safety and quality assurance.

Inventive Principle:
Principle #16Partial or excessive action

3Measurement precision

If real-time eye data monitoring is implemented to check task conditions, then workflow control accuracy is improved, but response time and task completion speed may be reduced

Engineering Contradiction:
Improvetask condition verification accuracyVSAvoidtask completion time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent implements preliminary action by pre-defining expected eye movement patterns, fixation sequences, and gaze locations that indicate proper task performance. These templates are established before task execution, allowing the system to quickly compare real-time eye data against predetermined criteria rather than performing complex real-time analysis, thereby maintaining high verification accuracy while minimizing delays in task completion.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent employs periodic sampling of eye data at strategically chosen intervals during task performance rather than continuous monitoring. This periodic action captures sufficient information to verify task conditions and user attention while significantly reducing computational burden and preventing bottlenecks that would slow down task completion, thus balancing accuracy with speed.

Inventive Principle:
Principle #19Periodic action

Data Source

PatentUS11087127B2Method and system to control a workflow and method and system for providing a set of task-specific control parameters
Publication Date: 2021.08.10 APPLE INC
  • US11087127B2 patent drawing
  • US11087127B2 patent drawing
  • US11087127B2 patent drawing

AI summary

The invention relates to a system and method to control a workflow comprising at least one task to be performed by a person (P3), wherein information is provided about at least one certain object (20, 32, 36, 38) related to the at least one task of the workflow, eye data (24, 26) are captured of at least one eye of the person (P3), and in dependency of the eye data (24, 26) and the information about the at least one certain object (20, 32, 36, 38) it is checked whether at least one task condition consisting in whether the task had been performed and/or whether the task is allowed to be performed is fulfilled. The invention also relates to a system and method for providing a set of task-specific control parameters (CP).