Gaze-Based Workflow Control for Task Condition Verification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems fail to integrate gaze-triggered events into a process to achieve an overarching workflow goal, lacking control mechanisms to ensure tasks are performed correctly and safely.
Innovation Solution
A system and method that captures eye data to check task conditions, using gaze direction and motion patterns to verify task completion, emotional state, and authorization, with consequences for incorrect performance.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If gaze-triggered events are used to control workflow tasks, then task monitoring capability is improved, but system complexity increases due to integration requirements
Solution Approach 1:
The patent combines multiple independent components (eye tracker, scene camera, workflow management system, rule engine) into an integrated system where gaze data and scene data are processed together to control workflow tasks. This merging allows precise task monitoring through gaze-triggered events while managing complexity through unified system architecture.
Solution Approach 2:
The workflow management system is designed to handle multiple functions: tracking gaze positions, recognizing objects in scene data, evaluating task conditions, and controlling task execution. This multi-functionality reduces the need for separate specialized systems, addressing the complexity issue while maintaining monitoring precision.
2Reliability
If eye data analysis is used to verify task completion and authorization, then workflow quality and safety are improved, but processing time increases
Solution Approach 1:
The system performs preliminary actions by continuously capturing and pre-processing eye data and scene data in the background before task execution is needed. Gaze positions are tracked and objects are recognized in advance, so when a task condition needs evaluation, the data is already prepared, reducing actual processing time while maintaining high reliability.
Solution Approach 2:
The system implements feedback mechanisms where task conditions are evaluated based on accumulated gaze and scene data, and results are used to control subsequent task execution. This continuous feedback loop allows the system to optimize processing by only performing detailed analysis when relevant gaze patterns are detected, balancing quality assurance with time efficiency.
3Measurement precision
If multiple task conditions are monitored using eye data, then task control precision is improved, but measurement complexity increases
Solution Approach 1:
The patent segments task conditions into distinct evaluable units, where each condition can be independently assessed based on specific gaze patterns and scene object recognitions. This segmentation allows precise monitoring of multiple conditions while simplifying the measurement process by breaking down complex tasks into manageable condition checks.
Solution Approach 2:
The system changes parameters by transforming raw eye tracker data (gaze positions, fixation durations) and scene camera data into meaningful task condition parameters. This parameter transformation simplifies the detection and measurement process while maintaining high precision in task control, as the system evaluates conditions based on processed parameters rather than raw data.
Data Source
AI summary
The invention relates to a system and method to control a workflow comprising at least one task to be performed by a person (P3), wherein information is provided about at least one certain object (20, 32, 36, 38) related to the at least one task of the workflow, eye data (24, 26) are captured of at least one eye of the person (P3), and in dependency of the eye data (24, 26) and the information about the at least one certain object (20, 32, 36, 38) it is checked whether at least one task condition consisting in whether the task had been performed and/or whether the task is allowed to be performed is fulfilled. The invention also relates to a system and method for providing a set of task-specific control parameters (CP).