Coherent Eye Gaze and Hand Data Capture for Surgical Assessment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for assessing a surgeon's skill during surgical procedures rely on human observation, which is subjective and prone to bias, lacking objective measures for eye gaze, hand motion, and hand force data.
Innovation Solution
A system comprising pupil, head, and hand tracking subsystems, along with a computer processor, to capture spatially and temporally coherent eye gaze and hand data, including kinematic and force data, using cameras, electromagnetic sensors, and piezoelectric sensors, for objective assessment and analysis.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If human observation is used to assess surgeon skill, then the assessment process is simple and requires no complex equipment, but the measurement precision and objectivity are insufficient due to observer bias and subjectivity
Solution Approach 1:
The system segments the assessment process into multiple independent measurement components: eye tracking subsystem, head tracking subsystem, hand tracking subsystem, and instrument tracking subsystem. Each subsystem independently captures specific data (pupil position, head position/orientation, hand position, instrument position) which are then integrated to provide comprehensive objective assessment, resolving the contradiction by replacing subjective human observation with multiple precise objective measurement systems
Solution Approach 2:
The system employs universal tracking technology that can simultaneously monitor multiple parameters (eye gaze, head position, hand motion, instrument position) across different spatial dimensions and time points. This multi-functional tracking approach provides comprehensive objective data for skill assessment without requiring separate specialized devices for each measurement type, thereby improving assessment accuracy while managing system complexity
2Measurement precision
If multiple tracking subsystems are integrated to capture comprehensive eye gaze and hand data, then measurement precision and objectivity improve, but device complexity and data integration difficulty increase
Solution Approach 1:
The system introduces a central computer as an intermediary that receives data from all tracking subsystems (eye tracking, head tracking, hand tracking, instrument tracking). This intermediary processes, synchronizes, and integrates the multi-source data streams, coordinating the various subsystems to work together seamlessly. The computer acts as the mediating element that resolves the integration complexity by providing a centralized processing hub that manages data flow between all components
Solution Approach 2:
The system merges multiple tracking subsystems into a unified integrated system that captures eye gaze, head position, hand motion, and instrument position data simultaneously. By combining these separate tracking functions into one coordinated system with centralized data processing, the patent achieves comprehensive precise measurement while managing complexity through integration rather than separate independent systems
3Reliability
If spatially and temporally coherent data is captured from multiple sources, then the reliability of performance analysis improves, but the difficulty of detecting and measuring increases due to synchronization requirements
Solution Approach 1:
The central computer serves as an intermediary that synchronizes data from all tracking subsystems by assigning temporal markers and coordinating data collection timing. This intermediary ensures that eye gaze data, head position data, hand motion data, and instrument position data are temporally aligned and spatially coherent, making the data reliable for performance analysis while managing the synchronization complexity through centralized control
Solution Approach 2:
The system transforms multi-source tracking data into standardized spatial and temporal parameters that can be consistently compared and analyzed. By converting diverse data types (pupil position, head orientation, hand coordinates, instrument position) into unified parameter formats with consistent reference frames and time synchronization, the system makes the data measurable and reliable for performance assessment while reducing the difficulty of detecting and measuring through standardization
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and objective capture of eye gaze, hand movements, and hand forces during surgical tasks, allowing for performance metrics analysis and detection of errors, improving training and quality improvement in surgical procedures.
Implementation Method 1
The instrument force tracking subsystem comprises a piezoelectric sensor attachable to the hand-held instrument
Implementation Method 2
the hand tracking subsystem comprises at least one electromagnetic sensor attachable to the hand, and at least one electromagnetic transmitter for generating an electromagnetic field detectable by the electromagnetic sensor
Implementation Method 3
the pupil tracking subsystem comprises an eye camera for optically monitoring the pupil position
Implementation Method 4
the head tracking subsystem comprises a plurality of markers attachable to the head, and at least one camera for optically capturing a position of the plurality of markers
Data Source
AI summary
An eye gaze and hand data capturing system for use with a human performing a manual task (such as a surgical procedure) with a hand-held instrument (such as a surgical instrument), includes subsystems for tracking pupil position head position and orientation, hand position, and force applied by the hand to an instrument, all operatively connected to a computer that repeatedly determines an eye gaze vector, the hand position and orientation, and the force applied to the instrument and records such information as a record of spatially and temporally coherent data in a database.