Eye Tracking Synchronization for Medical Image Segmentation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current eye-tracking technologies face challenges in synchronizing gaze data with volumetric medical images, such as lung CT scans, and struggle to interpret extensive data sets effectively for radiology applications, limiting their use in real-time image segmentation tasks.
Innovation Solution
An eye-tracking system that extracts gaze information to perform real-time image segmentation by stabilizing gaze data, creating visual attention maps, and using computer-derived saliency information to identify foreground and background cues, followed by a graph-based algorithm for boundary identification, directly defining object regions of interest.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If eye-tracking data is collected from volumetric medical images, then gaze information can be extracted for image segmentation, but synchronization of eye-tracking data with individual 2D slices becomes challenging
Solution Approach 1:
The volumetric CT data is divided into multiple 2D slices, and eye-tracking data is synchronized with each individual slice. This segmentation approach allows the system to process complex volumetric data by breaking it down into manageable 2D components, making the synchronization task feasible while maintaining precise gaze information extraction for each slice.
Solution Approach 2:
The system introduces an intermediary processing layer that coordinates between the eye-tracking device and the volumetric image data. This intermediary component manages the complex synchronization by acting as a mediator that translates eye-tracking coordinates into the appropriate 2D slice context, resolving the technical contradiction without requiring direct complex synchronization between all components.
2Loss of information
If extensive eye-tracking data is collected, then more comprehensive gaze information is available, but interpreting and processing the large data sets becomes difficult
Solution Approach 1:
The system extracts only the relevant gaze information from the extensive eye-tracking data sets. Instead of processing all raw data, it selectively extracts meaningful gaze points, fixation durations, and attention patterns that are directly useful for image segmentation, thereby maintaining information completeness while reducing processing complexity.
Solution Approach 2:
The system processes a subset of the most relevant eye-tracking data points rather than attempting to process every single data point. By focusing on partial action (selective processing of key gaze events), the system achieves effective image segmentation without being overwhelmed by the full extent of the collected data.
3Reliability
If conventional eye-tracking research focuses on understanding visual search patterns, then psychological insights are gained, but application in real-time image analysis tasks remains limited
Solution Approach 1:
The system replaces the conventional psychological analysis approach with a computational image processing approach. Instead of merely observing and analyzing visual search patterns, the system uses gaze information as direct input for automated image segmentation algorithms, substituting mechanical/passive observation with active computational processing that enables real-time image analysis.
Solution Approach 2:
The system enables the eye-tracking data to serve dual purposes: it maintains its value for understanding visual search patterns while simultaneously serving itself as direct input for image segmentation tasks. The gaze information automatically contributes to both psychological research and practical image analysis without requiring separate processing systems.
Data Source
AI summary
A system and method for using gaze information to extract visual attention information combined with computer derived local saliency information from medical images to (1) infer object and background cues from a region of interest indicated by the eye-tracking and (2) perform a medical image segmentation process. Moreover, an embodiment is configured to notify a medical professional of overlooked regions on medical images and/or train the medical professional to review regions that he/she often overlooks.