Eye Tracking Camera for Interactive 3D Object Quantification
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current 3D image analysis methods in biomedicine, particularly using confocal microscopes and CT scans, are time-consuming and inefficient due to the need for manual refocalization and lack of effective interaction between operators and machines, especially in low-quality images.
Innovation Solution
The method employs an eye tracking camera to track the operator's gaze, allowing for interactive quantification of digitized 3D objects by projecting sections into a plane, reducing the need for manual interaction through gaze-based selection and confirmation, and utilizing adaptive visualization to enhance accuracy and speed.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If manual refocalization and mouse interaction are used for 3D object analysis, then measurement precision can be maintained, but productivity is significantly reduced due to time-consuming operations
Solution Approach 1:
The patent replaces manual mouse operations with an eye-tracking camera system that detects gaze direction and automatically selects objects. The camera captures images of the operator's eyes, processes gaze coordinates, and triggers analysis operations without mechanical mouse interaction, thereby eliminating the time loss associated with manual clicking and refocusing while maintaining measurement precision through automated coordinate mapping.
Solution Approach 2:
The system enables self-service operation where the analysis process automatically responds to the operator's natural gaze direction. The eye-tracking system continuously monitors eye position, automatically updates the analysis focus to the gazed-at object, and performs measurements without requiring manual intervention for each object, allowing the system to serve itself in maintaining analysis continuity and speed.
2Measurement precision
If single-purpose on-line systems are used for 3D analysis, then measurement precision is maintained, but device complexity and cost increase
Solution Approach 1:
The patent implements a multi-functional system where a single eye-tracking camera setup can perform multiple analysis tasks across different 3D objects and data types. The same hardware platform (camera, processor, display) handles object selection, coordinate mapping, measurement execution, and result visualization, eliminating the need for multiple specialized devices while maintaining precision through software-based adaptation to different analysis requirements.
Solution Approach 2:
The patent introduces a software intermediary layer that translates natural gaze movements into precise measurement commands. This software mediator processes raw eye-tracking data, maps gaze coordinates to image coordinates, determines object boundaries through interpolation, and triggers appropriate analysis functions, thereby simplifying the overall system architecture while maintaining measurement accuracy through intelligent data transformation.
3Productivity
If fully automatic methods are used for particle counting, then productivity increases, but measurement precision decreases due to reliability issues in low-quality images
Solution Approach 1:
The patent applies partial automation where the eye-tracking system handles object selection and coordinate identification, but the actual measurement and counting decisions remain under operator supervision. The system performs preliminary automatic actions (selecting objects based on gaze, marking sections) but allows the operator to verify and correct results, providing excessive action in terms of automated assistance while maintaining reliability through human oversight in challenging image conditions.
Solution Approach 2:
The system implements feedback mechanisms where the eye-tracking camera continuously monitors operator gaze and provides real-time visual feedback about selected objects and measurement progress. The display shows which objects are currently targeted, what measurements are being performed, and allows immediate correction of automatic selections, creating a closed-loop system that combines automated speed with reliability through continuous operator-in-the-loop verification.
Data Source
AI summary
A method of interactive quantification of digitized 3D objects includes a determination of coordinates of observed screen space using a camera that senses the position of pupils of the operator gazing on the screen. Dimensions of studied sub-volume of VOI block of dimensions of Sx, Sy, Sz or VOI cylinder of dimensions of Sx=Sy=Sxy are defined. An analyzed particle and VOI position is selected. A VOI is visualized. Observed space is corrected by VOI visualization. The last level is selected by gaze of the operator from the sequence of probe levels and the gaze is focused on the last level on which the particle is still visible. The property of the marked particle in 3D space is verified, and marked with a color mark. The mark position is determined by interpolation or by finding a representative point.