MRI Touch Panel Visual Feedback for Hand-Eye Coordination
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current MRI-compatible touch panel systems, such as those using crosshair/microswitch input methods, fail to provide sufficient feedback for natural handwriting and drawing during fMRI, leading to complex and inefficient input processes, especially for subjects with cognitive impairments, and result in ecologically invalid brain activity patterns.
Innovation Solution
The system provides real-time visual feedback of the subject's hand position and optional force feedback using an MRI-compatible camera to record and process video images, allowing direct and unambiguous input on a touch panel without the need for initial position establishment, enhancing hand-eye coordination and ecological validity.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If crosshair/microswitch input method is used, then touch panel input can be recorded during fMRI, but hand-eye coordination is poor and input process is complex
Solution Approach 1:
The patent implements real-time visual feedback by displaying the subject's hand position and touch panel interaction on a screen during fMRI scanning. This feedback loop allows subjects to see their hand movements and adjust their input accordingly, dramatically improving hand-eye coordination and simplifying the input process compared to blind crosshair methods.
Solution Approach 2:
The patent introduces a video camera and display screen as intermediary devices between the subject's hands and the touch panel. This intermediary system captures hand position visually and presents it back to the subject, enabling natural hand-eye coordination without requiring complex direct coupling mechanisms.
2Productivity
If crosshair/microswitch input method is used, then input can be recorded during fMRI, but learning time is prolonged and input efficiency is low
Solution Approach 1:
By providing real-time visual feedback of hand position and touch response, the system eliminates the need for extensive practice to learn the crosshair/microswitch mechanism. Subjects can immediately understand the input method through visual demonstration, dramatically reducing learning time and improving input efficiency from the start.
Solution Approach 2:
The visual feedback system preliminarily demonstrates the expected hand movements and responses before the subject actually performs the task. This pre-visualization allows subjects to mentally prepare and execute more efficient input actions without needing to learn through trial and error.
3Reliability
If crosshair/microswitch input method is used, then touch panel can be operated during fMRI, but ecological validity is compromised due to unnatural input behavior
Solution Approach 1:
The real-time visual feedback allows subjects to perform touch panel interactions in a natural, intuitive manner similar to using a regular touchscreen device. This feedback mechanism preserves the ecological validity of the input behavior by enabling natural hand-eye coordination and intuitive touch responses, rather than forcing unnatural crosshair-based interactions.
4Measurement precision
If visual feedback is provided in real-time, then input accuracy and efficiency improve, but processing time and system complexity increase
Solution Approach 1:
The video camera and display screen serve as intermediary components that handle the complex real-time processing and visual feedback generation. This separates the complex processing tasks from the core fMRI scanning system, allowing high input accuracy through visual feedback without significantly increasing the complexity of the MRI scanning infrastructure itself.
Data Source
AI summary
Systems and methods of are disclosed for providing visual feedback to a subject during magnetic resonance imaging, where the visual feedback is associated with input provided by the subject to a magnetic resonance compatible touch panel. A video camera is employed to record video images of the interaction between the subject and the touch panel, and the video images are processed to generate a real-time video signal including a rendering of the input provided to the touch panel and the interaction between the subject's hands and the touch panel. The real-time video signal is provided to the subject as visual feedback, and is displayed within a time duration that is sufficiently fast to avoid the detection of the visual feedback as an error signal with the subject's brain in relation to the sense of proprioception. A measurement of the force applied to the touch panel by the subject may be recorded and employed when rendering the real-time video. The systems and methods may be employed for a wide range of diagnostic and therapeutic procedures involving magnetic resonance imaging.