Modular Mixed Reality Simulator Tracking for Tactile Anatomy Visibility
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing medical simulators lack the ability to provide direct, non-mediated interaction with realistic tactile and haptic feedback, and fail to accurately simulate the internal structures and processes of physical systems, limiting the effectiveness of training in procedures requiring user-determined entry points and proper instrument alignment.
Innovation Solution
A mixed reality simulator system that integrates a physical model with a virtual model, using tracked instruments and interchangeable modular physical models, enhanced with indicators for improved imaging probe and instrument alignment, such as anisotropy, in-plane, and perpendicularity indicators, and a universal needle hub for various needle types, providing realistic tactile and haptic feedback.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If a physical simulator is used to provide tactile feedback and 3D interaction, then the realism and haptic feedback are improved, but the internal structure and processes remain hidden as a black-box
Solution Approach 1:
The simulator is divided into separate modules: a physical patient model for tactile interaction and a virtual anatomical model for internal structure visualization. This segmentation allows each component to fulfill its specific function without compromising the other, resolving the contradiction between physical realism and internal visibility.
Solution Approach 2:
A transparent or translucent physical model acts as an intermediary between the user and the internal structures. This mediator allows tactile feedback while simultaneously enabling visualization of internal anatomy through transparency, thus resolving the black-box problem without sacrificing physical interaction.
2Measurement precision
If a fixed point of entry simulator is used with prepositioned sensors, then the tracking accuracy is improved, but the ability to simulate user-determined entry points is reduced
Solution Approach 1:
The system transitions from fixed, prepositioned sensors to dynamic tracking using sensors mounted on the physical patient model and virtual anatomy. This allows the entry points to be dynamically determined by the user while maintaining precise tracking through the sensor system, resolving the contradiction between accuracy and flexibility.
Solution Approach 2:
The system changes the parameters of the tracking system from fixed spatial coordinates to dynamic parameters that adapt to user-determined entry points. This allows the simulator to maintain measurement precision while accommodating variable entry locations chosen by the user during the procedure.
3Loss of information
If virtual simulation is used to show internal structures, then the internal structure visualization is improved, but the direct tactile interaction is lost
Solution Approach 1:
The system merges the physical patient model with the virtual anatomical model into a unified mixed reality environment. This combination allows users to simultaneously access both tactile feedback from the physical model and internal structure visualization from the virtual model, resolving the contradiction between the two modalities.
Solution Approach 2:
The transparent physical model serves as an intermediary that bridges the gap between virtual and physical realms. It provides tactile feedback as a physical object while simultaneously enabling visualization of internal structures through its transparency, thus merging both experiences without requiring separate interaction modes.
4Adaptability or versatility
If multiple physical models are used for different procedures, then the versatility is improved, but the device complexity increases
Solution Approach 1:
The physical patient model is designed as a universal platform that can simulate multiple procedures and anatomical regions through modular components and software configuration. This single multi-functional model replaces the need for multiple specialized models, reducing overall system complexity while maintaining versatility.
Solution Approach 2:
The physical patient model is segmented into modular components that can be reconfigured for different procedures. This modular segmentation allows the same base model to adapt to various training scenarios without requiring complete model replacements, thus reducing device complexity while maintaining procedural versatility.
Data Source
AI summary
Techniques and systems are described for providing modularity, tracking and simulation features of a mixed reality simulator. A modular approach to tracking systems, tracked instruments, and interchangeable modular physical models is described. Enhanced indicators and indicator interfaces improve imaging probe and instrument orientation and alignment with respect to a physical target, including but not necessarily within a combined physical and virtual system; these include anisotropy indicators, indicators of alignment in both in-plane and out-of-plane ultrasound or other imaging techniques, and perpendicularity indicators for better placement of probes and instruments over curved surfaces. A universal needle hub is described that integrates tracking system components and simulation feedback components usably with varying needle types.