Mixed Reality System for Surgical Training with Haptic Feedback
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current VR systems for surgical task planning lack realism due to inadequate haptic feedback, sensitivity, and navigation, which can lead to medical errors and limit the effectiveness of surgical training, especially with cadavers and existing VR systems being resource-intensive and not widely commercially available.
Innovation Solution
A Mixed Reality Combination System (MRCS) that integrates augmented reality (AR) technology with 3D-printed collagen-based specimens and inertial measurement units (IMUs) to provide realistic haptic feedback and dynamic interaction, allowing for accurate task planning and execution by projecting virtual imagery onto physical objects and tracking user interactions.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If cadavers are used for surgical training, then physical realism is improved, but resource availability deteriorates
Solution Approach 1:
The patent creates virtual copies of cadaveric anatomical structures through 3D reconstruction from medical imaging data (CT, MRI). These digital twins replicate the physical properties, tissue characteristics, and anatomical variations of real cadavers, making them available unlimitedly for surgical training without requiring actual cadaveric resources.
Solution Approach 2:
The system transforms physical cadaveric properties into digital parameters that can be manipulated and reproduced. By converting anatomical structures into 3D models with adjustable parameters (tissue density, elasticity, vascularization), the system maintains physical realism while enabling unlimited replication and customization for different training scenarios.
2Productivity
If VR systems are used for surgical planning, then task planning capability is improved, but haptic feedback realism deteriorates
Solution Approach 1:
The patent merges virtual reality visualization with augmented reality haptic feedback by integrating force feedback devices into the VR surgical planning system. This combination allows surgeons to both visualize the surgical plan in immersive VR and receive realistic haptic feedback from virtual tissue interactions, resolving the contradiction between task planning capability and haptic realism.
Solution Approach 2:
The system introduces haptic feedback devices as an intermediary between the surgeon and the virtual surgical environment. These devices translate virtual tissue properties into realistic force feedback, allowing the surgeon to feel virtual tissue resistance, elasticity, and structural properties while maintaining full VR immersion for comprehensive task planning.
3Manufacturing precision
If custom physical models are created for each patient, then anatomical accuracy is improved, but manufacturing cost and time deteriorate
Solution Approach 1:
Instead of manufacturing physical models for each patient, the system creates digital 3D copies of patient-specific anatomy from medical imaging data. These digital models can be instantly generated, stored, and reused without additional manufacturing costs or time, while maintaining high anatomical accuracy through precise image-to-model conversion algorithms.
Solution Approach 2:
The patent replaces the mechanical manufacturing process with digital modeling and virtual reality visualization. By substituting physical model fabrication with computer-generated 3D reconstructions displayed in VR/AR environments, the system eliminates manufacturing costs and time while preserving anatomical accuracy through digital precision.
Data Source
AI summary
Disclosed herein is a system providing a mixed reality combination system that pairs augmented reality technology and an inertial measurement unit sensor with 3D printed objects such that user motions tracked by the inertial measurement unit as the user interacts with the 3D printed object is reflected in a virtual environment display of dynamic 3D imagery and augmented reality imagery.