Mixed-Reality 3D Anatomy Visualization for SRS Case Planning
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current neurosurgical subspecialties like brain and spine stereotactic radiosurgery (SRS) face challenges in converting 2D radiological images to 3D anatomical views during multidisciplinary team (MDT) case planning, limiting effective communication and visualization.
Innovation Solution
Integration of Mixed Reality (MR) technology using a headset with a 3D visualization engine and interactive features to create and manipulate patient-specific brain models, allowing 3D visualization and interaction with anatomical structures.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If 2D radiological images are used for case planning, then device complexity is reduced, but visualization quality and anatomical understanding are insufficient
Solution Approach 1:
The patent transforms 2D radiological images into 3D volumetric models, adding a spatial dimension to the visualization. This allows the multidisciplinary team to view anatomical structures from multiple angles and depths, significantly improving anatomical understanding while managing system complexity through optimized rendering techniques.
Solution Approach 2:
The system creates virtual copies of patient-specific anatomical structures from 2D imaging data. These 3D volumetric models serve as digital replicas that can be manipulated and examined without risking patient safety, allowing thorough case planning and discussion.
2Loss of information
If 3D volumetric models are rendered in real-time, then visualization quality improves, but processing time and computational resources increase
Solution Approach 1:
The system performs preliminary processing of 2D radiological images to create 3D volumetric models before the MDT meeting. This advance preparation allows complex computational tasks to be completed beforehand, ensuring high-quality anatomical visualization is ready for immediate review during the discussion without causing delays.
Solution Approach 2:
The rendering system is designed to dynamically adjust model complexity and detail levels based on viewing distance and device capabilities. This allows the system to maintain high visualization quality when needed while reducing computational load during routine viewing, optimizing the balance between detail and processing time.
Data Source
AI summary
Embodiments of the present disclosure relate to methods, systems, and computer program products for rendering a three-dimensional anatomical model in a virtual or augmented reality device. In various embodiments, a method includes reading, at a remote server, a three-dimensional imaging study from a data store, where the three-dimensional imaging study includes a plurality of two-dimensional slices of at least one anatomical structure, optionally performing segmentation, at the remote server, on each of the plurality of two-dimensional slices, generating, at the remote server, a volumetric model of the at least one anatomical structure based on the plurality of two-dimensional slices, scaling, at the remote server, the volumetric model according to one or more display parameters of a virtual or augmented reality device, receiving, at the virtual or augmented reality device, the scaled volumetric model; and rendering, at the virtual or augmented reality device, the scaled volumetric model.