Extended Reality Medical Slice Visualization for 3D Surgical Navigation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In traditional computer-assisted navigated surgeries, it is challenging for operators to understand the geometric relationship between 2D medical image slices and 3D graphical models of patient anatomy, making it difficult to navigate surgical tools accurately.
Innovation Solution
A navigated surgery system using an extended reality (XR) headset displays 2D medical image slices alongside a 3D graphical model, with graphical objects indicating virtual cross-sectional planes that correspond to the 2D slices, providing geometric correspondence visualization.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Illumination intensity
If 2D medical image slices are displayed separately from 3D graphical models, then the display clarity of each view is improved, but the operator's understanding of geometric relationship between 2D and 3D structures deteriorates
Solution Approach 1:
The patent combines 2D medical image slices and 3D graphical models into a unified augmented reality display. The 2D slices are projected as semi-transparent overlays on the 3D anatomical model, allowing operators to view both representations simultaneously in their correct geometric relationship. This merging eliminates the need to switch between separate 2D and 3D views while preserving the clarity of each representation.
Solution Approach 2:
The patent adds a dimensional layer by projecting 2D image slices onto the 3D spatial model in augmented reality space. Instead of displaying 2D slices on a flat screen separate from the 3D model, the system embeds the 2D information within the 3D visualization space, allowing operators to perceive the geometric correspondence between 2D slices and 3D structures through spatial positioning and orientation in the augmented reality environment.
2Device complexity
If traditional separate display methods are used for 2D slices and 3D models, then device complexity is reduced, but surgical navigation precision deteriorates
Solution Approach 1:
The system provides real-time visual feedback by displaying 2D medical image slices overlaid on the corresponding 3D anatomical model in augmented reality. This feedback mechanism allows operators to continuously verify the geometric relationship between 2D slice positions and 3D anatomical structures, enhancing navigation precision without requiring complex separate display systems.
Data Source
AI summary
A navigated surgery system includes at least one processor that is operative to obtain a 2D medical image slice of anatomical structure of a patient. The operations further obtain a 3D graphical model of anatomical structure. The operations determine a pose of a virtual cross-sectional plane extending through the 3D graphical model of the anatomical structure that corresponds to the anatomical structure of the 2D medical image slice. The operations control the XR headset to display the 2D medical image slice of the anatomical structure of the patient, display the 3D graphical model of the anatomical structure, and display a graphical object oriented with the pose relative to the 3D graphical model of the anatomical structure.