Virtual Guide for Accurate Volume Layer Visualization in AR Surgery
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
In augmented reality (AR), virtual reality (VR), and mixed reality (MR) environments, accurately visualizing volume layers of a virtual environment in alignment with the real world is challenging due to differences in orientation and viewpoint, leading to errors in healthcare procedures like surgeries.
Innovation Solution
A digital virtual guide is used to accurately collocate and visualize volume layers on biological structures or surgical equipment by generating guide attributes based on imaging data, aligning with tracking data from users and devices, and projecting a virtual guide to overlay volume layers in real-time, utilizing AI for 3D landmark detection and segmentation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Adaptability or versatility
If volume layers are visualized in AR/VR/MR environment, then immersive experience and data visualization capability are improved, but accuracy of collocation with real world deteriorates due to orientation and viewpoint differences
Solution Approach 1:
A virtual guide object is introduced as an intermediary element between the volume layers and the real-world object. The virtual guide includes a 3D model of the real-world object and serves as a reference framework that mediates the alignment between virtual volume layers and physical anatomy, enabling accurate collocation despite orientation and viewpoint differences
Solution Approach 2:
The system performs preliminary alignment by establishing the virtual guide with known spatial relationships to the real-world object before visualizing the volume layers. The virtual guide is positioned and oriented in advance based on imaging data, creating a pre-aligned reference framework that ensures subsequent volume layer collocation accuracy
2Manufacturing precision
If virtual guide is projected and volume layers are visualized, then surgical precision is improved, but system complexity increases
Solution Approach 1:
The system segments the complex visualization task into distinct functional components: (1) retrieving and processing imaging data, (2) generating volume layers from imaging data, (3) creating the virtual guide with 3D model, (4) projecting the virtual guide, and (5) visualizing volume layers in association with the virtual guide. This segmentation allows each component to be optimized independently while working together to achieve surgical precision
Data Source
AI summary
Embodiments of the present disclosure provide a system, a method, and a computer programmable product for visualizing volume layers on an object accurately. The system retrieves imaging data relating to an object, generates a set of volume layers corresponding to the object based on the imaging data, and generates a set of guide attributes associated with a virtual guide for the object based on the imaging data. The virtual guide includes an object-specific structure. The system causes to project the virtual guide at least in association with the object and visualizes the set of volume layers in association with the object based on the projected virtual guide.