Mixed Reality Anatomical Model Alignment Using Body Surface Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for aligning three-dimensional virtual models with physical anatomical entities during surgery, such as using infrared reflective markers, result in invasive procedures, imprecise alignment, and reliance on manual adjustments, which are time-consuming and prone to errors, especially in complex surgeries like orthopedics.
Innovation Solution
A display device and system that constructs a first virtual model using intraoperative two-dimensional scanning data and image data, calibrates it with a preoperative CT-based second virtual model, and displays it through a mixed reality device, ensuring precise alignment without invasive procedures by using body surface markers.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If infrared reflective markers are manually fixed onto the physical anatomical entity, then the three-dimensional virtual model can be aligned with the physical entity, but invasive procedures are required and precise alignment cannot be achieved
Solution Approach 1:
The patent introduces a body surface marker as an intermediary element that can be non-invasively placed on the patient's skin. This marker serves as a mediator between the external imaging system and the internal anatomical structures, enabling precise tracking and alignment without requiring invasive procedures to attach markers directly to bones or organs.
Solution Approach 2:
The patent creates a three-dimensional virtual model that is a digital copy of the patient's internal anatomical structures based on preoperative imaging data. This virtual model is then aligned with the physical entity through the body surface marker, allowing precise visualization and measurement without direct physical intervention on the anatomical structures themselves.
2Measurement precision
If manual adjustments of virtual image poses are performed, then alignment can be achieved, but the process is time-consuming and dependent on network signal quality
Solution Approach 1:
The patent replaces the manual mechanical adjustment process with an automated image processing and recognition system. The system automatically captures images of the body surface marker, identifies its position and orientation, and adjusts the virtual model's pose accordingly, eliminating the need for time-consuming manual adjustments and reducing dependency on network signal quality for real-time alignment.
3Measurement precision
If invasive procedures are performed to fix markers on internal structures, then precise tracking can be achieved, but surgical complexity and patient risk increase
Solution Approach 1:
The body surface marker acts as an intermediary that enables indirect tracking of internal anatomical structures. By placing the marker on the skin surface and using image processing to correlate its position with the underlying anatomy, the system achieves precise tracking without the surgical complexity and patient risk associated with invasive marker placement procedures.
Data Source
AI summary
The present disclosure provides a display device and system for a three-dimensional virtual model of a living organism, as well as a mixed reality device. The display device comprises a construction module, configured to construct a first virtual model comprising body surface features and internal features of a living organism based on two-dimensional scanning data and image data of the living organism collected during surgery; a calibration module, configured to calibrate the first virtual model by using a second virtual model of the living organism to obtain a calibrated first virtual model; a display module, configured to determine a pose of the calibrated first virtual model in a real world scenario based on the image data of a body surface marker to display the calibrated first virtual model and the real world scenario through a mixed reality device.