AR Registration Guidance for Surgical Image-to-Tracking Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing surgical navigation systems lack effective guidance for acquiring registration points between patient image data and surgical tracking systems, particularly before the tracking system is activated, leading to potential inaccuracies in transformations.
Innovation Solution
A method utilizing augmented reality (AR) devices to provide user guidance by overlaying registration instructions on patient images, using pre-operative or intra-operative medical image data to determine optimal registration points, and performing transformations between different coordinate systems to facilitate accurate registration.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If registration points are acquired without guidance, then the surgical tracking system can be activated, but the accuracy of transformation between patient image data and tracking system coordinate systems deteriorates
Solution Approach 1:
The system performs preliminary action by determining optimal registration point locations and providing visual guidance instructions before the surgical tracking system is activated. The method calculates and displays guidance information on a display device, allowing the surgeon to acquire registration points at the correct locations in advance, ensuring accurate transformation when the tracking system becomes active.
2Measurement precision
If transformation is performed using generic face models, then registration accuracy is improved, but the complexity of image processing and coordinate system alignment increases
Solution Approach 1:
The method uses a generic face model as a template or copy to represent the patient's face geometry. By comparing the generic face model with actual patient images and determining correspondence between facial landmarks, the system achieves accurate transformation without requiring complex patient-specific 3D modeling. The generic model serves as a simplified representation that captures essential geometric relationships.
3Measurement precision
If registration instructions are provided before tracking system activation, then guidance accuracy is improved, but the time required for preparation and coordination increases
Solution Approach 1:
The system performs preliminary calculation and display of registration guidance instructions before the surgical tracking system is activated. By determining optimal registration point locations and providing visual guidance in advance, the surgeon can prepare and acquire registration points efficiently when the tracking system becomes active, reducing overall preparation time despite the advance computation required.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A method is provided, comprising: obtaining first patient image data of a patient's body; determining a registration instruction indicative of where to acquire a registration point relative to a surface of the body; obtaining second patient image data of the body, having been acquired by an augmented reality, AR, device; determining a transformation between coordinate systems of the first and the second patient image data; and based on the transformation, triggering display of the registration instruction on a display of the AR device such that a user of the AR device is presented an augmented view with the registration instruction being overlaid onto the patient's body, the augmented view guiding the user where to acquire the registration point. Also disclosed are a computing system, a surgical navigation system, and a computer program product.