Head-Mounted AR Anatomy Registration With Cross-View Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for registering a virtual representation of patient anatomy with a physical patient anatomy in augmented reality require multiple realignments from different directions, which are cumbersome and do not allow for seeing the impact of realignment from one direction on the alignment from another, leading to inefficiencies in the registration process.
Innovation Solution
A method that displays first and second overlap data from different perspectives, identifies areas or features with a minimum degree of alignment, and takes into account the alignment from the first perspective during the display of the second perspective to maintain alignment, using a head-mounted device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If multiple realignments from different directions are performed to register the virtual representation, then the alignment accuracy is improved, but the registration time and operational complexity increase
Solution Approach 1:
The system performs preliminary alignment from a first viewing direction and stores the alignment state. When the user moves to a second viewing direction, the system uses the preliminary alignment information to automatically adjust the virtual representation, eliminating the need for complete realignment from scratch. This preliminary action reduces the registration time while maintaining accuracy.
Solution Approach 2:
The system provides feedback by displaying the impact of realignment from the first direction on the alignment from the second direction. This feedback mechanism allows the user to understand how previous alignment decisions affect the current view, enabling more efficient registration by reducing unnecessary adjustments.
2Measurement precision
If multiple realignments from different directions are performed to register the virtual representation, then the alignment accuracy is improved, but the operational complexity increases
Solution Approach 1:
By establishing a preliminary alignment state from the first viewing direction and storing it for use in the second viewing direction, the system reduces the operational complexity of performing multiple independent realignment operations. The user only needs to make minimal adjustments rather than performing complete realignments from each direction.
Solution Approach 2:
The system merges the alignment information from the first viewing direction with the second viewing direction alignment process. Instead of treating each direction's alignment as a separate complex operation, the system combines them by using the preliminary alignment state to guide the second direction alignment, simplifying the overall operational complexity.
3Adaptability or versatility
If the user manually realigns the virtual representation from each direction independently, then the alignment can be adjusted, but the impact of previous alignments on subsequent alignments cannot be visualized
Solution Approach 1:
The system provides visual feedback by displaying the impact of realignment from the first direction on the alignment from the second direction. This feedback mechanism shows the user how previous alignment decisions affect the current view, preserving alignment impact information and enabling more informed adjustment decisions.
Solution Approach 2:
The system acts as an intermediary by calculating and displaying the relationship between alignment states from different directions. This intermediary function bridges the gap between independent alignment operations, showing how they interact and affecting each other, thus preventing loss of alignment impact information.
Data Source
AI summary
The present invention relates to a method for registering a virtual representation of a patient anatomy with a coordinate system of a physical patient anatomy, comprising displaying first overlap data in a head-mounted device, wherein the first overlap data describe from a first perspective onto the physical patient anatomy a first visual overlap between the virtual representation of the patient anatomy and the physical patient anatomy, identifying at least a first area in the first visual overlap and/or at least a first anatomical feature of the patient anatomy in the first visual overlap having at least a minimum degree of alignment between the virtual representation and the physical patient anatomy, displaying second overlap data in the head-mounted device, wherein the second overlap data describe from a second perspective onto the physical patient anatomy a second visual overlap between the virtual representation of the patient anatomy and the physical patient anatomy, and taking into account, during the displaying of the second overlap data, the alignment of the identified first area and/or anatomical feature of the patient anatomy that was identified in the first visual overlap as having at least a minimum degree of alignment between the virtual representation and the physical patient anatomy.