Optical Code Patient Registration for Accurate AR Image Alignment
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Conventional augmented reality (AR) systems face challenges in accurately aligning and retrieving virtual elements with real-world environments, and these challenges include cumbersome and inaccurate manual processes for aligning image data with actual views of the patient, and consistently retrieving the correct virtual element that corresponds to the live view of the real-world environment, which are often time-consuming, cumbersome, and inaccurate.
Innovation Solution
The method involves affixing an optical code, such as a QR code, and a pattern of markers to a patient, capturing image data using a non-optical imaging modality, and then employing an AR headset to sense the optical code and calculate the position of the markers in a 3D space, automatically aligning the image data with actual patient views.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If manual processes are used to align image data with actual views of the patient, then the alignment can be performed without additional automated equipment, but the process becomes time-consuming and inaccurate
Solution Approach 1:
The system uses automatically detected optical codes and markers to perform alignment without requiring manual operation. The AR headset automatically detects the optical code, retrieves associated image data, and aligns it with the patient view, eliminating the need for manual alignment processes while maintaining high accuracy and reducing time consumption.
2Reliability
If manual processes are used to retrieve virtual elements, then the system can operate without automated retrieval mechanisms, but the retrieval becomes cumbersome and inaccurate
Solution Approach 1:
The patent replaces manual mechanical retrieval processes with an automated optical detection and data retrieval system. The AR headset's optical sensor automatically detects the optical code and triggers retrieval of the corresponding virtual element (image data), eliminating manual intervention and improving both accuracy and ease of operation.
3Extent of automation
If optical codes and markers are affixed to the patient, then automated alignment and retrieval can be achieved, but the patient preparation process becomes more complex
Solution Approach 1:
The patent combines the optical code and markers into a single integrated affixing process. Both the optical code (visible to optical sensors) and the markers (visible to non-optical imaging modalities) are applied together as part of the same patient preparation procedure, reducing the complexity of managing separate affixing processes while enabling automated alignment and retrieval.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and efficient alignment of image data with actual patient views, reducing manual intervention and ensuring data retrieval matches the viewed patient, enhancing surgical precision and reducing errors.
Implementation Method 1
an optical code being perceptible to an optical sensor
Implementation Method 2
capturing image data of the patient using the non-optical imaging modality, with the image data including an inner layer of the patient
Data Source
AI summary
Aligning image data of a patient with actual views of the patient using an optical code affixed to the patient. In some embodiments, a method may include affixing an optical code to a patient, affixing a pattern of markers to the patient, capturing image data of the patient, sensing the optical code affixed to the patient and a position of the optical code in a 3D space, accessing the image data, calculating the position of the pattern of markers in the 3D space, registering the position of the inner layer of the patient in the 3D space by aligning the calculated position of the pattern of markers in the 3D space with the position of the pattern of markers in the image data, and displaying in real-time, in an alternate reality (AR) headset, the inner layer of the patient from the image data projected onto actual views of the patient.