AR Surgical Navigation Co-registration via Fiducial Markers
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current computer-assisted surgical systems provide limited real-time assistance to surgeons during procedures, relying on pre-registered 3D images and offering minimal benefit during actual surgeries, necessitating a system that enhances real-time surgical performance with additional information through augmented reality.
Innovation Solution
A computer-assisted surgical system that integrates augmented reality, using a near-eye display and tracking systems to overlay real-time data and surgical plans directly onto the patient's anatomy, allowing for precise navigation and instrument guidance, while maintaining sterility and accuracy through co-registration of tracking modalities.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If pre-registered 3D images are used for surgical guidance, then the system can provide surgical navigation information, but the system cannot provide real-time assistance during surgery
Solution Approach 1:
The system performs preliminary registration of preoperative images with intraoperative trackers before surgery begins. This pre-established spatial relationship allows the system to immediately provide real-time AR overlays during surgery without requiring time-consuming registration procedures intraoperatively.
Solution Approach 2:
The patent replaces traditional mechanical registration procedures with automated image processing and AI-based tracking systems. The system uses machine learning models to automatically register preoperative images with intraoperative trackers, eliminating manual registration steps and enabling real-time surgical guidance.
2Productivity
If augmented reality overlays are provided during surgery, then real-time surgical information is enhanced, but the system complexity increases
Solution Approach 1:
The system uses a universal tracking framework that can accommodate multiple tracking modalities (optical, electromagnetic, acoustic) and integrate them with various surgical instruments and imaging modalities. This multi-functional approach allows a single system architecture to serve multiple surgical guidance needs without proportionally increasing complexity.
Solution Approach 2:
The patent introduces an intermediary registration layer that mediates between different tracking systems and imaging modalities. This intermediate registration framework standardizes the interface between diverse tracking technologies and surgical tools, simplifying system integration while enabling comprehensive AR overlays.
3Measurement precision
If multiple tracking modalities are integrated, then co-registration accuracy is improved, but the difficulty of detecting and measuring increases
Solution Approach 1:
The system implements feedback mechanisms that continuously monitor the performance of multiple tracking modalities and automatically adjust registration parameters to maintain optimal co-registration accuracy. The AI-based tracking system receives feedback from various sensors and dynamically refines its registration, simplifying the detection and measurement of spatial relationships.
Solution Approach 2:
The patent employs parameter transformation and normalization techniques that convert different tracking modalities into a unified coordinate system. By changing and standardizing parameters across different tracking systems, the system achieves accurate co-registration while reducing the complexity of detecting and measuring spatial relationships between different modalities.
Data Source
AI summary
Various embodiments disclosed herein relate to improved systems and methods for performing computer-aided surgical navigation using augmented reality. A tracking device having one or more optically detectable points is mounted to a patient via surgical hardware. The detectable points are identified by a sensor. One or more augmented reality marker assemblies that each have an augmented reality fiducial marker or symbol are also attached to the tracking device. A computer system generates augmented reality information and transmits it to a display screen, such as a near-eye augmented reality device, for display thereon. The near-eye augmented reality device also has an image capture device capable of capturing the augmented reality symbols, and thereby determining a three-dimensional orientation associated with the tracking device, augmented reality markers, and a user wearing the near-eye reality device.