Wearable AR Glasses Surgical Navigation Using Eye-Camera Calibration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current surgical navigation methods are cumbersome and time-consuming, particularly in orthopaedic surgeries, due to the need for complex alignment of surgical instruments with pre-operative images, often requiring reference marks and multiple imaging systems, which can lead to inaccuracies and increased operation times.
Innovation Solution
An image-guided augmented reality method for wearable glasses that involves obtaining conversion matrices to accurately align the surgeon's gaze with marked points on a patient's body, using a combination of camera and eye calibration matrices to correct visual focus errors, allowing for precise positioning without the need for external guidance systems.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If conventional surgical navigation methods are used with multiple imaging systems and reference marks, then alignment accuracy can be achieved, but operation time increases significantly and device complexity increases
Solution Approach 1:
The patent combines pre-operative CT/MRI images with real-time optical tracking and augmented reality display into a single integrated navigation system. The surgical site is visualized by fusing pre-operative imaging data with real-time camera feeds, eliminating the need for separate imaging systems and reference marks while maintaining alignment accuracy through coordinate transformation algorithms.
Solution Approach 2:
The patent creates a virtual copy of the patient's internal anatomy from pre-operative CT or MRI scans and overlays it onto the real surgical field through augmented reality. This virtual model serves as a digital twin that can be viewed directly through wearable glasses, replacing the need for physical reference marks and multiple imaging devices while preserving measurement precision.
2Measurement precision
If multiple imaging systems and reference marks are used for surgical navigation, then positioning accuracy is improved, but device complexity increases
Solution Approach 1:
The patent extracts and removes the unnecessary components of conventional navigation systems, specifically eliminating physical reference marks and multiple imaging devices. The essential function of positioning is achieved through a simplified system using a single camera for optical tracking and computational algorithms for coordinate transformation, reducing device complexity while maintaining positioning accuracy.
Solution Approach 2:
The patent replaces the mechanical and physical systems (reference marks, multiple imaging devices, complex alignment mechanisms) with an optical-computational system. A single camera captures visual features, and software algorithms perform coordinate transformations and image fusion, substituting mechanical complexity with optical and computational processes that achieve the same positioning accuracy with fewer components.
3Reliability
If conventional navigation methods with physical reference marks are used, then surgical site alignment can be achieved, but the procedure becomes cumbersome and time-consuming
Solution Approach 1:
The patent replaces physical reference marks with a virtual digital model created from pre-operative imaging data. This virtual copy of the surgical site and surrounding anatomy is overlaid onto the real field of view through augmented reality, allowing the surgeon to see alignment information directly in the visual field without physically placing or adjusting reference marks, thereby improving ease of operation while maintaining alignment reliability.
Solution Approach 2:
The patent introduces augmented reality wearable glasses as an intermediary device that directly presents navigation information to the surgeon's visual field. Instead of requiring the surgeon to look at separate screens or physically manipulate reference marks, the AR glasses mediate by superimposing virtual surgical guidance onto the real surgical field, making the alignment process more convenient and intuitive while maintaining reliability.
Data Source
AI summary
This present invention discloses an image guided augmented reality method, comprising the following steps of: obtaining a first conversion matrix of a camera and a marked point; obtaining a second conversion matrix of the eye and the camera; linking the first conversion matrix and the second conversion matrix to obtain a correct position corresponding matrix of the eye to the marked point; and linking the correct position corresponding matrix to a position feature of the marked point to obtain the correct position of the eye to the marked point. The present invention also discloses a surgical navigation method of wearable glasses, used for obtaining the correct position of the operator's eye to the marked point.