Head-Mounted AR Tracking with Dual Line-of-Sight Switching
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing augmented reality systems for image-guided surgery face challenges in maintaining accurate alignment of virtual images with the patient's anatomy, particularly when the line of sight between the tracking device and the patient or tool markers is obstructed.
Innovation Solution
The system employs a first head-mounted device with a tracking device that uses a single camera to track a patient marker and a tool marker, and incorporates data from an additional tracking device when the first device loses line of sight, allowing for continued generation of augmented reality images.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Device complexity
If a single tracking device with a single camera is used to track patient marker and tool marker, then the device complexity is reduced, but the reliability of tracking is compromised when line of sight is obstructed
Solution Approach 1:
The patent combines data from multiple tracking devices (first tracking device and second tracking device) to achieve continuous and accurate tracking. When the first tracking device loses line of sight to markers, the system merges in data from the second tracking device to maintain tracking reliability, thus resolving the contradiction between simple device configuration and reliable tracking.
Solution Approach 2:
The system implements multi-functionality by enabling the first head-mounted device to operate both as a primary tracking device with display capabilities and as a secondary tracking device when needed. This allows the same hardware to serve multiple functions depending on operational conditions, maintaining reliability without permanently increasing system complexity.
2Device complexity
If the first head-mounted device is used for both tracking and display, then the device complexity is reduced, but the measurement precision of tracking may be compromised
Solution Approach 1:
The system dynamically switches between using data from the first tracking device and the second tracking device based on line of sight conditions. When the first device has clear visibility, it provides tracking data; when obscured, the system transitions to using the second device's data, maintaining measurement precision adaptively without requiring permanently complex hardware.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
This approach ensures accurate and continuous tracking of the tool and patient anatomy, maintaining alignment and reducing errors in image-guided surgery, even when the primary line of sight is obstructed.
Implementation Method 1
a first head-mounted device with a tracking device that uses a single camera to track a patient marker and a tool marker
Data Source
AI summary
Apparatus and methods are described including tracking a tool portion and a patient marker from a first line of sight, using a first tracking device disposed upon a first head-mounted device that includes a display. The tool portion and the patient marker are tracked from a second line of sight, using a second tracking device. When a portion of the patient marker and the tool portion are both within the first line of sight, an augmented reality image is generated upon the first display based upon data received from the first tracking device and without using data from the second tracking device. When at least the patient marker portion and the tool portion are not both within the first line of sight, a virtual image of the tool and anatomy of the patient is generated using data received from the second tracking device. Other applications are also described.