XR Headset Eye Tracking via External Stereo Camera Calibration
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Eye tracking systems for augmented reality headsets in surgical settings are expensive, bulky, and difficult to integrate, requiring multiple cameras and infrared strobes, which increase the weight and size of the headset, making them impractical for certain designs.
Innovation Solution
A camera tracking system that determines the pose of an extended reality headset relative to stereo tracking cameras and calibrates the eye-to-display relationship, allowing for accurate overlay of virtual content on the physical world without the need for additional bulky equipment, by using a combination of visible and near-infrared tracking cameras and algorithms to track fiducials and maintain navigation accuracy.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If traditional eye tracking equipment (multiple cameras and infrared strobes) is integrated into the XR headset, then eye tracking accuracy is improved, but the weight and size of the headset increase significantly
Solution Approach 1:
The patent extracts the eye tracking function from the XR headset by using a separate camera system positioned externally. The external camera captures images of the user's eyes, and the processor mounted on the XR headset performs eye tracking calculations based on these images, eliminating the need for bulky eye tracking components inside the headset.
Solution Approach 2:
The processor in the XR headset serves multiple functions: it processes navigation data from tracking cameras, renders virtual content, and also performs eye tracking calculations by analyzing images from the external camera. This multi-functionality eliminates the need for dedicated eye tracking hardware in the headset.
2Adaptability or versatility
If traditional eye tracking equipment (multiple cameras and infrared strobes) is integrated into the XR headset, then eye tracking capability is achieved, but the device complexity increases
Solution Approach 1:
The patent extracts the eye tracking function from the XR headset by using a separate camera system positioned externally. The external camera captures images of the user's eyes, and the processor mounted on the XR headset performs eye tracking calculations based on these images, eliminating the need for bulky eye tracking components inside the headset.
Solution Approach 2:
The processor in the XR headset serves multiple functions: it processes navigation data from tracking cameras, renders virtual content, and also performs eye tracking calculations by analyzing images from the external camera. This multi-functionality eliminates the need for dedicated eye tracking hardware in the headset.
3Measurement precision
If traditional eye tracking equipment (multiple cameras and infrared strobes) is integrated into the XR headset, then accurate eye position detection is achieved, but the headset becomes bulky and impractical for certain designs
Solution Approach 1:
The patent extracts the eye tracking function from the XR headset by using a separate camera system positioned externally. The external camera captures images of the user's eyes, and the processor mounted on the XR headset performs eye tracking calculations based on these images, eliminating the need for bulky eye tracking components inside the headset.
Solution Approach 2:
The processor in the XR headset serves multiple functions: it processes navigation data from tracking cameras, renders virtual content, and also performs eye tracking calculations by analyzing images from the external camera. This multi-functionality eliminates the need for dedicated eye tracking hardware in the headset.
Applied Scientific Principles
This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.
Function Achieved in This Case
Enables accurate and efficient eye tracking for improved surgical navigation, reducing the bulk and weight of the headset while maintaining navigation accuracy, allowing for seamless tracking of surgical instruments and anatomical structures.
Implementation Method 1
a camera tracking system determines a pose of a user's eyes relative to stereo tracking cameras based on tracking information from the stereo tracking cameras
Data Source
AI summary
A camera tracking system for computer assisted navigation during surgery operatively determines a first pose of a second extended-reality (XR) headset relative to stereo tracking cameras located on a first XR headset based on first tracking information from the stereo tracking cameras. The camera tracking system determines a second pose of eyes of a user wearing the second XR headset relative to the stereo tracking cameras located on the first XR headset based on second tracking information from the stereo tracking cameras. The camera tracking system also calibrates an eye-to-display relationship defining pose of the eyes of the user wearing the second XR headset to a display device of the second XR headset based on the determined first and second poses. The camera tracking system also controls where symbols are displayed on the display device of the second XR headset based on the eye-to-display relationship.