AR Headset Alignment via Virtual Workspace Copying
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current collaborative maintenance and repair processes involving remote and local operators face challenges in precise alignment of augmented reality markings with physical targets, leading to potential errors due to complex calibration procedures and degradation over time, especially when linguistic, cultural, or ergonomic differences exist.
Innovation Solution
A multi-layer viewing system comprising a stationary imager, a beam projector, and an augmented reality headset that allows a remote user to project physical layer markings and annotations onto a target object, with a processor calculating the display position to ensure accurate alignment and visibility on the local user's AR display, enabling precise guidance and operation.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If complex calibration procedures are used to achieve precise alignment between AR markings and physical targets, then alignment precision is improved, but device complexity and time consumption increase
Solution Approach 1:
The system creates a virtual copy of the physical workspace by capturing images with a camera and overlaying AR markings on them. This virtual representation allows remote experts to annotate and guide local users without requiring complex physical calibration of AR equipment. The virtual model serves as an intermediary that simplifies the alignment process while maintaining precision.
Solution Approach 2:
The system introduces a virtual reality layer as an intermediary between the remote expert and the physical equipment. By projecting AR markings onto a captured image of the equipment rather than directly onto physical surfaces, the system mediates the interaction and eliminates the need for complex spatial calibration procedures.
2Measurement precision
If complex calibration procedures are used to achieve precise alignment, then alignment precision is improved, but the alignment accuracy deteriorates over time due to maintenance requirements
Solution Approach 1:
By working with a virtual copy (captured image) rather than direct physical AR projection, the system creates a stable reference frame that does not degrade over time. The virtual model can be regenerated from new images as needed, eliminating the accumulation of calibration errors that occurs with physical AR systems.
Solution Approach 2:
The system performs the calibration action preliminarily by capturing a reference image of the equipment before the remote guidance session begins. This pre-captured image serves as a stable reference that eliminates the need for real-time calibration during the guidance process, ensuring consistent alignment throughout the session.
3Speed
If AR markings are projected directly onto physical targets, then real-time guidance is improved, but alignment precision deteriorates due to environmental factors and movement
Solution Approach 1:
The system uses a captured image copy of the equipment as the projection surface rather than projecting directly onto physical targets. This virtual surface remains stable even when the physical equipment moves or when environmental conditions change, maintaining alignment precision while still providing real-time guidance through the AR interface.
4Loss of information
If remote experts provide verbal guidance with supporting material, then information sharing is improved, but communication efficiency deteriorates due to linguistic and cultural differences
Solution Approach 1:
The system uses visual annotations (different colors, shapes, and highlights) on the virtual image to convey information universally, bypassing linguistic barriers. Remote experts can mark specific locations, indicate directions with arrows, and highlight important areas using visual cues that are understood across different languages and cultures, significantly improving communication efficiency.
Data Source
Figure 1
Figure 2A
Figure 2B
AI summary
A multi-layer viewing system includes a stationary imager and a beam projector to project physical layer markings onto a region of an object. A headset includes an augmented reality display that is sufficiently transparent to enable a user who is wearing the headset to directly view the object through the display, and to display annotation that is superimposed on the object. A processor is configured to receive a selected location relative to the target for display of the annotation, determine an orientation of the augmented reality display by identifying images of markings in acquired images or markings on the object, calculate a display location for displaying the annotation on the augmented reality display such that the annotation is perceivable by the user as displayed at the selected position, and display the annotation at the calculated display location.