HMD Augmented Image Overlay for Remote Maintenance Guidance
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Field technicians face challenges in performing maintenance on increasingly complex systems due to the need for effective and cost-efficient solutions that assist them in real-time, especially in providing guidance and feedback during operations.
Innovation Solution
A method and system that utilizes a head-mounted display (HMD) to transmit images to an intermediate computerized system, which then generates and transmits augmented images back to the HMD, allowing for real-time feedback and guidance, enabling field technicians to receive annotations and instructions directly on their display, even without manual input, through a cloud environment server.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Productivity
If field technicians perform maintenance on complex systems manually without assistance, then they maintain independence and avoid additional equipment, but their efficiency and accuracy decrease due to system complexity
Solution Approach 1:
The patent introduces an intermediate computerized system that acts as a mediator between the field technician and the complex system being maintained. This intermediary receives images from the technician's HMD, processes them, generates augmented images with feedback, and transmits them back to the HMD, thereby simplifying the technician's interaction with complex systems without reducing productivity
Solution Approach 2:
The patent implements a feedback loop where the intermediate system analyzes images captured by the technician's HMD, generates appropriate feedback annotations, and displays them in real-time through the HMD. This continuous feedback mechanism guides the technician through complex maintenance procedures, improving efficiency while managing system complexity
2Measurement precision
If remote experts provide real-time guidance to field technicians, then maintenance accuracy improves, but system complexity and cost increase
Solution Approach 1:
The patent enables the field technician to receive automated guidance from the intermediate system without requiring constant intervention from remote experts. The system autonomously processes images, generates feedback, and provides step-by-step instructions, allowing technicians to self-service complex maintenance tasks while maintaining high accuracy
Solution Approach 2:
The intermediate system prepares and provides maintenance guidance in advance by analyzing images and generating augmented feedback before the technician completes each step. This preliminary action ensures accuracy by providing instructions ahead of time rather than requiring real-time expert intervention
3Ease of operation
If field technicians use traditional communication methods for maintenance guidance, then equipment cost remains low, but information delivery speed and hands-free operation are limited
Solution Approach 1:
The patent replaces traditional mechanical communication methods (two-way radio, phone) with an optical-based HMD system that displays augmented images directly in the technician's field of view. This substitution enables hands-free operation while providing visual feedback, improving ease of operation without significantly increasing communication system complexity
Data Source
AI summary
A method for feedback based maintenance wherein the method may include transmitting to an intermediate computerized system a first image that was acquired, at an acquisition point of time, by a head mounted display (HMD) mounted on a head of a first user; transmitting the first image from the intermediate computerized system and towards a computerized device of a second user; displaying on the computerized device of the second user the first image; receiving feedback, in response to the displaying and by the intermediate computerized system; generating, by the intermediate computerized system, an augmented image that comprises the first image and the feedback; transmitting to the HMD the augmented image; adjusting, by the HMD the augmented image to provide an amended augmented image that corresponds to visual information as viewed by the HMD at a display point in time; and displaying, by the HMD, the amended augmented image.