Remote Maintenance System with AR Visual Overlay and Secure Authentication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current remote maintenance technologies face challenges in effectively communicating visual information and system performance parameters between on-site personnel and remote technical experts, and lack cybersecurity measures to prevent unauthorized access, making it difficult to troubleshoot and maintain complex systems efficiently.

Innovation Solution

An interactive remote maintenance system utilizing a wearable head-mounted device with visual and audio interfaces, combined with image recognition and augmented reality, to provide real-time visual feedback and system data analysis, along with cybersecurity measures like authentication and encryption to secure remote access.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If remote maintenance systems provide real-time visual feedback and system data, then troubleshooting efficiency is improved, but cybersecurity vulnerabilities increase due to unauthorized access risks

Engineering Contradiction:
Improvetroubleshooting efficiencyVSAvoidsystem security
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent introduces a server as an intermediary between the wearable device and remote users. The server manages authentication, controls data transmission, and mediates all communications, preventing direct unauthorized access to the maintenance system while enabling efficient remote troubleshooting through controlled real-time visual and data feedback

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system performs preliminary authentication and authorization actions before allowing remote access. The server verifies user credentials and establishes secure connections in advance, ensuring that only authorized personnel can access the real-time visual feedback and system data, thus preventing security vulnerabilities before they occur

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If the system integrates image recognition and augmented reality for visual inspection, then diagnostic accuracy is improved, but device complexity increases

Engineering Contradiction:
Improvediagnostic accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent uses image recognition to create digital copies or representations of the physical system components being inspected. The augmented reality overlay displays diagnostic information and system data as virtual copies superimposed on the real-world view, enhancing diagnostic accuracy without requiring complex physical inspection equipment

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The wearable device integrates multiple functions including camera capture, image recognition processing, augmented reality display, and communication capabilities into a single universal platform. This multi-functional approach improves diagnostic accuracy through integrated visual and data analysis while managing overall device complexity through consolidation rather than separate specialized equipment

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Ease of repair

If the system provides comprehensive system performance parameters and prognostics, then maintenance quality is improved, but data transmission requirements and bandwidth consumption increase

Engineering Contradiction:
Improvemaintenance qualityVSAvoiddata transmission volume
Core Design Contradiction:
Ease of repairVSQuantity of substance

Solution Approach 1:

The patent applies local quality by selectively transmitting and displaying different types of system performance parameters based on their relevance to specific maintenance tasks. The augmented reality interface presents customized information layers that highlight only the critical data needed for current diagnostic and repair activities, rather than transmitting all possible system data uniformly

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS10516857B2Method and apparatus of secured interactive remote maintenance assist
Publication Date: 2019.12.24 THE UNITED STATES OF AMERICA AS REPRESENTED BY THE SECRETARY OF THE NAVY
  • US10516857B2 patent drawing
  • US10516857B2 patent drawing
  • US10516857B2 patent drawing

AI summary

A system and method for using the system comprising a head mounted device (HMD), a remote maintenance server (RMS), and a control section operable to identify the system under test (SUT) using an image recognition function, to identify a plurality of subsystems (PLoS) within the SUT in a data library, to create three dimensional models of the PLoS and displaying the same on a visual interface of the HMD using an augmented reality function, to connect to the RMS using an encryption algorithm via streaming video or images sent to the RMS, to collect SUT data and external (to the SUT) sensor data, to conduct a prognostics and/or health, maintenance, and/or management (HMM) service on the collected data to determine system health and projected health of the SUT and/or PLoS, to authenticate remote user access to the RMS, to update the data library, and to insert a plurality of (HMM) designators on the visual interface.