Wearable AR Maintenance System with Secure Remote Authentication

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing systems for remote control and maintenance of fielded systems lack integration with visualization technology, requiring on-site personnel and are vulnerable to cybersecurity threats due to inadequate user authentication and encryption.

Innovation Solution

A wearable augmented reality system with machine vision and voice/gesture recognition, coupled with secure user authentication and encryption, enables remote calibration and configuration management by generating 3D models of systems and subsystems, allowing secure remote parameter changes and interaction with remote data sources.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If existing remote control and maintenance systems are used, then remote maintenance capability is provided, but the systems are vulnerable to cybersecurity threats due to inadequate user authentication and encryption

Engineering Contradiction:
ImprovecybersecurityVSAvoidauthentication and encryption mechanisms
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system performs preliminary authentication actions before allowing any remote maintenance operations. Users must authenticate through multiple factors (biometric, cryptographic certificates, token-based verification) before gaining access to the remote maintenance interface, ensuring security is established in advance rather than reacted to during operations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements prior cushioning by establishing encryption keys and security protocols before any data transmission occurs. Cryptographic certificates are pre-installed, encryption algorithms are pre-configured, and security policies are pre-established, creating a protective buffer against potential cybersecurity threats before they can manifest

Inventive Principle:
Principle #11Beforehand cushioning (Prior cushioning)

2Ease of operation

If on-site personnel are required for maintenance tasks, then direct physical access to systems is achieved, but logistical challenges and operational complexity increase

Engineering Contradiction:
Improveremote maintenance operationVSAvoidlogistical challenges
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The system introduces an intermediary layer - a secure remote maintenance interface that mediates between the operator and the fielded system. This intermediary provides visualization overlays, control interfaces, and communication channels that allow operators to perform maintenance tasks remotely without needing physical presence at the system location

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system substitutes the mechanical requirement of physical presence with electronic and optical mechanisms. Instead of requiring operators to physically access the system, the system uses visual recognition, augmented reality overlays, and wireless communication to enable remote interaction and control, replacing the mechanical need for on-site personnel

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Productivity

If visualization technology is integrated with remote control systems, then operational efficiency is improved, but system complexity and integration requirements increase

Engineering Contradiction:
Improveoperational efficiencyVSAvoidintegration of visualization and control systems
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The system merges previously separate functions - visualization technology, remote control capabilities, and maintenance operations - into a unified integrated system. The visualization interface combines augmented reality overlays, system status displays, and control interfaces into a single cohesive environment that improves operational efficiency while managing complexity through integration rather than separation

Inventive Principle:
Principle #5Merging (Combining)

Data Source

PatentUS9746913B2Secured mobile maintenance and operator system including wearable augmented reality interface, voice command interface, and visual recognition systems and related methods
Publication Date: 2017.08.29 THE UNITED STATES OF AMERICA AS REPRESENTED BY THE SECRETARY OF THE NAVY
  • US9746913B2 patent drawing
  • US9746913B2 patent drawing
  • US9746913B2 patent drawing

AI summary

Secured remote maintenance, configuration management, and systems engineering apparatuses and methods including wearable augmented reality (AR) interface systems are provided. Embodiments can support secure and remote configuration setting changes (CSC) to a system or subsystem of interest (SSoI) using a head mounted device (HMD), a camera, a visual interface section, and a processing section including a plurality of processing instructions operable to operate a command input (CI) interface using one or more user command input CIs (e.g. voice or motion/gesture input recognition) using a secure user authentication systems. HMD machine vision and pattern recognition systems visually identify a SSoI, displaying a 3D model(s) of the SSoI on the HMD's visual interface using the AR interface system, obtaining a plurality of SSoI data, and displaying one or more of the SSoI data in relation to the 3D model on the HMD visual interface to support various tasks including CI directed CSCs.