Wearable Immersive AR for Marine Navigation Data Overlay

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Critical system operations, such as marine vessel navigation, require timely and accurate decision-making by personnel, which is challenging due to the need to monitor multiple data sources while physically navigating, leading to potential disastrous consequences from bad decision-making.

Innovation Solution

A wearable immersive augmented reality (WIAR) system is integrated with marine navigation systems, using a WIAR device to display critical navigation data and receive command inputs, with a middleware component that determines the appropriate display items based on the vessel's operational mode, enhancing situational awareness and reducing visual clutter.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional navigation displays are used, then navigation data is available, but the personnel must switch between multiple displays which reduces situational awareness and increases cognitive load

Engineering Contradiction:
Improvesituational awarenessVSAvoidnumber of displays to monitor
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent combines multiple navigation data sources (GPS, radar, AIS, chart data) and overlays them onto a single augmented reality display that the pilot wears. This merging of multiple information sources into one unified interface eliminates the need to switch between multiple separate displays, maintaining situational awareness while reducing the cognitive burden of monitoring multiple devices.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent transitions from traditional 2D flat displays to a 3D augmented reality overlay that projects navigation data directly into the pilot's field of view. This dimensional change allows the pilot to see navigation information superimposed on the actual environment, creating a more intuitive spatial relationship between the data and the real world, thereby improving situational awareness.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Loss of information

If all navigation data is displayed simultaneously, then complete information is provided, but visual clutter increases making it difficult to identify critical information

Engineering Contradiction:
Improvecompleteness of navigation informationVSAvoidability to identify critical information
Core Design Contradiction:
Loss of informationVSEase of operation

Solution Approach 1:

The patent applies different display qualities and priorities to different types of navigation information based on their criticality. Critical safety-related information (such as collision warnings, depth alerts, or navigation marker positions) is displayed with higher prominence, larger size, or distinct visual characteristics, while less critical data is displayed with lower prominence. This local differentiation allows the pilot to quickly identify critical information without being overwhelmed by visual clutter from less important data.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent selectively displays only the most relevant navigation information based on the current operational context, vessel type, and environmental conditions, rather than displaying all available data. This partial action approach filters out unnecessary information while maintaining completeness of critical data, reducing visual clutter while preserving essential navigation information.

Inventive Principle:
Principle #16Partial or excessive action

3Loss of information

If the pilot focuses on monitoring displays, then navigation data is monitored, but physical observation of surroundings is compromised leading to safety risks

Engineering Contradiction:
Improvemonitoring of navigation dataVSAvoidrisk of collision or grounding
Core Design Contradiction:
Loss of informationVSObject-affected harmful factors

Solution Approach 1:

The patent projects navigation data into the pilot's field of view in three-dimensional space, allowing the pilot to see both the physical environment and digital navigation information simultaneously without shifting focus. This dimensional integration eliminates the need to alternate between looking at displays and observing the surroundings, as both are visible in the same visual field, thereby maintaining situational awareness and reducing safety risks.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Solution Approach 2:

The augmented reality display acts as an intermediary that bridges the gap between the physical environment and digital navigation information. Instead of requiring the pilot to switch attention between separate physical displays and the environment, the AR display mediates by overlaying digital information directly onto the view of the physical world, allowing simultaneous monitoring of both without compromising safety.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS10712159B2Critical system operations and simulations using wearable immersive augmented reality technology
Publication Date: 2020.07.14 GRABOWSKI MARTHA
  • US10712159B2 patent drawing
  • US10712159B2 patent drawing
  • US10712159B2 patent drawing

AI summary

A system, method and program product for utilizing WIAR technology to aid in the navigation of a marine vessel. A system is provided that includes a WIAR device for displaying marine navigation data and receiving command inputs; a middleware component that interfaces with the WIAR device and a navigation system of a marine vessel; and a display coordinator that determines a set of display items to display on the WIAR device, wherein the set of display items are determined in response to an operational mode of the marine vessel.