AR Cross-Cueing Map Camera Correlation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Prior art cueing systems fail to provide an immediate bilateral ability for camera operators and unmanned vehicle operators to see the relationship between video received from an unmanned vehicle and a map of the area, requiring systems and methods for cross-cueing between map and camera displays.

Innovation Solution

A graphical user interface with cursor control devices allows for cross-cueing between map and camera views, using color-coded hazard maps and line of sight data to indicate visible and occluded locations, with the unmanned vehicle providing geographic position and image data to the ground station for real-time correlation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If prior art cueing systems are used, then system complexity is reduced, but situation awareness and understanding of the relationship between video and map views deteriorates

Engineering Contradiction:
Improvesituation awarenessVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent merges the map view and camera view into a single integrated display interface, allowing operators to see both views simultaneously with correlated cursors. This combination enables immediate understanding of the relationship between video and map data without requiring separate display systems or complex switching mechanisms, thus improving situation awareness while maintaining manageable system complexity.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent introduces correlated cursors as an intermediary element that bridges the map view and camera view. The first cursor on the map and second cursor on the camera feed are dynamically linked, allowing operators to select features in one view and immediately see the corresponding location in the other view. This intermediary mechanism enables bidirectional cross-cueing without requiring complex processing or multiple intermediate systems.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If color coded hazard maps are used, then understanding speed and situation awareness improve, but information processing complexity increases

Engineering Contradiction:
Improveunderstanding speedVSAvoidinformation processing complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent applies color coding to hazard zones on the map display, using different colors to represent different levels of hazard or terrain types. This visual encoding allows operators to rapidly comprehend the terrain and hazard information without requiring detailed analysis of numerical data, thus improving understanding speed while the processing complexity remains manageable through standard graphical rendering techniques.

Inventive Principle:
Principle #32Color changes

3Loss of information

If real-time cross-cueing between map and camera views is implemented, then situation awareness improves, but computational requirements and system complexity increase

Engineering Contradiction:
Improverelationship visibilityVSAvoidsystem complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent implements bidirectional feedback between the map view and camera view through correlated cursors. When the operator moves the first cursor on the map, the second cursor automatically updates to show the corresponding location on the camera feed, and vice versa. This real-time feedback mechanism provides immediate visual confirmation of the relationship between the two views, improving situation awareness through a relatively simple cursor coordination system.

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS10353389B2Augmented reality cross-cueing systems and methods
Publication Date: 2019.07.16 RAPID IMAGING TECHNOLOGIES LLC
  • US10353389B2 patent drawing
  • US10353389B2 patent drawing
  • US10353389B2 patent drawing

AI summary

Cross-cueing systems allow users to instantly understand the geographic location of objects in the video scene, as well as instantly understand the location within the scene of objects on a map. This provides an unprecedented level of situation awareness for unmanned vehicle operators and video surveillance system operators.