UAS Data Integration with GIS for AR Decision Support

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

In safety-critical systems, decision-makers face challenges in synthesizing disparate and unpredictable data sources, such as UAS imagery, weather data, and social media feeds, to make timely and effective decisions during emergencies, as current systems lack integrated real-time data visualization for augmented reality displays.

Innovation Solution

A system and method that integrate unmanned aerial system (UAS) data with structured and unstructured information, using a geographic information system (GIS) platform to generate a visual decision support interface on augmented reality displays, overlaying flight plans with interactive points linking UAS images to geospatial locations, and incorporating additional data types like weather, thermal images, and social media data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual synthesis of information from disparate sources is used, then decision-makers can process information, but the process is time-consuming and delays critical decisions

Engineering Contradiction:
Improvedecision-making speedVSAvoidtime to synthesize information
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The patent merges multiple disparate information sources (UAS data, GIS data, weather data, social media data, RFID data) into a single integrated augmented reality interface. This consolidation eliminates the need for manual synthesis across multiple systems, directly addressing the time loss problem by presenting all relevant information in one unified view that updates automatically.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent replaces the mechanical process of manual information synthesis with an automated computer-based system. The system automatically collects, processes, integrates, and displays data from multiple sources through AR visualization, substituting human manual effort with automated computational processes that operate continuously without delay.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Reliability

If multiple disparate information sources are integrated into a unified system, then decision support quality improves, but system complexity increases

Engineering Contradiction:
Improvedecision support qualityVSAvoidsystem integration complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The patent introduces an intermediary integration layer that sits between multiple data sources and the AR display interface. This intermediary system handles the complexity of data collection, processing, and synchronization from disparate sources (UAS, GIS, weather, social media, RFID), shielding users from underlying system complexity while delivering unified, reliable decision support through the AR interface.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent creates a universal platform that handles multiple data types and sources through a single integrated system. The AR interface serves multiple functions simultaneously: displaying GIS maps, overlaying UAS imagery, showing weather conditions, presenting social media feeds, and tracking RFID tags, all within one unified system that reduces overall complexity despite handling diverse information.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Loss of information

If real-time data from multiple sources is processed and integrated, then situational awareness improves, but data processing requirements and computational load increase

Engineering Contradiction:
Improvesituational awareness completenessVSAvoidcomputational energy consumption
Core Design Contradiction:
Loss of informationVSUse of energy by moving object

Solution Approach 1:

The patent implements selective data processing where the system processes only the most relevant data elements in real-time while maintaining readiness for additional data. The AR interface prioritizes displaying critical information (such as UAS imagery and active incident data) while still having access to broader data sets, achieving comprehensive situational awareness without processing every possible data point at maximum intensity.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS11361664B2Integration of unmanned aerial system data with structured and unstructured information for decision support
Publication Date: 2022.06.14 GRABOWSKI MARTHA
  • US11361664B2 patent drawing
  • US11361664B2 patent drawing
  • US11361664B2 patent drawing

AI summary

A system and method that system for provide visual decision support information. A disclosed system performs a process that includes: storing a set of layers of GIS data associated with a safety critical use case; in response to an active incident, integrating UAS incident data with the GIS data and generating a visual decision support interface that includes a flight plan overlaid onto the GIS data, wherein the flight plan includes a path with interactive points that link images taken by a UAS to geospatial locations in the GIS data; in further response to the active incident, integrating at least one of: weather, thermal image, social media, RFID, machine learning, animation, graphic, haptic sensor, holographic or virtual image, emoji, or video data, with the GIS data to provide additional visual information to the visual decision support interface; and displaying the visual decision support interface on at least one display.