Augmented Reality Responder System for Real-Time Incident Data

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Responders, such as firefighters and police, often receive incomplete and non-situational information about incidents, lacking details like floor layouts, hazards, and personnel locations, which hinders their response efficiency.

Innovation Solution

The system utilizes IoT devices and augmented reality to provide real-time, situational information to responders, including driving instructions, hazard alerts, and mission-specific data, by receiving alert data, determining relevant stored data, and generating augmented reality information based on IoT device data for optimized communication and response.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If traditional alert systems are used to notify responders of incidents, then responders receive basic location information, but they lack comprehensive situational details such as floor layouts, hazards, and personnel locations

Engineering Contradiction:
Improvesituational information completenessVSAvoidinformation system complexity
Core Design Contradiction:
Loss of informationVSDevice complexity

Solution Approach 1:

The patent combines multiple information sources (IoT devices, building management systems, responder wearables) into a unified augmented reality interface that presents comprehensive situational data to responders. This merging of previously separate information systems eliminates information gaps while managing complexity through integration rather than multiplication of separate systems.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The augmented reality head-mounted display serves as an intermediary device that processes and presents filtered, relevant information to responders based on their location and role. This intermediary layer manages information complexity by selectively displaying only the most critical situational details needed for effective response.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Productivity

If responders navigate to incident locations using traditional methods, then they can reach the location, but they lack real-time guidance and situational awareness during transit and response

Engineering Contradiction:
Improveresponse efficiencyVSAvoidtime to achieve situational awareness
Core Design Contradiction:
ProductivityVSLoss of time

Solution Approach 1:

The system pre-loads building floor plans, hazard locations, and personnel data into the augmented reality interface before responders arrive at the incident. This preliminary preparation of information allows responders to immediately access critical data upon arrival, eliminating the time loss associated with gathering situational awareness during the response.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces traditional mechanical navigation methods (maps, radio communications) with augmented reality visual overlays that provide real-time directional guidance and situational information directly in the responder's field of view. This substitution eliminates the time required to interpret separate navigation tools and maintains continuous situational awareness during transit.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Reliability

If IoT devices are deployed throughout a facility to provide real-time data, then comprehensive incident information becomes available, but system complexity and data management challenges increase

Engineering Contradiction:
Improvereal-time data accuracyVSAvoidIoT system complexity
Core Design Contradiction:
ReliabilityVSDevice complexity

Solution Approach 1:

The system extracts and prioritizes only the most critical real-time data from the extensive IoT device network, such as active fire zones, structural hazards, and personnel locations. This extraction approach maintains high data reliability for decision-making while managing IoT system complexity by focusing on essential information rather than processing all available sensor data.

Inventive Principle:
Principle #2Taking out (Extraction)

4Ease of operation

If augmented reality interfaces provide comprehensive real-time information to responders, then situational awareness improves, but information overload may occur

Engineering Contradiction:
Improveresponder decision-makingVSAvoidinformation volume
Core Design Contradiction:
Ease of operationVSQuantity of substance

Solution Approach 1:

The augmented reality interface displays different types of information with varying prominence based on the responder's location, role, and current task. Critical safety information such as active hazards and evacuation routes is displayed with high visibility, while less critical data is shown with lower prominence. This local quality approach optimizes decision-making ease by presenting information according to its immediate relevance rather than uniformly displaying all data.

Inventive Principle:
Principle #3Local quality

Data Source

PatentUS11647375B2Providing responders with relevant real-time information
Publication Date: 2023.05.09 DISH NETWORK LLC
  • US11647375B2 patent drawing
  • US11647375B2 patent drawing
  • US11647375B2 patent drawing

AI summary

Providing of relevant information to a responder is described. A responder system receives alert data identifying an incident location. Available relevant data for the incident location is stored in the responder system. When relevant data is not stored, relevant data for the incident location is obtained from an external data source and stored in the responder system. While proceeding to the incident location and based on the alert data and the relevant data, initial augmented reality information is prepared for presentation to a responder. Upon arriving at the incident location, second augment reality information is generated. Upon arriving within a localized area of the incident location, an IoT device operable within the localized area is identified and selected and a communications link therewith is established. First IoT device data is received from the selected IoT device, and based thereon third augmented reality information is generated.