Dynamic Situational Awareness Interface for Unmanned Vehicle Control

Resolve Bottlenecks,
Find Innovative SolutionsGenerate Solutions

Solution Overview

Problem

Current unmanned systems require specialized training and are limited by information quality, bandwidth, and latency, which degrades operator control and situational awareness, especially in complex environments.

Innovation Solution

A system and method that dynamically adjusts the situational awareness interface by regulating data and resolution from multiple sensors (EO and LIDAR) based on available bandwidth, generating a 3-D video and receiving operator commands to enhance control of unmanned vehicles.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If high-resolution data from multiple sensors is transmitted to provide comprehensive situational awareness, then information quality improves, but bandwidth consumption increases and latency increases

Engineering Contradiction:

Improveinformation qualityVSAvoidbandwidth consumption

Core Design Contradiction:

Loss of informationVSLoss of energy

Solution Approach 1:

The system dynamically adjusts the resolution and data transmission rate based on real-time bandwidth availability and operator attention focus. The image collection module monitors bandwidth parameters and dynamically regulates the amount of data transmitted, switching between high-resolution modes when bandwidth is abundant and compressed modes when bandwidth is limited.

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system applies different resolution levels to different regions of the scene based on operator focus. Areas where the operator is currently attending (identified through eye tracking or interface interaction) are transmitted at high resolution, while peripheral areas use lower resolution, optimizing the balance between information quality and bandwidth consumption.

Inventive Principle:

Principle #3Local quality

2Loss of information

If high-resolution data from multiple sensors is transmitted to provide comprehensive situational awareness, then information quality improves, but transmission time increases

Engineering Contradiction:

Improveinformation qualityVSAvoidtransmission time

Core Design Contradiction:

Loss of informationVSLoss of time

Solution Approach 1:

Inventive Principle:

Principle #15Dynamics

Solution Approach 2:

The system performs preliminary processing and compression of sensor data before transmission. The image collection module pre-regulates and optimizes the data stream based on current operational conditions, reducing the time required for transmission while maintaining essential information quality.

Inventive Principle:

Principle #10Preliminary action

3Loss of information

If the user interface presents comprehensive situational awareness information, then operator awareness improves, but interface complexity increases

Engineering Contradiction:

Improveoperator awarenessVSAvoidinterface complexity

Core Design Contradiction:

Loss of informationVSDevice complexity

Solution Approach 1:

The system applies different resolution levels and information densities to different regions of the interface based on operator focus. Areas where the operator is currently attending (identified through eye tracking or interface interaction) are displayed at high detail, while peripheral areas use lower detail representations, optimizing operator awareness while reducing overall interface complexity.

Inventive Principle:

Principle #3Local quality

Solution Approach 2:

The interface dynamically adjusts the amount and detail of information presented based on operator state and operational context. When the operator is focused on a specific task, the interface provides detailed information in that region while simplifying other areas, preventing information overload while maintaining comprehensive awareness.

Inventive Principle:

Principle #15Dynamics

4Measurement precision

If specialized training is required for unmanned system operation, then control precision improves, but operational time increases

Engineering Contradiction:

Improvecontrol precisionVSAvoidtraining time

Core Design Contradiction:

Measurement precisionVSLoss of time

Solution Approach 1:

The system provides adaptive training and guidance based on operator performance and attention patterns. The interface automatically identifies when an operator needs guidance and provides context-specific assistance, allowing operators to develop competence through use rather than requiring extensive pre-training.

Inventive Principle:

Principle #25Self-service

Solution Approach 2:

The system continuously monitors operator performance and provides real-time feedback to improve control precision. By analyzing operator actions and system responses, the interface adapts to provide appropriate levels of assistance and guidance, enabling operators to achieve proficient control without requiring months or years of specialized training.

Inventive Principle:

Principle #23Feedback

Data Source

PatentUS10142609B2Dynamically adjustable situational awareness interface for control of unmanned vehicles

Publication Date: 2018.11.27 NORTHROP GRUMMAN SYSTEMS CORP

AI summary

An apparatus includes an image collection module that monitors at least one parameter to dynamically regulate an amount of data and resolution to be allocated to at least one object in a scene collected from an image data set. A situational awareness interface (SAI) renders a 3-D video of the scene to an operator based on the amount of data and resolution allocated from the image data set by the image collection module and receives operator commands for an unmanned vehicle (UV) that interacts with the scene.