Augmented UAV Video Overlay for Situational Awareness
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Unmanned aerial vehicles (UAVs) lack effective systems for providing enhanced situational awareness to operators, particularly in identifying targets and restricted operating zones, and viewing captured information in the context of a surrounding environment, which limits their operational effectiveness.
Innovation Solution
A method and apparatus that enhance situational awareness by overlaying detectability information and other contextual data onto real-time image data from UAVs, using metadata to transform and display detectability overlays, along with geographical and topographical data, to estimate the likelihood of detection and provide actionable intelligence.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If typical unmanned systems display only basic sensor information, then the display system remains simple, but operators cannot identify targets, locate restricted zones, or view captured information in geographical context
Solution Approach 1:
The patent combines multiple information sources including captured image data, synthetic vision data from databases, geographical information, and detectability overlays into a single integrated display. This merging of previously separate information streams provides comprehensive situational awareness while managing complexity through unified presentation.
Solution Approach 2:
The display system serves multiple functions simultaneously: showing live camera feeds, overlaying geographical context, displaying detectability information, and presenting synthetic vision data. This multi-functionality addresses the information loss problem without requiring separate dedicated displays for each function.
2Loss of information
If no detectability information is provided, then the system operates simply, but operators cannot assess the likelihood of UAV detection by adversaries
Solution Approach 1:
The system pre-calculates detectability information and prepares synthetic vision data before the UAV mission. By performing these computations in advance and storing them in databases, the system reduces real-time processing complexity while ensuring detectability information is available when needed during operation.
Solution Approach 2:
The patent introduces synthetic vision data as an intermediary layer between raw sensor information and operator decision-making. This synthetic data, generated from databases and processed through coordinate transformations, mediates the complex relationship between UAV state and detectability assessment, making the information more usable for operators.
3Ease of operation
If real-time transformation and overlay of detectability information is implemented, then operator awareness is improved, but processing time and computational resources increase
Solution Approach 1:
The system performs coordinate transformations and prepares overlay data in advance where possible. By pre-processing synthetic vision data and maintaining it in accessible database formats, the system minimizes real-time computational requirements while ensuring accurate transformation when data is displayed to operators.
Data Source
Figure 1
Figure 2
Figure 3
AI summary
A facility, comprising systems and methods, for providing enhanced situational awareness to captured image data is disclosed. The disclosed techniques are used in conjunction with image data, such as a real-time or near real-time image stream captured by a camera attached to an unmanned system, previously captured image data, rendered image data, etc. The facility enhances situational awareness by projecting overlays onto captured video data or "wrapping" captured image data with previously-captured and/or "synthetic world" information, such as satellite images, computer-generated images, wire models, textured surfaces, and so on. The facility also provides enhanced zoom techniques that allow a user to quickly zoom in on an object or area of interest using a combined optical and digital zoom technique. Additionally, the facility provides a digital lead indicator designed to reduce operator-induced oscillations in commanding an image capturing device.