UAV Operating Modes With Low-Latency Video and Telemetry
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Modern unmanned sensor platforms, such as UAVs, face challenges in operator control due to complex controls and latency in video streams, which hinder optimal operation and increase cognitive load.
Innovation Solution
A mobile platform with a propulsion system, imaging system, and logic device that can execute various operating modes and reduce video processing latency through a low-latency video pipeline using hardware-accelerated applications and plugins, allowing for real-time control operations and telemetry processing.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If traditional video processing pipelines are used, then comprehensive image processing and telemetry determination can be performed, but video processing latency increases
Solution Approach 1:
The video processing pipeline is segmented into two separate processing paths: a first processing path that performs comprehensive image processing at a first processing rate, and a second processing path that determines telemetry information at a second processing rate. This segmentation allows each path to be optimized independently, with the telemetry path potentially using lower processing rates to reduce latency while the image processing path maintains higher rates for completeness.
Solution Approach 2:
The system applies partial processing to different data streams based on their specific requirements. The image data receives excessive processing (first processing rate) to ensure comprehensive analysis, while the telemetry data receives partial processing (second processing rate) that is sufficient for control operations but reduces overall latency. This selective processing approach optimizes the balance between processing completeness and speed.
2Adaptability or versatility
If multiple operating modes with complex control operations are provided, then system versatility increases, but operator cognitive load increases
Solution Approach 1:
The logic device is designed to execute multiple different operating modes, each with its own set of control operations. This multi-functionality allows the system to adapt to various operational requirements (surveillance, reconnaissance, exploration, etc.) while presenting a unified interface to the operator. The logic device universally handles mode selection and execution, reducing the need for operators to learn multiple separate control systems.
Solution Approach 2:
The system provides self-service through automated control operations within each operating mode. Once an operator selects an operating mode, the logic device automatically executes the appropriate control operations without requiring continuous manual intervention. This reduces cognitive load by allowing the system to manage its own complex control logic while the operator focuses on high-level mode selection and oversight.
Data Source
AI summary
Systems and methods related to operating modes and video processing for mobile platforms are disclosed. In one example, a logic device of a mobile platform may receive, from a base station, a command comprising a selection of one of a plurality of operating modes for the mobile platform, where each operating mode is associated with a plurality of corresponding control operations. The logic device may execute the control operations associated with the selected operating mode in response to the command. A video processing device having a low latency pipeline may be implemented in the mobile platform to assist the mobile platform in conducting the operating modes such as by outputting real time video streaming and telemetry information for the mobile platform. Related devices and systems are also provided.


