UAV Video Overlay Control Under Remote Communication Latency
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing systems face challenges in accurately maneuvering unmanned aerial vehicles (UAVs) from a remote location due to high video and communication latency, leading to response time lags and uncontrolled movements.
Innovation Solution
A system and method that overlays interactive markers and virtual UAV representations on the video feed, allowing users to assess and rectify UAV movements in real-time by using low-latency communication between the ground control station and display modules, such as VR headsets, to compensate for latency.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If video feed is transmitted from UAV to remote location, then user can see UAV position and area of interest, but response time lag occurs due to latency
Solution Approach 1:
The system pre-calculates and displays where the UAV will be in the future based on current velocity and control inputs, rather than showing where it currently is. This predictive rendering compensates for transmission latency by presenting information about future states before they occur, eliminating the perception of delay for the operator.
Solution Approach 2:
The system creates a virtual copy of the UAV's future position and orientation, rendering this virtual representation in the video feed instead of the actual current position. This virtual copy allows the operator to see where the UAV will be, creating the illusion of real-time control despite physical latency in signal transmission.
2Ease of operation
If user controls UAV with remote controller, then UAV can be maneuvered from remote location, but collision and uncontrolled movement occur due to latency
Solution Approach 1:
The system provides enhanced feedback by showing the operator where the UAV will be based on current control inputs, rather than where it currently is. This predictive feedback loop allows the operator to anticipate the UAV's position and make corrective adjustments before collisions occur, significantly improving safety despite latency.
Solution Approach 2:
By displaying the predicted future position of the UAV, the system enables the operator to take preliminary corrective actions before the UAV actually reaches potentially dangerous positions. This allows proactive collision avoidance rather than reactive response.
3Loss of time
If video latency is reduced for better control, then response time improves, but transmission quality and accuracy may be compromised
Solution Approach 1:
The system creates a mathematically calculated copy of the UAV's future position based on telemetry data, rather than transmitting additional high-resolution video frames. This virtual representation maintains precision without requiring increased transmission bandwidth or reduced latency.
Solution Approach 2:
The system changes the temporal parameter of the video feed from showing current position to showing future predicted position. This parameter transformation allows the system to maintain full transmission quality while eliminating the perception of latency, as the displayed information is deliberately shifted forward in time.
Data Source
AI summary
A ground control station configured to establish a communication channel with an Unmanned Aerial Vehicle (UAV), to receive a second marked singular point indicative of an Area of Interest (AOI) and based on user input, to transmit, to the UAV, the second marked singular point, which is configured to instruct the UAV to move towards the second marked singular point, to receive, from the UAV, live video including the AOI, to determine a latency of the live video, to determine a first marked singular point based on the determined latency of the live video, to render a display video using the live video, the second marked singular point, and the first marked singular point, wherein the display video further includes a visual connection between the second marked singular point and the first marked singular point, and to display the rendered display video.