Drone Path Coordinate Mapping for Camera-Based Flight Overlay
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current systems face challenges in accurately displaying the flight path of autonomous drones on user terminals, as the coordinate systems used by drones and camera-equipped devices differ, making it difficult to superimpose flight paths onto real-time images with high accuracy.
Innovation Solution
The solution involves setting a real object in the camera-captured image as a marker, generating marker reference coordinates, and using these coordinates to transform and transmit position data between devices, allowing for accurate display of flight paths and destination tracking on user terminals.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If flight path information in NED coordinate system is transmitted from drone to user terminal, then flight path data can be provided to user terminal, but accurate display on camera-captured image becomes difficult due to coordinate system mismatch
Solution Approach 1:
The patent introduces a coordinate transformation process as an intermediary mechanism between the NED coordinate system (used by drone) and camera coordinate system (used by user terminal). The transformation unit converts flight path information from NED coordinates to camera coordinates, enabling accurate superposition of flight path lines on camera-captured images while maintaining reliable information transmission.
2Extent of automation
If drone performs autonomous flight using GPS and NED coordinate system, then autonomous navigation is achieved, but integration with camera-based visual display becomes problematic
Solution Approach 1:
The patent changes the coordinate system parameters by transforming flight path information from NED coordinate parameters (north, east, down) to camera coordinate parameters (image plane coordinates). This parameter transformation enables autonomous flight functionality to be integrated with camera-based visual display without increasing system complexity.
3Ease of operation
If flight path is displayed by superimposing lines on camera images, then visual tracking is achieved, but coordinate transformation complexity increases
Solution Approach 1:
The patent performs preliminary coordinate transformation by pre-converting flight path information from NED coordinates to camera coordinates before display. This preliminary action simplifies the display process by eliminating the need for real-time coordinate calculations during image rendering, thereby reducing processing complexity while maintaining ease of visual tracking.
Data Source
AI summary
Provided is a data processing unit of a user terminal that sets a real object included in a camera-captured image as a marker, generates marker reference coordinates with a configuration point of the set marker as an origin, and transmits position data on the marker reference coordinates to a mobile device. The data processing unit transforms the destination position of the drone or the position of the tracking target from the coordinate position on the user terminal camera coordinates to the coordinate position on the marker reference coordinates, and transmits the transformed coordinate position to the drone. The data processing unit receives the movement path from the drone as coordinate position data on the marker reference coordinates, transforms the coordinate position data into a coordinate position on the user terminal camera coordinates, and displays the path information on the display unit.