Drone Flight Path Overlay Using NED to Camera Coordinate Conversion
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current technologies face challenges in accurately displaying the flight path of autonomous drones on captured images due to the mismatch between the NED coordinate system used for flight control and the camera coordinate system for image processing, leading to inaccurate superimposition of flight paths on real-time drone images.
Innovation Solution
An image processing device and method that perform coordinate conversion processing to convert position information from the NED coordinate system to the camera coordinate system, using a coordinate conversion matrix to accurately display the drone's flight path on the captured image, enabling precise alignment of flight path information with the camera's image coordinates.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Loss of information
If flight path information is provided in NED coordinate system from drone or control center, then the flight path data can be obtained for user terminal display, but the position information cannot be accurately displayed on camera-capturing image due to coordinate system mismatch
Solution Approach 1:
The patent introduces a coordinate conversion process as an intermediary between the NED coordinate system (used by drone/control center) and the camera coordinate system (used for image display). This intermediary conversion mechanism enables accurate positioning by translating flight path data into the appropriate coordinate framework for visual display, resolving the coordinate system mismatch problem.
Solution Approach 2:
The patent changes the coordinate system parameters by generating a coordinate conversion matrix that transforms position information from NED coordinates to camera coordinates. This parameter transformation allows the same position data to be accurately represented in different coordinate systems, enabling precise overlay of flight path on captured images.
2Measurement precision
If coordinate conversion processing is performed to convert position information from NED coordinate system to camera coordinate system, then accurate display of flight path on captured image is achieved, but additional processing steps and computational complexity are required
Solution Approach 1:
The patent performs preliminary action by pre-calculating and storing the coordinate conversion matrix based on the relationship between NED and camera coordinate systems. This preparation work is done in advance, so that when flight path data needs to be displayed, the conversion can be performed efficiently using the pre-computed matrix, reducing real-time processing complexity.
Data Source
AI summary
A configuration capable of accurately displaying a flight path of a drone on an actually captured image of the drone. The configuration includes a data processing unit that displays a moving path of a moving device such as a drone on a display unit that displays a camera-capturing image of the moving device. The data processing unit generates a coordinate conversion matrix for performing coordinate conversion processing of converting position information according to a first coordinate system, for example, the NED coordinate system indicating the moving path of the moving device into a second coordinate system, for example, the camera coordinate system capable of specifying a pixel position of a display image on the display unit. The data processing unit outputs the moving path having position information according to the camera coordinate system generated by coordinate conversion processing to which the generated coordinate conversion matrix is applied.