Drone Path Overlay Using Marker-Based Coordinate Transformation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing technologies face challenges in accurately displaying the flight path and destination of autonomous drones, such as those used for baggage delivery, due to differences between the camera coordinate system and the NED coordinate system used for flight control.
Innovation Solution
The proposed solution involves setting a real object in the camera-captured image as a marker, generating marker reference coordinates, and transmitting position data on these coordinates to enable accurate superimposition of flight paths on live images of drones, using a data processing unit in an information processing device.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If flight path information is transmitted using NED coordinate system from drone or control center, then flight control and position confirmation are enabled, but accurate superimposition on camera-captured images becomes difficult due to coordinate system mismatch
Solution Approach 1:
The patent introduces a coordinate transformation process as an intermediary between the NED coordinate system (used for flight control) and the camera coordinate system (used for image display). The control center transforms flight path information from NED coordinates to camera coordinates before transmitting to the user terminal, enabling accurate superimposition without compromising flight control accuracy
Solution Approach 2:
The patent changes the coordinate system parameters by transforming position data from NED coordinate system (north, east, down axes) to camera coordinate system (image-based coordinates). This parameter transformation allows the same flight path information to be accurately represented in both coordinate systems for their respective purposes
2Productivity
If autonomous flying drones are used for baggage delivery without visual monitoring, then operational efficiency increases, but user ability to track and confirm flight path decreases
Solution Approach 1:
The patent implements a feedback mechanism where the user terminal receives real-time flight path information from the control center and displays it on camera-captured images. This provides continuous feedback to the user about the autonomous drone's position and trajectory, maintaining user awareness without requiring visual monitoring
Solution Approach 2:
The patent creates a visual copy of the flight path information by superimposing the transmitted path data onto the live camera image. This copied representation allows users to track the autonomous drone's position and confirm its flight path without needing to visually observe the actual drone
Data Source
AI summary
Provided is a data processing unit of a user terminal that sets a real object included in a camera-captured image as a marker, generates marker reference coordinates with a configuration point of the set marker as an origin, and transmits position data on the marker reference coordinates to a mobile device. The data processing unit transforms the destination position of the drone or the position of the tracking target from the coordinate position on the user terminal camera coordinates to the coordinate position on the marker reference coordinates, and transmits the transformed coordinate position to the drone. The data processing unit receives the movement path from the drone as coordinate position data on the marker reference coordinates, transforms the coordinate position data into a coordinate position on the user terminal camera coordinates, and displays the path information on the display unit.