UAV Camera View Control Using Gesture-Based Image Reference Points
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current methods for controlling unmanned aerial vehicles (UAVs) during aerial photography require coordination between pilots and camera operators, making it costly and time-consuming to compose shots, especially for self-portraits, as they involve indirect control methods that are inefficient and difficult to execute.
Innovation Solution
A system that uses a client device to receive image data from a UAV's image capture device, detect gesture-based inputs, and determine control data based on reference coordinates to adjust the UAV's position or attitude, allowing for direct and intuitive control of the camera's orientation and composition.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Ease of operation
If remote controls are used to directly control UAV attitude and speed, then ease of operation is improved, but device complexity increases due to independent camera control requirements
Solution Approach 1:
The patent merges the control of UAV navigation and camera orientation into a single integrated system. The image capture device is rigidly coupled to the UAV body, eliminating independent camera control. Gesture-based control combines both navigation and composition commands into unified input methods, reducing operational complexity while maintaining ease of use.
Solution Approach 2:
The control system is designed to handle multiple functions through unified interfaces. Gesture inputs can simultaneously control UAV movement and image composition, and the system adapts to different operational modes (navigation vs. composition) based on context, providing multi-functionality without increasing apparent device complexity.
2Ease of operation
If indirect control methods are used to reposition UAV for camera orientation, then ease of operation is improved, but loss of time increases due to multiple trials required for composition
Solution Approach 1:
The system provides real-time visual feedback through a display showing the current image composition. Users can see the effect of their gestures immediately, allowing for precise single-trial composition rather than multiple trials. The feedback loop enables users to adjust gestures based on the displayed result, dramatically reducing time loss.
Solution Approach 2:
The patent replaces traditional mechanical remote control with gesture-based control that directly maps user intent to system response. This substitution allows for more precise and faster control inputs, reducing the time needed to achieve proper composition compared to iterative mechanical control methods.
3Device complexity
If rigid coupling of image capture device to UAV is implemented, then device complexity is reduced, but adaptability decreases due to loss of independent camera orientation
Solution Approach 1:
The system dynamically adapts its control response based on the type of gesture detected and the current operational context. The same rigidly coupled hardware can achieve different composition outcomes through varied gesture inputs, providing adaptability equivalent to independent camera control while maintaining structural simplicity.
Solution Approach 2:
Gesture-based control acts as an intermediary between user intent and system response. This intermediary layer compensates for the rigid coupling by providing multiple levels of control abstraction, allowing users to achieve fine-grained camera composition control without mechanical independence.
4Ease of operation
If gesture-based control is used for direct camera manipulation, then ease of operation is improved, but difficulty of detecting and measuring increases due to gesture recognition complexity
Solution Approach 1:
The system changes the parameters of gesture detection by establishing clear geometric relationships between touch points and image coordinates. By mapping gestures to reference coordinates and using proportional relationships, the system simplifies the detection and measurement processes while maintaining intuitive operation.
Data Source
AI summary
A control terminal for controlling an unmanned aerial vehicle (UAV) includes a processor and a storage medium storing instructions that, when executed by the processor, cause the processor to render an image on a user interface of the control terminal. The image is captured by an imaging device coupled to the UAV and is associated with a view of the imaging device. The instructions further cause the processor to detect, via the user interface, a gesture-based input including one or more reference points in the image and indicating a view change of the imaging device, determine a type of the gesture-based input by analyzing the one or more reference points, and generate control data based on the type of the gesture-based input to control at least one of the UAV or the imaging device for the view change of the imaging device.