Magic Wand UAV Interface for Gesture-Based Shot Control
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current UAV control systems require piloting expertise and are prone to crashes due to pilot error, as they rely on direct control of pitch, roll, and yaw, making them less intuitive and user-friendly for capturing images and video.
Innovation Solution
The implementation of a portable multifunction device (PMD) for controlling unmanned aerial vehicles (UAVs) using new interaction paradigms such as the 'magic wand' interface, multitouch cinematographer, and scripted shots, which allow for indirect and intuitive control through gestures and pre-defined paths, leveraging localization and navigation systems for autonomous image and video capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If direct control of pitch, roll, and yaw is used for UAV piloting, then control precision is improved, but ease of operation deteriorates due to requiring piloting expertise
Solution Approach 1:
The patent introduces an intermediary control system that translates simple user gestures (e.g., pointing with a smartphone) into complex UAV control commands. This mediator layer handles the pitch, roll, and yaw adjustments automatically, allowing users without piloting expertise to control the UAV effectively while maintaining control precision through the intermediary's sophisticated control algorithms.
Solution Approach 2:
The patent replaces traditional mechanical control interfaces (joysticks, throttles) with gesture-based control systems. Users point or gesture with their smartphones, and the system converts these gestures into appropriate flight control signals, eliminating the need for users to understand or manipulate complex mechanical control mechanisms while maintaining precise control capability.
2Measurement precision
If direct control interface is used for UAV piloting, then control accuracy is improved, but device complexity increases due to requiring specialized control systems
Solution Approach 1:
The intermediary control system acts as a bridge between simple user gestures and complex flight control requirements. It consolidates the complexity into a centralized software layer that processes gestures and generates appropriate control signals, reducing the need for complex hardware interfaces while maintaining control accuracy through sophisticated algorithms.
Solution Approach 2:
The patent uses the user's smartphone as a control interface, leveraging an existing device rather than requiring specialized control equipment. The smartphone's camera and sensors are used to detect gestures and translate them into control commands, copying the functionality needed for precise control from the user's familiar device rather than requiring dedicated complex control hardware.
3Ease of operation
If autonomous control with gesture interface is implemented, then ease of operation is improved, but control precision deteriorates for complex maneuvers
Solution Approach 1:
The system incorporates feedback mechanisms where the UAV's actual position and orientation are continuously monitored and compared with the desired position derived from user gestures. The intermediary control system adjusts control signals in real-time based on this feedback, ensuring that even simple gestures result in precise maneuver execution while maintaining ease of operation.
Data Source
AI summary
Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.