Magic Wand UAV Control for Intuitive Autonomous Shot Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current UAV control systems require piloting expertise and are prone to crashes due to pilot error, as they rely on direct control of pitch, roll, and yaw, making them less intuitive and user-friendly for capturing images and video.

Innovation Solution

The implementation of a portable multifunction device (PMD) for controlling unmanned aerial vehicles (UAVs) using new user interaction paradigms such as the 'magic wand' interface, multitouch cinematographer, and scripted shots, which allow for indirect and intuitive control of autonomous UAVs for image and video capture.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If direct control of pitch, roll, and yaw is used for UAV piloting, then control precision is improved, but ease of operation deteriorates due to requiring piloting expertise

Engineering Contradiction:
Improvecontrol precisionVSAvoidease of operation
Core Design Contradiction:
Measurement precisionVSEase of operation

Solution Approach 1:

The patent introduces an autonomous UAV system with a portable multifunction device that acts as an intermediary between the user and the UAV. The PMD captures images and transmits them to the UAV, which then autonomously navigates to capture the desired imagery. This intermediary system eliminates the need for direct piloting while maintaining control precision through automated image-based navigation.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The UAV is equipped with autonomous navigation capabilities that allow it to service itself by automatically processing images from the PMD, calculating flight paths, and executing maneuvers without human intervention. The system includes automated functions for maintaining altitude, avoiding obstacles, and returning to home position, enabling the UAV to perform complex tasks independently.

Inventive Principle:
Principle #25Self-service

2Force

If direct control interfaces like joysticks are used, then control authority is improved, but reliability deteriorates due to pilot error causing crashes

Engineering Contradiction:
Improvecontrol authorityVSAvoidreliability
Core Design Contradiction:
ForceVSReliability

Solution Approach 1:

The autonomous UAV system performs self-monitoring and self-correction functions, including automated obstacle detection, collision avoidance, and emergency landing procedures. The system continuously monitors its own status and environmental conditions, eliminating reliance on human pilot judgment and reducing crashes caused by pilot error.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system implements continuous feedback loops where sensors monitor UAV status, image processing provides visual feedback, and the control system automatically adjusts maneuvers based on real-time conditions. This closed-loop control ensures reliable operation by constantly comparing actual state with desired state and making corrective adjustments.

Inventive Principle:
Principle #23Feedback

3Ease of operation

If autonomous control with indirect interfaces is implemented, then ease of operation is improved, but device complexity increases due to sensors and computer vision systems

Engineering Contradiction:
Improveease of operationVSAvoiddevice complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The portable multifunction device serves multiple functions: it captures reference images, processes computer vision algorithms, communicates with the UAV, and provides user interface control. By consolidating these functions in a single device, the system reduces overall complexity compared to having separate specialized equipment for each function.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent positions the PMD as an intermediary that handles complex image processing and computer vision tasks, allowing the UAV to maintain simpler onboard electronics. The PMD acts as a external brain that processes images and sends simplified navigation commands to the UAV, distributing complexity across the system rather than concentrating it all in the aircraft.

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS20240402702A1Magic Wand Interface And Other User Interaction Paradigms For A Flying Digital Assistant
Publication Date: 2024.12.05 SKYDIO INC
  • US20240402702A1 patent drawing
  • US20240402702A1 patent drawing
  • US20240402702A1 patent drawing

AI summary

Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a magic wand user interaction paradigm is described for intuitive control of an FDA using a PMD. In other embodiments, methods for scripting a shot are described.