Flying Digital Assistant Control via Virtual Camera and Drawn Paths
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Current UAV systems require piloting skills and are prone to crashes due to pilot error, as they necessitate direct control of pitch, roll, yaw, and power.
Innovation Solution
The development of new user interaction paradigms for UAVs, such as the 'virtual camera' and 'drawn path' interfaces, allowing for indirect control using a portable multifunction device, enabling autonomous navigation and image/video capture.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Reliability
If direct control of UAV using joystick and throttle is used, then precise control of pitch, roll, yaw and power is achieved, but piloting expertise is required and crash risk increases
Solution Approach 1:
The patent introduces an intermediary control system that translates simple user gestures (touch inputs on a display) into complex UAV control commands. This intermediary layer handles the complexity of pitch, roll, yaw, and power adjustments automatically, allowing users without piloting expertise to control the UAV safely and effectively.
Solution Approach 2:
The patent replaces traditional mechanical control interfaces (joysticks, throttles, physical switches) with a graphical user interface system. Users interact with visual representations of the UAV and its environment on a display, selecting control options through touch inputs rather than manipulating physical mechanical controls, thereby simplifying operation while maintaining precise control.
2Ease of operation
If indirect control paradigms are used, then ease of operation improves and piloting expertise is reduced, but direct control precision may be compromised
Solution Approach 1:
The system incorporates real-time feedback mechanisms that display the UAV's current state, position, and control options on a graphical interface. This feedback loop allows users to make informed control decisions while maintaining precise control, as the system continuously updates the visual representation based on actual UAV status and user inputs.
Solution Approach 2:
The control system dynamically adjusts its behavior based on the UAV's current state and the user's intentions. The graphical interface adapts to show relevant control options and parameters, and the control algorithms dynamically calculate the appropriate pitch, roll, yaw, and power adjustments to achieve the desired maneuver while maintaining precision.
Data Source
AI summary
Methods and systems are described for new paradigms for user interaction with an unmanned aerial vehicle (referred to as a flying digital assistant or FDA) using a portable multifunction device (PMD) such as smart phone. In some embodiments, a method for synchronizing video and audio is described. The method includes capturing video of a physical environment, receiving first audio of the physical environment captured by a first microphone of a first distributed electronic device, and synchronizing the video of the physical environment with the first audio of the physical environment.