Drone Gesture and Image Control Without a Remote

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing remote device control systems, such as those for drones, rely on dedicated wireless remote control devices that require skill, are prone to interference, and have limitations due to battery power and range, making them cumbersome and unreliable for effective operation.

Innovation Solution

The implementation of multimodal control systems that allow for motion, image, and voice-based control of remote devices, enabling autonomous operation and hands-free use by detecting user movements and voice commands through onboard sensors and cameras, eliminating the need for a dedicated control device.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If a dedicated wireless remote control device is used to control the drone, then the drone can be operated remotely, but the system becomes cumbersome requiring the user to carry both the drone and the remote control device

Engineering Contradiction:
Improveease of useVSAvoidsystem complexity
Core Design Contradiction:
Ease of operationVSDevice complexity

Solution Approach 1:

The patent combines the control device and the drone into a single integrated system. The control device is mounted on the drone itself, eliminating the need for a separate remote control unit. This merging of functions allows the drone to be controlled automatically or through simple gestures without requiring the user to carry and operate a separate controller.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The drone is equipped with onboard sensors, processors, and control mechanisms that enable it to autonomously navigate and perform tasks. The system can detect gestures, process images, and execute commands independently, making the drone self-sufficient and eliminating the need for continuous manual control from a separate device.

Inventive Principle:
Principle #25Self-service

2Reliability

If a dedicated remote control device is used, then control functionality is provided, but the device is subject to interference and battery limitations

Engineering Contradiction:
Improvecontrol reliabilityVSAvoidinterference and power limitations
Core Design Contradiction:
ReliabilityVSObject-affected harmful factors

Solution Approach 1:

The system uses an image capture device and gesture recognition algorithm as intermediaries between the user and the drone control. Instead of relying on traditional radio frequency remote controls that are susceptible to interference, the system captures images or video, detects gestures through image processing, and translates these gestures into control commands, providing a more reliable control mechanism.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The patent replaces the traditional mechanical/electronic remote control system with an optical-based gesture recognition system. By using image capture devices and computer vision algorithms to detect hand gestures or body movements, the system eliminates the need for battery-powered remote controls and radio frequency communication, thereby removing the associated interference and power limitations.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Ease of operation

If traditional remote control devices are used, then basic control is achieved, but skill and practice are required for effective operation

Engineering Contradiction:
Improveease of useVSAvoidoperational difficulty
Core Design Contradiction:
Ease of operationVSDifficulty of detecting and measuring

Solution Approach 1:

The patent replaces complex manual control mechanisms with automatic gesture recognition. Instead of requiring users to learn and operate sophisticated remote controls, the system captures images or video of the user's gestures and automatically interprets them into control commands, making the drone easy to operate without requiring specialized skills or practice.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The drone's control system automatically detects and interprets user gestures without requiring manual input through a remote control interface. The onboard processor analyzes the captured images or video frames, identifies gesture patterns, and executes corresponding commands autonomously, eliminating the need for users to have expertise in operating complex control devices.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11126206B2Motion and image-based control system
Publication Date: 2021.09.21 SNAP INC
  • US11126206B2 patent drawing
  • US11126206B2 patent drawing
  • US11126206B2 patent drawing

AI summary

Systems, devices, media, and methods are presented for detecting and interpreting motion of a device and a remote object to control operations of the device. The systems and methods identify a sensor input within a drone. The sensor input indicates movement of the drone within a three dimensional space. The systems and methods determine one or more movement attributes from the sensor input and, in response to the one or more movement attributes, selects one or more maneuvers corresponding to at least one movement attribute. The system and methods then execute the one or more maneuvers by controlling one or more drone control components to move the drone within the three dimensional space.