Drone Expression Recognition for Controller-Free Aerial Capture

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current drone control methods require extensive practice and are limited in capturing diverse views, either through manual remote control or auto-follow features that restrict the quality and variety of captured images or videos.

Innovation Solution

An aerial system equipped with an optical system and processing system that can recognize a target person, track user expressions, and execute corresponding events without physical interaction with a remote device, allowing for intuitive control through facial recognition, gesture recognition, and voice commands.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of operation

If manual remote control is used, then the drone can be controlled to take photos and videos, but the user requires extensive practice and the quality is limited by the controller's skills

Engineering Contradiction:
Improveease of drone controlVSAvoidtime for practice
Core Design Contradiction:
Ease of operationVSLoss of time

Solution Approach 1:

The drone performs photography and videography operations autonomously by detecting user expressions and gestures through its onboard optical system and processing system, eliminating the need for manual remote control and extensive user practice

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the mechanical remote control system with an expression-based control system that uses optical sensors to detect facial expressions and gestures, converting physical control mechanisms into optical recognition-based control

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Ease of operation

If auto-follow feature is used, then the drone automatically captures pictures and video, but the resulting images are limited to a single view

Engineering Contradiction:
Improveautomatic operationVSAvoidvariety of captured views
Core Design Contradiction:
Ease of operationVSAdaptability or versatility

Solution Approach 1:

The drone dynamically adjusts its capture behavior based on real-time detection of user expressions and gestures, allowing it to capture multiple views and angles by responding to different user signals rather than following a fixed auto-follow pattern

Inventive Principle:
Principle #15Dynamics

Solution Approach 2:

The system uses feedback from optical sensors detecting user facial expressions and gestures to continuously adjust the drone's photography and videography operations, enabling diverse viewing angles based on user response

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS11340606B2System and method for controller-free user drone interaction
Publication Date: 2022.05.24 HANGZHOU ZERO ZERO TECH CO LTD
  • US11340606B2 patent drawing
  • US11340606B2 patent drawing
  • US11340606B2 patent drawing

AI summary

System and method for controlling an aerial system, without physical interaction with a separate remote device, based on sensed user expressions. User expressions may include thought, voice, facial expressions, and/gestures. User expressions may be sensed by sensors associated with the aerial device or a remote device.