Drone Fall-Trajectory Control Using Image Feedback

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing unmanned aircraft control systems fail to reflect user intentions during failures, leading to uncontrollable falls and potential damage, as they require pre-defined detection targets and lack adaptive control based on real-time user inputs.

Innovation Solution

A control device and method that includes an imaging unit capturing the falling position and surrounding situation, generating a control command for the unmanned aircraft to control its movement based on the captured image, and transmitting this command to the aircraft, allowing the user to influence the aircraft's trajectory during a fall through a composite image displayed on a smartphone.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If self-sustaining control is used for unmanned aircraft during failure, then the control system operates autonomously without external intervention, but the user's intentions and values cannot be reflected in the control decisions

Engineering Contradiction:
Improveautonomous controlVSAvoiduser intention adaptation
Core Design Contradiction:
Extent of automationVSAdaptability or versatility

Solution Approach 1:

The system captures images during the fall, processes them to generate control commands, and feeds these commands back to control the aircraft's movement. This closed-loop feedback mechanism allows the user's visual input to directly influence the aircraft's trajectory, resolving the contradiction between autonomous operation and user intention reflection.

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

Image processing serves as an intermediary between the user's visual observation and the aircraft's control system. The captured images are processed to extract falling position information, which then generates control commands that reflect user intentions while maintaining automated execution, bridging the gap between human intent and machine action.

Inventive Principle:
Principle #24Intermediary (Mediator)

2Measurement precision

If pre-defined detection targets are used, then the control system has clear objectives for detection, but it cannot adapt to different situations and user preferences

Engineering Contradiction:
Improvedetection accuracyVSAvoidsituation adaptability
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The detection target is not fixed but dynamically determined based on the captured images and processing results. The system identifies the falling position in real-time according to the actual situation, allowing the detection objective to adapt flexibly to different scenarios while maintaining precise detection of the relevant position information.

Inventive Principle:
Principle #15Dynamics

3Ease of operation

If the aircraft falls without control intervention, then the fall trajectory is determined solely by physics, but damage may occur to people or objects in the fall range

Engineering Contradiction:
Improvecontrol simplicityVSAvoidcollision damage
Core Design Contradiction:
Ease of operationVSObject-affected harmful factors

Solution Approach 1:

The system captures images and processes them to determine control commands during the fall, enabling preliminary control actions to be taken to adjust the falling trajectory before impact occurs. This allows damage mitigation to be implemented in real-time while maintaining relatively simple operational procedures.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12103663B2Control device, control method, unmanned aircraft, information processing device, and information processing method
Publication Date: 2024.10.01 SONY GROUP CORP
  • US12103663B2 patent drawing
  • US12103663B2 patent drawing
  • US12103663B2 patent drawing

AI summary

The present technology relates to a control device, a control method, an unmanned aircraft, an information processing device, an information processing method, and a program capable of reflecting the user's intentions and reducing damage in the event of a failure in an unmanned aircraft. A control device of a first aspect of the present technology is a device that controls movement of an unmanned aircraft during a fall according to a control command generated for an image showing a falling position, captured by the unmanned aircraft. The present technology can be applied to a device that controls a drone that controls movement so as to shift the falling position when an aircraft fails.