Digital Visual Observer With Multi-Camera Airspace Tracking for UAVs

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current UAV operations often require a human visual observer to be present, which can be impractical, especially for autonomous or beyond visual line of sight (BVLOS) flights, due to regulatory requirements such as Part 107, and existing systems lack the capability to effectively detect and avoid objects in airspace without a direct visual line of sight.

Innovation Solution

The implementation of a digital visual observation system using observer devices equipped with high-resolution cameras, movable cameras on gimbals, ADS-B technology, and additional sensors like radar and lidar, which can detect and track objects in the airspace, communicate with each other and with UAVs, and transmit data to operators for real-time monitoring and control.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If a human visual observer is required to be present for UAV operations, then safety and regulatory compliance are improved, but operational flexibility and ease of operation deteriorate

Engineering Contradiction:
ImprovesafetyVSAvoidoperational flexibility
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent creates a digital copy of the visual observer function using electronic sensors, cameras, and detection systems mounted on the UAV. This digital observer system captures and transmits visual data remotely, replacing the need for a physical human observer while maintaining safety monitoring capabilities. The system copies the essential function of visual observation through technological means rather than human presence.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent substitutes the mechanical system of human visual observation with an electronic detection system. Sensors, cameras, and electronic displays replace the human eye and brain processing. The mechanical presence of a human observer is replaced by electronic signal transmission and digital image processing, enabling remote monitoring without physical proximity requirements.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Difficulty of detecting and measuring

If a human visual observer is required to maintain direct visual line of sight, then collision detection capability is improved, but device complexity and loss of time increase

Engineering Contradiction:
Improvecollision detection capabilityVSAvoidsystem complexity
Core Design Contradiction:
Difficulty of detecting and measuringVSDevice complexity

Solution Approach 1:

The patent implements a multi-functional detection system that performs multiple tasks simultaneously. The same sensor array and camera system used for visual observation also detect collisions, monitor airspace, track objects, and provide navigational data. This universal detection system replaces multiple specialized systems, reducing overall complexity while enhancing collision detection capability through integrated sensing.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces an intermediary electronic system between the UAV and the operator. Detection sensors and cameras act as intermediaries that capture environmental data and transmit it to remote operators or autonomous control systems. This intermediary layer enables collision detection without requiring direct human visual contact, reducing system complexity by automating the detection-transmission-response chain.

Inventive Principle:
Principle #24Intermediary (Mediator)

3Productivity

If autonomous operation without visual observer is implemented, then productivity and operational flexibility are improved, but reliability and safety may deteriorate

Engineering Contradiction:
Improveoperational efficiencyVSAvoidsafety
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent enables the UAV to perform self-monitoring and self-detection functions through onboard sensors and detection systems. The system independently captures visual data, processes spatial information, and identifies potential hazards without continuous human intervention. This self-service capability maintains safety while enabling autonomous operation, as the UAV monitors its own environment and can respond to detected threats autonomously.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent implements continuous feedback loops where detection sensors constantly monitor the environment and transmit data to control systems. Real-time feedback from cameras, sensors, and detection arrays enables autonomous safety responses. The system receives ongoing environmental feedback, processes it through algorithms, and adjusts flight operations accordingly, maintaining safety through automated feedback-driven control rather than human observation.

Inventive Principle:
Principle #23Feedback

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

Enables safe and regulatory-compliant UAV operations beyond visual line of sight by providing comprehensive airspace monitoring, detecting and avoiding objects, and allowing for autonomous operation without a human visual observer, enhancing safety and operational flexibility.

Implementation Method 1

additional sensors like radar and lidar

Methodology Applied
Scientific EffectRadar: Radar

Implementation Method 2

radar sensor emits electromagnetic waves

Methodology Applied
Scientific EffectElectromagnetic radiation: Electromagnetic Induction

Implementation Method 3

additional sensors like radar and lidar

Methodology Applied
Scientific EffectLIDAR: LIDAR

Implementation Method 4

lidar sensor emits laser beams

Methodology Applied
Scientific EffectLaser: Laser

Data Source

PatentUS11827352B2Visual observer for unmanned aerial vehicles
Publication Date: 2023.11.28 SKYDIO INC
  • US11827352B2 patent drawing
  • US11827352B2 patent drawing
  • US11827352B2 patent drawing

AI summary

In some examples, a device may receive, from a first camera, a plurality of images of an airspace corresponding to an area of operation of an unmanned aerial vehicle (UAV). The device may detect, based on the plurality of images from the first camera, a candidate object approaching or within the airspace. Based on detecting the candidate object, the device may control a second camera to direct a field of view of the second camera toward the candidate object. Further, based on images from the second camera captured at a first location and images from at least one other camera captured at a second location, the candidate object may be determined to be an object of interest. In addition, at least one action may be taken based on determining that the candidate object is the object of interest.