Drone Swarm Camera Coordination for Real-Time Moving Object Filming

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems for swarm flight of unmanned aircraft struggle to effectively film moving objects due to overwhelming hardware and software demands, safety requirements, and limitations in maintaining spatial arrangement and camera orientation, especially when objects move beyond the camera's field of view or are large.

Innovation Solution

A system where a swarm control unit coordinates the flight control units and camera alignment means to maintain and adjust the spatial arrangement of aircraft and camera orientations in real time, allowing for the use of commercially available drones and cameras, enabling the capture of cinematic effects like 'spatial flow motion' and 'bullet time' by coordinating camera movements and orientations.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Adaptability or versatility

If the flight paths of individual aircraft and camera orientations are constantly adjusted to film moving objects, then the recording capability of moving objects is improved, but the hardware and software resources of the aircraft and control units are overwhelmed

Engineering Contradiction:
Improverecording capabilityVSAvoidhardware and software resources
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system divides the swarm into multiple groups, with each group assigned to film a specific object. This segmentation allows distributed control where each subgroup independently manages its filming tasks, reducing the computational burden on any single control unit while maintaining overall coordination.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The swarm control unit pre-calculates and distributes flight paths and camera orientations to aircraft before they need to execute them. By preparing control data in advance based on predicted object movements, the system reduces real-time computational demands during actual filming operations.

Inventive Principle:
Principle #10Preliminary action

2Reliability

If safety distances are maintained between filmed objects and other aircraft, then safety requirements are met, but the flexibility in spatial arrangement and filming angles is reduced

Engineering Contradiction:
Improvesafety requirementsVSAvoidspatial arrangement flexibility
Core Design Contradiction:
ReliabilityVSAdaptability or versatility

Solution Approach 1:

The system implements dynamic safety distance adjustment where minimum safe distances are maintained through real-time monitoring and adaptive control. The swarm control unit continuously calculates safe zones and adjusts aircraft positions dynamically, allowing maximum filming flexibility within safety constraints rather than using fixed conservative distances.

Inventive Principle:
Principle #15Dynamics

3Device complexity

If a fixed arrangement of cameras in a camera ring is used, then the system structure is simplified, but objects moving beyond the camera ring or very large objects cannot be filmed

Engineering Contradiction:
Improvesystem structureVSAvoidfilming coverage
Core Design Contradiction:
Device complexityVSAdaptability or versatility

Solution Approach 1:

The camera ring is transformed from a fixed structure to a dynamic formation that can expand, contract, and reconfigure in real time. The swarm control unit adjusts the spatial arrangement of aircraft based on object size and movement, allowing the system to film objects of varying scales and trajectories while maintaining coordinated camera positions for cinematic effects.

Inventive Principle:
Principle #15Dynamics

4Adaptability or versatility

If multiple cameras are coordinated to capture objects from different perspectives, then cinematic effects are improved, but the control coordination complexity increases

Engineering Contradiction:
Improvecinematic effectsVSAvoidcontrol coordination
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The system pre-defines multiple camera coordination patterns for different cinematic effects (such as spatial flow motion and bullet time sequences). These patterns are prepared in advance and selected based on the filming scenario, reducing real-time control complexity while maintaining diverse cinematic capabilities.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The swarm control unit implements feedback mechanisms where camera positions and orientations are continuously monitored and adjusted based on object position and desired cinematic effects. This closed-loop control automates the coordination complexity, allowing sophisticated multi-camera sequences without overwhelming manual control requirements.

Inventive Principle:
Principle #23Feedback

Data Source

PatentEP3630606B1System for controlling unmanned aircraft in a swarm to film a moving object with multiple cameras
Publication Date: 2024.01.10 ARS ELECTRONICA LINZ GMBH & CO KG
  • EP3630606B1 patent drawingFigure 1~2
  • EP3630606B1 patent drawingFigure 3~4

AI summary

A system (1) for controlling at least two unmanned aircraft (10) in a swarm flight, wherein each aircraft (10) has a flight control unit (3) for controlling the flight path of the aircraft (10) and a camera (6) which can be rotated at least on one axis by means of an orientation means (8), wherein at least one swarm control unit (15, 18) for wireless communication with the aircraft (10) is provided in the system (1). The at least one swarm control unit (15, 18) is designed to control the flight control units (3) and the orientation means (8) while at least one moving object (12) which is to be filmed is being recorded, in such a way that a spatial arrangement (13, 22) of the aircraft (10) with respect to the object (12) and the orientation of the optical axis (7) of each camera (6) with respect to the object (12) and/or with respect to the orientation/orientations of the optical axis/axes (7) of the other camera/cameras (6) is essentially maintained, and, if appropriate, adapted essentially in real-time.