Drone Sensor Data Fusion in a 3D Virtual Map

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current systems lack an efficient method to integrate and visualize sensor data from drones in real-time across large areas, particularly in emergency and disaster scenarios, where rapid data collection and analysis are crucial.

Innovation Solution

A system that utilizes 3-D visualization software to create a virtual environment, where geometry data of the real-world landscape is used to project sensor data from drones onto a map, allowing for real-time fusion and display of information collected by multiple drones, enabling systematic navigation and visualization of large areas.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If sensor data from multiple drones is collected and integrated in real-time, then data collection efficiency and coverage area are improved, but system complexity and computational requirements increase

Engineering Contradiction:
Improvedata collection efficiencyVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The patent introduces a server as an intermediary component that receives sensor data from multiple drones, performs fusion processing, and generates integrated visualizations. This mediator architecture allows drones to operate independently while the server handles the complex integration tasks, resolving the contradiction between improved data collection efficiency and increased system complexity by centralizing computational requirements.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system creates virtual copies of the physical environment by generating three-dimensional visualizations and digital twins of the area being monitored. These virtual representations allow complex sensor data from multiple drones to be integrated and displayed in an simplified visual format, improving data collection efficiency while presenting the processed information in a manageable form that reduces perceived system complexity.

Inventive Principle:
Principle #26Copying

2Loss of information

If real-time sensor data fusion is performed across large areas, then visualization comprehensiveness is improved, but processing time and computational resources increase

Engineering Contradiction:
Improvevisualization comprehensivenessVSAvoidprocessing time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent divides the large monitoring area into multiple zones or regions, with each drone responsible for collecting data from a specific segment. The server then integrates these segmented data sets to create a comprehensive whole. This segmentation approach allows real-time processing of large areas by breaking down the computational task into manageable pieces, maintaining visualization comprehensiveness while reducing overall processing time through parallel processing.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary actions by pre-processing sensor data as it is received from drones, including calibration, filtering, and initial integration, before generating the final three-dimensional visualization. This preliminary processing reduces the computational burden during real-time display operations, enabling comprehensive visualization of large areas while minimizing additional processing time delays.

Inventive Principle:
Principle #10Preliminary action

3Reliability

If multiple sensors and drones are coordinated, then data accuracy and reliability are improved, but coordination complexity and operational difficulty increase

Engineering Contradiction:
Improvedata accuracyVSAvoidcoordination difficulty
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The patent implements a universal server platform that can interface with multiple types of sensors and drones through standardized protocols. This multi-functional system handles diverse data sources uniformly, improving data accuracy through integrated processing while simplifying coordination by providing a single point of control that manages all sensors and drones regardless of their specific types or capabilities.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Data Source

PatentUS20240142978A1Systems and Methods for Fusing Sensor Data from Drones in a Virtual Environment
Publication Date: 2024.05.02 TEMPEST DRONEWORX INC
  • US20240142978A1 patent drawing
  • US20240142978A1 patent drawing
  • US20240142978A1 patent drawing

AI summary

Systems and methods for fusing sensor data from drones in a virtual environment are described In one embodiment, a method for fusing sensor data from drones in a virtual environment includes obtaining geometry data describing a real-world landscape, drawing a map within a virtual environment using a 3-D visualization software and the geometry data, placing a plurality of projectors on the map within the virtual environment corresponding to sensors in the region of the real-world landscape, receiving sensor data and location data from the sensors; and projecting the sensor data onto the map at locations indicated by the location data using the projectors corresponding to the sensors that the sensor data is received from.