Multimodal Neural Network for Dust Identification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current dust weather identification methods using satellite remote sensing and threshold-based spectral characteristics are inaccurate due to uncertainties in threshold determination and inability to differentiate between varying surface features, leading to poor practical utility.

Innovation Solution

A multimodal neural network method that integrates satellite data, MODIS inversion data, ground observation data, and other sources, utilizing a backbone network, output network, and fusion network for precise dust identification, including preprocessing, training, and inference steps.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Ease of manufacture

If threshold-based spectral characteristics are used for dust identification, then the method is simple to implement, but the accuracy deteriorates due to uncertainties in threshold determination and inability to differentiate between varying surface features

Engineering Contradiction:
Improvesimplicity of method implementationVSAvoiddust identification accuracy
Core Design Contradiction:
Ease of manufactureVSMeasurement precision

Solution Approach 1:

The patent replaces the traditional mechanical threshold-based comparison system with a neural network-based intelligent recognition system. The neural network automatically learns optimal decision boundaries from training data, eliminating the need for manual threshold calibration and enabling accurate differentiation between dust and similar surface features through pattern recognition rather than fixed thresholds.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent transforms the static threshold parameter into a dynamic neural network model that adapts to different conditions. The neural network adjusts its internal parameters during training to optimize dust identification performance across varying surface features and environmental conditions, replacing the fixed threshold approach with a flexible, learnable parameter system.

Inventive Principle:
Principle #35Parameter changes

2Device complexity

If traditional satellite remote sensing data is used alone, then the data source is simple, but the identification continuity deteriorates due to cloud coverage and data gaps

Engineering Contradiction:
Improvedata source complexityVSAvoiddust identification continuity
Core Design Contradiction:
Device complexityVSDuration of action of stationary object

Solution Approach 1:

The patent merges multiple data sources including satellite remote sensing data, MODIS inversion data, and ground observation data into a unified neural network framework. This integration allows the system to compensate for cloud coverage and data gaps by cross-referencing multiple sources, thereby maintaining continuous dust identification capability while increasing overall system robustness.

Inventive Principle:
Principle #5Merging (Combining)

Solution Approach 2:

The patent creates a multi-functional data processing system that handles multiple types of data (satellite images, inversion data, ground observations) through a single neural network architecture. This universal approach enables the system to process diverse data formats and maintain continuous operation by leveraging the strengths of each data source to fill gaps in others.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If a multimodal neural network integrating multi-source data is used, then the dust identification accuracy is significantly improved, but the device complexity increases

Engineering Contradiction:
Improvedust identification accuracyVSAvoidmodel structure complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent segments the complex neural network into distinct functional modules: a backbone network for feature extraction, a fusion network for integrating multi-source data, and an output network for classification. This modular segmentation reduces overall complexity by making each component more manageable and easier to optimize independently while maintaining high accuracy through their coordinated interaction.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240402013A1Method and device for dust identification utilizing multimodal neural network, and storage device
Publication Date: 2024.12.05 LANZHOU UNIV
  • US20240402013A1 patent drawing
  • US20240402013A1 patent drawing

AI summary

A method for dust identification includes following steps: collecting multi-source data related to dust; preprocessing the multi-source data to obtain processed data; constructing a training set for a dust identification model using the processed data; constructing the dust identification model, where the dust identification model includes a backbone network, an output network, and a fusion network; training the dust identification model based on the training set to obtain a final model; and identifying dust based on the final model. The dust identification method significantly improves a speed and accuracy of dust identification, and also partially improves continuity of the dust identification.