Self-Attention Context Network for Adversarial Robustness in Hyperspectral Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing hyperspectral remote sensing image classification methods based on deep neural networks are vulnerable to adversarial attacks, lacking security and reliability in object recognition tasks.

Innovation Solution

A hyperspectral remote sensing image classification method utilizing a self-attention context network, comprising a backbone network, self-attention module, and context encoding module, which extracts hierarchical features, constructs spatial dependencies, and learns global context features to enhance classification accuracy and resistance to adversarial attacks.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If deep convolutional neural networks are used for hyperspectral remote sensing image classification, then classification accuracy is improved, but vulnerability to adversarial attacks increases

Engineering Contradiction:
Improveclassification accuracyVSAvoidresistance to adversarial attacks
Core Design Contradiction:
Measurement precisionVSReliability

Solution Approach 1:

The network is divided into multiple functional modules including backbone network for feature extraction, self-attention module for spatial dependency modeling, and context encoding module for global context learning. This segmentation allows each module to specialize in specific tasks, improving both accuracy and robustness while reducing vulnerability to adversarial attacks through distributed feature processing

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension of global context features through the context encoding module, which processes spatial relationships and contextual information separately from local features. This additional dimensional processing enhances the model's ability to recognize adversarial patterns and maintain reliability under attack while preserving classification accuracy

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If deep neural networks are applied to hyperspectral remote sensing classification, then object recognition capability is enhanced, but model security deteriorates

Engineering Contradiction:
Improveobject recognition accuracyVSAvoidadversarial attack vulnerability
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The self-attention module performs preliminary spatial dependency analysis and context encoding on input features before final classification. This preliminary processing establishes robust spatial and contextual representations that are resistant to adversarial perturbations, preventing harmful factors from affecting the final recognition outcome

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The context encoding module acts as an intermediary between local feature extraction and global classification decisions. It processes and integrates spatial context information, serving as a buffer that filters out adversarial noise while preserving genuine object characteristics, thereby enhancing both security and recognition capability

Inventive Principle:
Principle #24Intermediary (Mediator)

Data Source

PatentUS11783579B2Hyperspectral remote sensing image classification method based on self-attention context network
Publication Date: 2023.10.10 WUHAN UNIV
  • US11783579B2 patent drawing
  • US11783579B2 patent drawing

AI summary

A hyperspectral remote sensing image classification method based on a self-attention context network is provided. The method constructs a spatial dependency between pixels in a hyperspectral remote sensing image by self-attention learning and context encoding, and learns global context features. For adversarial attacks in the hyperspectral remote sensing data, the proposed method has higher security and reliability to better meet the requirements of safe, reliable, and high-precision object recognition in Earth observation.