Extended Semi-Supervised GAN for Hyperspectral Imagery Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The high dimensionality of hyperspectral imagery (HSI) data poses challenges in analysis, and existing deep learning methods struggle to effectively classify and generate accurate synthetic data, particularly in unsupervised scenarios.

Innovation Solution

An extended semi-supervised learning (ESSL) generative adversarial network (GAN) is introduced, which includes a modified loss function for the generator network and utilizes a conditional vector to improve classification and generate accurate synthetic data by training on both real and synthetic distributions, allowing for better fidelity in classification and faster training stability.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If traditional deep learning methods are used for HSI classification, then the method is simple to implement, but classification accuracy is insufficient due to high dimensionality

Engineering Contradiction:
Improveclassification accuracyVSAvoidnetwork complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The network is segmented into two distinct components: a discriminator network for classification and a generator network for synthetic data generation. This segmentation allows each component to specialize, with the discriminator focusing on accurate classification and the generator on creating realistic synthetic samples, thereby improving overall classification accuracy without overwhelming complexity in a single network

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent introduces a new dimension to the training process by incorporating synthetic data generation alongside real data classification. The generator creates synthetic HSI samples that augment the training dataset, effectively adding a dimensional aspect of data synthesis to the traditional classification approach, which helps the discriminator learn more robust features despite the high dimensionality of HSI data

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

2Measurement precision

If GANs are used for unsupervised classification, then classification performance improves, but training stability deteriorates

Engineering Contradiction:
Improveclassification performanceVSAvoidtraining stability
Core Design Contradiction:
Measurement precisionVSStability of the object's composition

Solution Approach 1:

The patent applies preliminary action by pre-training the discriminator on real HSI data before introducing synthetic data from the generator. This staged approach allows the discriminator to first learn from authentic samples, establishing a stable baseline, and then gradually adapt to synthetic samples, preventing the training instability that typically plagues GAN implementations

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent dynamically adjusts training parameters including the ratio of real to synthetic data, learning rates, and loss function weights during training. These parameter changes are made adaptively to maintain training stability while preserving the performance benefits of unsupervised classification, addressing the instability issue without sacrificing accuracy

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If more training data is used to improve classification, then accuracy improves, but training time increases

Engineering Contradiction:
Improveclassification accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The generator network creates synthetic copies of HSI data that mimic the statistical properties and visual characteristics of real data. These synthetic copies serve as proxies for additional real training samples, allowing the model to learn from augmented data without the time cost of collecting and processing equivalent amounts of real hyperspectral imagery

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The generator is pre-trained to learn the data distribution of real HSI samples before being used to generate synthetic training data. This preliminary training phase allows the generator to quickly produce high-quality synthetic samples that are immediately useful for discrimination training, reducing the overall training time compared to traditional approaches that would require extensive real data collection

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS12135762B1Extended semi-supervised learning generative adversarial network
Publication Date: 2024.11.05 THE GOVERNMENT OF THE UNITED STATES OF AMERICA AS REPRESENTED BY THE SECRETARY DEPARTMENT OF HEALTH & HUMAN SERVICES
  • US12135762B1 patent drawing
  • US12135762B1 patent drawing
  • US12135762B1 patent drawing

AI summary

An extended semi-supervised learning (ESSL) generative adversarial network (GAN) including metrics for evaluating training performance and a method for generating an estimated label vector γ by the extended semi-supervised learning (ESSL) generative adversarial network (GAN) discriminator are described. Embodiments in accordance with the invention improve classification accuracy over convolutional neural networks with improved synthetic imagery.