Semi-supervised Microorganism Classification via Unsupervised Clustering

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for classifying microscopic organisms like plankton are inefficient and require large datasets, making them computationally expensive and impractical due to the large number of plankton species, which limits their effectiveness in real-time classification and anomaly detection.

Innovation Solution

A neural network-based system that classifies microorganisms using unsupervised and supervised learning modules, with an image processor and feature extractor to identify known and unknown species, as well as anomalies, by analyzing morphology and behavior with minimal human supervision, employing algorithms like k-Means and Delta Enhanced Class detectors.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If deep learning is used to classify plankton, then classification accuracy is improved, but computational cost and data requirements increase significantly

Engineering Contradiction:
Improveclassification accuracyVSAvoidcomputational cost
Core Design Contradiction:
Measurement precisionVSUse of energy by stationary object

Solution Approach 1:

The system segments the classification task into two distinct phases: an unsupervised learning phase that discovers natural groupings in the data without labels, and a supervised classification phase that uses these pre-discovered clusters to train more efficient classifiers. This segmentation allows the computationally intensive unsupervised learning to be performed once on raw data, followed by more efficient supervised training on clustered data, thereby reducing overall computational cost while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary unsupervised clustering on the training data before supervised classification. By pre-processing the data to identify natural groups and structures, the subsequent supervised learning operates on already-organized data, reducing the computational burden and data requirements for achieving high classification accuracy.

Inventive Principle:
Principle #10Preliminary action

2Adaptability or versatility

If deep learning is used to classify all plankton species, then classification completeness is improved, but the complexity of training data collection increases

Engineering Contradiction:
Improveclassification completenessVSAvoiddata collection complexity
Core Design Contradiction:
Adaptability or versatilityVSDevice complexity

Solution Approach 1:

The unsupervised learning component performs self-service by automatically discovering clusters and structures in the training data without requiring manual labeling. The system autonomously identifies natural groupings among plankton species, eliminating the need for expert annotators to create comprehensive labeled datasets for all species, thus reducing data collection complexity while maintaining classification completeness.

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The unsupervised clustering module serves multiple functions: it pre-processes data for supervised classification, identifies unknown species clusters, and provides a framework that can adapt to new species without retraining. This multi-functional approach allows the system to handle diverse plankton species with a single unified framework, reducing the complexity of collecting and managing training data for each species individually.

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Use of energy by stationary object

If traditional classification methods are used, then computational resources are saved, but classification speed and real-time performance decrease

Engineering Contradiction:
Improvecomputational resource usageVSAvoidclassification speed
Core Design Contradiction:
Use of energy by stationary objectVSProductivity

Solution Approach 1:

The system segments the classification pipeline into feature extraction, unsupervised clustering, and supervised classification stages. The feature extraction and clustering stages are performed offline or in batch mode using computational resources, while the final classification stage uses the pre-computed cluster assignments for rapid real-time prediction. This segmentation allows heavy computation to be separated from time-critical operations, achieving both resource efficiency and real-time performance.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The system performs preliminary feature extraction and cluster assignment before the actual classification decision. By pre-computing these intermediate representations, the system reduces the computational workload during real-time classification, enabling faster prediction speeds while maintaining accuracy, as the classifier only needs to evaluate pre-processed features against learned models.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11682111B2Semi-supervised classification of microorganism
Publication Date: 2023.06.20 INTERNATIONAL BUSINESS MACHINE CORPORATION
  • US11682111B2 patent drawing
  • US11682111B2 patent drawing
  • US11682111B2 patent drawing

AI summary

A system and method that identify and classify unknown microorganisms and/or known microorganisms with anomalies are provided. The system and method comprise processing images of microorganisms from an aquatic environment; extracting features from the processed images; an unsupervised partitioning algorithm for identifying and classifying known microorganisms in the aquatic environment based upon the extracted features; and a supervised classifier neural network that is trained with the unsupervised partitioning algorithm and identifies and classifies unknown microorganisms and/or known microorganisms with anomalies.