Mosquito Image Patch Classification for Sex Detection

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing methods for classifying insects, particularly mosquitoes, using visual attributes are unreliable due to challenges in discriminating between males and females, especially when they cluster together, and classical object detection algorithms struggle with overlapping insects and slender bodies.

Innovation Solution

A computer-implemented system utilizing a predictive model, such as a convolutional neural network (CNN), to locate, classify, and count insects by dividing images into patches, training on labeled data to identify and differentiate between male and female mosquitoes based on anatomical characteristics.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Extent of automation

If classical object detection algorithms are used to classify insects visually, then automation is improved, but measurement precision deteriorates when insects cluster together or have slender bodies with long legs

Engineering Contradiction:
Improveautomation of insect classificationVSAvoiddiscrimination accuracy between male and female insects
Core Design Contradiction:
Extent of automationVSMeasurement precision

Solution Approach 1:

The patent divides the image into multiple patches and processes each patch independently through the neural network. This segmentation approach allows the system to handle individual insects even when they are clustered together, as each patch can be evaluated separately to identify and classify individual insects based on their anatomical features.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent replaces classical object detection algorithms with a deep learning-based neural network system. This substitution enables the system to automatically learn and extract relevant visual features from insect images, achieving high precision in discriminating between male and female insects without relying on hand-crafted features or traditional detection methods.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If machine learning techniques with heuristics are used to classify insects, then productivity is improved, but reliability deteriorates for insect populations with slender bodies and long legs

Engineering Contradiction:
Improveclassification speedVSAvoidclassification accuracy for mosquitoes
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The patent replaces heuristic-based machine learning techniques with a deep convolutional neural network. This substitution allows the system to automatically learn robust feature representations from training data, achieving high reliability in classifying insects with slender bodies and long legs while maintaining high productivity through automated processing.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent employs a training phase where the neural network is pre-trained on labeled insect images before deployment. This preliminary action allows the system to learn the characteristic features of different insect types, including mosquitoes with slender bodies, ensuring high classification reliability when processing actual insect populations.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If visual inspection by humans is used to classify insects, then measurement precision is improved, but productivity deteriorates due to manual inspection requirements

Engineering Contradiction:
Improveclassification accuracyVSAvoidprocessing throughput
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces manual human visual inspection with an automated neural network-based system. This substitution maintains high measurement precision by using the same visual attributes that human inspectors rely on, while dramatically improving productivity through automated image processing and classification without the need for manual intervention.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The patent creates a self-service system where the neural network automatically performs the entire classification process without human intervention. The system takes insect images as input, processes them through the trained model, and outputs classifications, enabling high-throughput automated processing while maintaining accuracy comparable to or exceeding human inspection.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS11151423B2Predictive models for visually classifying insects
Publication Date: 2021.10.19 GOOGLE LLC
  • US11151423B2 patent drawing
  • US11151423B2 patent drawing
  • US11151423B2 patent drawing

AI summary

Insects can be localized and classified using a predictive model. To begin, image data is obtained that corresponds to the insects. Using a predictive model, samples of the image data are evaluated to determine whether the image portions include an insect and, if so, into what category the insect should be classified (e.g., male/female, species A/species B, etc.).