Weakly Supervised Learning for Image Classification

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current image classification methods face challenges due to the scarcity of labeled data, high costs, and inefficiencies in manual curation, especially in fine-grained classification tasks like food classification, which often involve high intra-class variation and occluded or varying viewpoints.

Innovation Solution

The implementation of weakly supervised learning systems that utilize a combination of curated and weakly labeled data to train deep network models, allowing for the augmentation of classification accuracy through the use of pre-trained models, neural network layers for discriminative localization, and spatial pooling to compute cross-entropy loss, thereby reducing the reliance on extensive manual annotation.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual curation is used to label images for training, then classification accuracy can be improved, but cost and time requirements increase significantly

Engineering Contradiction:
Improveclassification accuracyVSAvoiddata curation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary action by using an pre-trained deep network model to generate predictions and confidence scores for unlabeled images before final classification. This preliminary processing identifies high-confidence samples that can be automatically labeled, reducing the need for manual curation while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system implements self-service through weakly supervised learning where the model learns to classify images using automatically generated weak labels from the pre-trained model. The system serves itself by automatically identifying training samples and generating labels without requiring external human annotators for each sample.

Inventive Principle:
Principle #25Self-service

2Measurement precision

If manual curation is used to label images for training, then classification accuracy can be improved, but scalability is limited

Engineering Contradiction:
Improveclassification accuracyVSAvoidscalability
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The system performs preliminary action by using an pre-trained deep network model to generate predictions and confidence scores for unlabeled images before final classification. This preliminary processing identifies high-confidence samples that can be automatically labeled, reducing the need for manual curation while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system changes the parameter of label quality from strict manual annotation to weak supervision using confidence thresholds. By adjusting the confidence threshold parameter, the system can flexibly scale from fully automatic labeling for high-confidence samples to selective manual labeling for borderline cases, enabling scalability across different productivity requirements.

Inventive Principle:
Principle #35Parameter changes

3Measurement precision

If extensive manual annotation is used for fine-grained classification, then classification accuracy can be improved, but cost increases significantly

Engineering Contradiction:
Improvefine-grained classification accuracyVSAvoiddata curation cost
Core Design Contradiction:
Measurement precisionVSLoss of energy

Solution Approach 1:

The system performs preliminary action by using an pre-trained deep network model to generate predictions and confidence scores for unlabeled images before final classification. This preliminary processing identifies high-confidence samples that can be automatically labeled, reducing the need for manual curation while maintaining accuracy.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system introduces an intermediary mechanism through the pre-trained deep network model that acts as a bridge between unlabeled images and final classifications. This intermediary generates weak labels and confidence scores, reducing the need for expensive manual fine-grained annotation while maintaining classification accuracy through its discriminative localization capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

4Productivity

If weakly supervised learning is used to reduce manual annotation, then scalability improves, but classification accuracy may decrease

Engineering Contradiction:
ImprovescalabilityVSAvoidclassification accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The system introduces an intermediary mechanism through the pre-trained deep network model that acts as a bridge between unlabeled images and final classifications. This intermediary generates weak labels and confidence scores, reducing the need for expensive manual fine-grained annotation while maintaining classification accuracy through its discriminative localization capability.

Inventive Principle:
Principle #24Intermediary (Mediator)

Solution Approach 2:

The system replaces the mechanical process of manual annotation with an automated deep learning-based weakly supervised learning system. This substitution uses computational mechanisms (pre-trained models, confidence scoring, threshold-based filtering) to replace human annotators, achieving both scalability and maintained accuracy through intelligent automation rather than brute-force manual labeling.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentUS10824916B2Weakly supervised learning for classifying images
Publication Date: 2020.11.03 SRI INTERNATIONAL
  • US10824916B2 patent drawing
  • US10824916B2 patent drawing
  • US10824916B2 patent drawing

AI summary

Systems and methods for improving the accuracy of a computer system for object identification/classification through the use of weakly supervised learning are provided herein. In some embodiments, the method includes (a) receiving at least one set of curated data, wherein the curated data includes labeled images, (b) using the curated data to train a deep network model for identifying objects within images, wherein the trained deep network model has a first accuracy level for identifying objects, receiving a first target accuracy level for object identification of the deep network model, determining, automatically via the computer system, an amount of weakly labeled data needed to train the deep network model to achieve the first target accuracy level, and augmenting the deep network model using weakly supervised learning and the weakly labeled data to achieve the first target accuracy level for object identification by the deep network model.