Machine Learning Model Fine-Tuning via Segmented Transfer Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Fine-tuning entire machine learning models for product image recognition in consumer packaged goods requires significant time and resources, especially when dealing with limited annotated training data and the need for rapid model deployment.

Innovation Solution

A machine learning system that utilizes a subset of a pre-trained model fine-tuned on a smaller dataset from an imagenet database, leveraging transfer learning to recognize new products with reduced computational costs and training time.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the entire machine learning model is fine-tuned on the new dataset, then the model accuracy is improved, but the computational cost and training time increase significantly

Engineering Contradiction:
Improvemodel accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent segments the machine learning model into two distinct parts: a pre-trained base model that retains its original weights, and a new classification layer that is trained on the target dataset. This segmentation allows only the necessary portion (classification layer) to be fine-tuned, significantly reducing training time while maintaining accuracy. The base model's pre-trained features are preserved, and only the task-specific classification parameters are adapted to the new domain.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

Instead of performing full fine-tuning on the entire model (excessive action), the patent applies partial fine-tuning by training only the classification layer (partial action). This approach uses fewer computational resources and less training time than complete fine-tuning would require, while still achieving the necessary adaptation to the target dataset for accurate product recognition.

Inventive Principle:
Principle #16Partial or excessive action

2Adaptability or versatility

If the entire machine learning model is fine-tuned on the new dataset, then the model adapts better to the new data, but the computational resources required increase

Engineering Contradiction:
Improvemodel adaptation to new dataVSAvoidcomputational resources
Core Design Contradiction:
Adaptability or versatilityVSUse of energy by moving object

Solution Approach 1:

The model is divided into a frozen pre-trained segment and a trainable classification segment. This segmentation enables selective adaptation where only the classification layer consumes computational resources during fine-tuning, while the base model remains static. This dramatically reduces the computational burden compared to fine-tuning the entire model, making resource-constrained deployments feasible.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The base model is pre-trained on a large source dataset before being deployed. This preliminary action ensures that the majority of the model already possesses robust feature extraction capabilities, reducing the amount of computational work needed during subsequent fine-tuning on the target dataset. Only the classification layer requires adaptation, minimizing resource usage.

Inventive Principle:
Principle #10Preliminary action

3Productivity

If a pre-trained model is used with transfer learning, then the training time is reduced, but the model requires a pre-trained model which adds initial complexity

Engineering Contradiction:
Improvetraining speedVSAvoidsystem complexity
Core Design Contradiction:
ProductivityVSDevice complexity

Solution Approach 1:

The pre-trained model serves multiple functions: it provides general feature extraction capabilities for diverse image types and serves as the foundation for specific product recognition tasks. This multi-functionality allows the same base model to be reused across different product categories and datasets, reducing overall system complexity despite the initial requirement for a pre-trained model.

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The pre-trained model is prepared in advance through training on a large source dataset, performing the complex feature learning task beforehand. This preliminary action shifts the computational complexity from the deployment phase to the model preparation phase, enabling fast training speeds during actual product recognition tasks while managing complexity through upfront investment.

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS20250021869A1Machine learning based system and method for optimizing training time of a machine learning model
Publication Date: 2025.01.16 PARALLELDOTS INC
  • US20250021869A1 patent drawing
  • US20250021869A1 patent drawing
  • US20250021869A1 patent drawing

AI summary

A machine learning based system for optimizing training time of a machine learning model is disclosed. The machine learning based system configured to: (a) train the machine learning model on second plurality of data associated with second one or more images corresponding to first one or more products, (b) extract third plurality of data associated with third one or more images corresponding to second one or more products from a database, (c) learn to recognize the third one or more images by fine-tuning the machine learning model trained on the second one or more images, using transfer learning method, (d) fine-tune a subset of the machine learning model to recognize third one or more analyzed images, and (e) analyze fourth one or more images corresponding to the second one or more products using the fine-tuned subset of trained machine learning model trained on third one or more recognized images.