CNN Defect Detection for Lyophilized Vials

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current inspection systems for lyophilized protein therapeutics face challenges in accurately detecting defects, particularly due to high false positive rates and the scarcity of defective samples for training machine-learning algorithms, leading to inefficiencies and increased costs.

Innovation Solution

The implementation of a machine-learning inspection system using convolutional neural networks (CNNs) with transfer learning to classify images of lyophilized product vials, enabling high accuracy in defect detection and reducing the need for extensive training data.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If manual inspection is used to detect defects in lyophilized protein therapeutics, then inspectors can identify contaminants and packaging defects, but the process is slow, inconsistent, and prone to human error

Engineering Contradiction:
Improvedefect detection accuracyVSAvoidinspection speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent replaces manual mechanical inspection with an automated optical inspection system that uses machine learning algorithms to analyze images of lyophilized protein therapeutics. The system captures images using optical sensors and processes them through trained neural networks to automatically detect defects, eliminating human involvement in the actual inspection process while maintaining high accuracy and increasing throughput speed.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Solution Approach 2:

The inspection system employs self-learning capabilities through machine learning algorithms that automatically improve their defect detection accuracy by processing and learning from inspection data. The system performs self-calibration and adaptive learning to enhance its inspection capabilities without requiring manual reprogramming or adjustment, enabling it to maintain high productivity while improving measurement precision over time.

Inventive Principle:
Principle #25Self-service

2Productivity

If automated inspection systems are used to increase inspection speed, then productivity improves, but false positive rates increase and detection accuracy decreases

Engineering Contradiction:
Improveinspection speedVSAvoiddefect detection accuracy
Core Design Contradiction:
ProductivityVSMeasurement precision

Solution Approach 1:

The patent applies preliminary action by training machine learning algorithms extensively before deployment using large datasets of labeled defect images. The system performs pre-processing of training data, including augmentation and normalization, to prepare robust models that can accurately distinguish defects from normal variations. This preliminary training phase ensures that when the system operates at high speed during actual inspection, it maintains high detection accuracy with minimal false positives.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The inspection system incorporates feedback mechanisms where detection results are continuously evaluated and used to refine the machine learning models. The system analyzes false positives and false negatives from high-speed inspection operations and uses this feedback to iteratively improve its algorithms, thereby maintaining high productivity while progressively enhancing measurement precision through adaptive learning.

Inventive Principle:
Principle #23Feedback

3Measurement precision

If extensive training data is used to improve machine-learning model accuracy, then defect detection precision improves, but the time and resources required for training increase

Engineering Contradiction:
Improvemodel accuracyVSAvoidtraining time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies preliminary action by curating and preparing high-quality training datasets in advance, including data augmentation techniques to artificially expand the effective training data. The system performs preliminary feature extraction and labeling to create optimized training corpora that maximize model learning efficiency. This preliminary preparation enables the system to achieve high model accuracy with reduced actual training time during deployment.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The inspection system employs partial training strategies where the machine learning model is trained on a carefully selected subset of the most informative training samples rather than processing the entire dataset. The system identifies and prioritizes critical defect patterns and uses targeted training on these representative samples to achieve high accuracy without the computational burden of exhaustive training on all available data.

Inventive Principle:
Principle #16Partial or excessive action

4Measurement precision

If the inspection system is made more complex to improve defect detection capability, then measurement precision improves, but device complexity and cost increase

Engineering Contradiction:
Improvedefect detection accuracyVSAvoidsystem complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent applies segmentation by dividing the inspection system into modular functional components: image capture module, pre-processing module, machine learning inference module, and result analysis module. Each module performs a specific function and can be independently optimized or replaced. This modular architecture enables high detection accuracy through specialized algorithms in each segment while managing overall system complexity through clear separation of concerns and standardized interfaces between modules.

Inventive Principle:
Principle #1Segmentation

Data Source

PatentUS20240020817A1Defect detection in lyophilized drug products with convolutional neural networks
Publication Date: 2024.01.18 GENENTECH INC
  • US20240020817A1 patent drawing
  • US20240020817A1 patent drawing
  • US20240020817A1 patent drawing

AI summary

In one embodiment, a method includes receiving one or more querying images associated with a container of a pharmaceutical product, each of the one or more querying images being based on a particular angle of the container of the pharmaceutical product, calculating one or more confidence scores associated with one or more defect indications, respectively for the container of the pharmaceutical product, by processing the one or more querying images using a target machine-learning model, and determining a defect indication for the container of the pharmaceutical product from the one or more defect indications based on a comparison between the one or more confidence scores and one or more predefined threshold scores, respectively.