Cryo-EM Grid Navigation Using ML Scoring and Active Learning

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current cryo-EM data collection methods are inefficient due to manual selection of high-magnification targets, limited by software limitations and varying image properties across different grid materials and electron beam doses, leading to low throughput and operator inefficiency.

Innovation Solution

A software pipeline using machine learning models for automated navigation of cryo-EM grids, including square and hole localization, scoring, and on-the-fly learning, to determine high-quality targeting locations without human input, leveraging Gaussian Process regression and neural networks for active learning.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Productivity

If manual selection of targets is used, then operator control and flexibility are maintained, but throughput and operator efficiency significantly decrease

Engineering Contradiction:
ImprovethroughputVSAvoidmanual selection
Core Design Contradiction:
ProductivityVSExtent of automation

Solution Approach 1:

The system enables automated data collection by allowing the software to automatically identify squares and holes, evaluate ice quality, and select collection locations without requiring manual operator intervention at each step, thereby significantly increasing throughput while maintaining quality control through algorithmic evaluation

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces the manual mechanical process of operator selection with an automated software-based system that uses image analysis algorithms to identify and evaluate potential collection locations, substituting human operator actions with computational processes to improve efficiency

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If automated methods are implemented, then throughput and efficiency are improved, but challenges arise from varying image properties across different grid materials and electron beam doses

Engineering Contradiction:
ImprovethroughputVSAvoidimage property variation
Core Design Contradiction:
ProductivityVSAdaptability or versatility

Solution Approach 1:

The system automatically adjusts evaluation parameters and thresholds based on the specific image properties detected, adapting to variations in grid materials and electron beam doses by modifying the criteria used to assess ice quality and particle distribution, thereby maintaining automated operation across diverse experimental conditions

Inventive Principle:
Principle #35Parameter changes

Solution Approach 2:

The software pipeline is designed to handle multiple types of grids and imaging conditions through a unified automated evaluation framework that can process and adapt to various image properties, making the system versatile across different experimental setups while maintaining high throughput

Inventive Principle:
Principle #6Universality (Multi-functionality)

3Measurement precision

If high-magnification data collection is performed, then structural resolution is improved, but the requirement for tens to hundreds of thousands of particle images increases data collection time

Engineering Contradiction:
Improvestructural resolutionVSAvoiddata collection time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The system performs preliminary low-magnification imaging and automated evaluation of squares and holes before high-magnification data collection, pre-identifying suitable collection locations to ensure that time-consuming high-magnification imaging is performed only on promising targets, thereby reducing overall data collection time while maintaining resolution requirements

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The data collection process is segmented into multiple magnification levels with automated transition criteria, allowing the system to quickly screen many locations at low magnification and then focus high-magnification imaging only on selected promising regions, reducing the total time required to collect sufficient particle images for high-resolution structure determination

Inventive Principle:
Principle #1Segmentation

4Extent of automation

If automated software pipeline is used, then human intervention is reduced, but the system must handle low signal-to-noise ratio and variable regions-of-interest

Engineering Contradiction:
Improvehuman interventionVSAvoidsignal-to-noise ratio
Core Design Contradiction:
Extent of automationVSDifficulty of detecting and measuring

Solution Approach 1:

The software pipeline incorporates feedback mechanisms where the automated evaluation of image quality and particle detection results is used to adjust and refine subsequent imaging parameters and selection criteria, allowing the system to adapt to low signal-to-noise conditions and variable regions-of-interest through iterative optimization without human intervention

Inventive Principle:
Principle #23Feedback

Data Source

PatentUS12057289B1Automating cryo-electron microscopy data collection
Publication Date: 2024.08.06 NEW YORK STRUCTURAL BIOLOGY CENT
  • US12057289B1 patent drawing
  • US12057289B1 patent drawing
  • US12057289B1 patent drawing

AI summary

A method of automated control of a microscope in cryogenic electron microscopy (cryo-EM), wherein the microscope is configured to collect high-magnification micrographs of particles suspended in vitreous ice. Such particles are found in grid squares, and a square contains holes from which high-magnification micrographs are imaged. The method is carried out during an active data collection session, leveraging a pipeline that comprises a set of models. The pipeline evaluates a set of collection locations to determine whether to continue collection at a current grid/square or instead at a new grid/square. The evaluation is based on a set of one or more quality scores derived from one or more pretrained models and machine learning-based active learning. Based on the determination, control information is provided to automatically control the microscope to move to a next target for data collection.