Autonomous Microscope System Using Reinforcement Learning for Biological Image Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Conventional automated microscope systems are inadequate for efficiently analyzing large numbers of biological images, leading to increased detection errors and faults, as they lack autonomous capabilities for finding the appropriate field of view and self-learning.

Innovation Solution

An autonomous microscope system utilizing a reinforcement learning scheme with convolutional neural networks to select regions of interest, analyze high magnification images for target features, and generate feedback signals to improve the neural network's training, thereby reducing manual operation errors and enhancing analysis efficiency.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Reliability

If manual detection and analysis methods are used, then flexibility and adaptability are maintained, but detection errors increase and analysis efficiency decreases

Engineering Contradiction:
Improvedetection accuracyVSAvoidanalysis efficiency
Core Design Contradiction:
ReliabilityVSProductivity

Solution Approach 1:

The system enables self-service through autonomous field of view selection and self-learning capabilities. The first neural network automatically identifies and selects optimal fields of view without manual intervention, and the reinforcement learning mechanism allows the system to continuously improve its performance through self-generated feedback from statistical results, thereby maintaining high detection accuracy while improving analysis efficiency

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The patent replaces manual mechanical detection operations with an automated neural network-based system. The first neural network substitutes human operators in selecting fields of view, and the second neural network performs automated analysis of biological samples, eliminating manual errors while maintaining adaptability through learning capabilities

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Productivity

If conventional automated microscope systems with auto focus are used, then analysis speed is improved, but detection errors increase due to lack of autonomous capabilities

Engineering Contradiction:
Improveanalysis speedVSAvoiddetection accuracy
Core Design Contradiction:
ProductivityVSReliability

Solution Approach 1:

The system implements a feedback mechanism where statistical results from the second neural network are fed back to train the first neural network through reinforcement learning. This closed-loop feedback enables the system to continuously improve its field of view selection accuracy while maintaining high analysis speed, resolving the contradiction between speed and accuracy

Inventive Principle:
Principle #23Feedback

Solution Approach 2:

The system dynamically changes operational parameters through learning. The neural networks adjust their internal parameters (weights and biases) based on reinforcement learning feedback, allowing the system to adapt to different biological samples and maintain high detection accuracy across various analysis scenarios while preserving fast analysis speed

Inventive Principle:
Principle #35Parameter changes

3Adaptability or versatility

If manual operation methods are used for analyzing large numbers of images, then adaptability to complex disease detection is maintained, but detection errors increase and faults occur

Engineering Contradiction:
Improvedisease detection capabilityVSAvoiddetection accuracy
Core Design Contradiction:
Adaptability or versatilityVSReliability

Solution Approach 1:

The system performs self-learning through reinforcement learning, where the first neural network continuously improves its field of view selection capability based on feedback from successful and unsuccessful detections. This self-service learning mechanism enables the system to adapt to complex disease detection scenarios while maintaining high detection accuracy, eliminating manual operation errors

Inventive Principle:
Principle #25Self-service

Solution Approach 2:

The system performs preliminary action by pre-selecting optimal fields of view using the trained first neural network before detailed analysis begins. This preliminary selection of relevant fields of view ensures that subsequent analysis focuses on the most diagnostic areas, improving both adaptability to different disease types and detection accuracy

Inventive Principle:
Principle #10Preliminary action

Data Source

PatentUS11287634B2Control method for automated microscope system, microscope system and computer-readable storage medium
Publication Date: 2022.03.29 AETHERAI CO LTD
  • US11287634B2 patent drawing
  • US11287634B2 patent drawing

AI summary

The present disclosure provides a method for controlling autonomous microscope system, microscope system, and computer readable storage medium. Taking the advantage of a neural network trained in a reinforcement learning scheme, the method automatizes the analysis process of biological sample executed by microscope system and therefore improves the diagnosis efficiency.