Microscope Observation System 3D Cell Tracking

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current observation systems face challenges in automatically locating and tracking observation target objects, such as cells, in a microscope, especially when cells move due to vibrations or are distributed across multiple wells, leading to increased user burden and potential phototoxicity from prolonged observation intervals.

Innovation Solution

An observation system comprising a microscope optical system, image pickup unit, image pickup control unit, detection unit, and observation control unit that automatically detects the three-dimensional position of the target object and adjusts the field-of-view to match it, allowing for efficient and detailed observation without manual searching, and includes features like ultraviolet, visible, and infrared light dispersion, as well as Raman scattering dispersion for comprehensive analysis.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If image processing is performed at intervals of several minutes to several tens of minutes to track cell movement, then cell tracking is achieved, but phototoxicity damages the observation target object

Engineering Contradiction:
Improvecell tracking accuracyVSAvoidphototoxicity
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The system performs preliminary detection of the observation target object's three-dimensional position before detailed observation. The detection unit captures images at multiple focal positions to identify the target's location and depth, then the observation control unit adjusts the field-of-view to match the detected position. This preliminary action eliminates the need for continuous searching during observation intervals, allowing longer intervals without phototoxicity damage while maintaining tracking accuracy.

Inventive Principle:
Principle #10Preliminary action

2Object-affected harmful factors

If observation intervals are extended to reduce phototoxicity, then phototoxicity is reduced, but the observation target object moves out of view

Engineering Contradiction:
ImprovephototoxicityVSAvoidtarget object visibility
Core Design Contradiction:
Object-affected harmful factorsVSReliability

Solution Approach 1:

The system employs feedback through the detection unit that continuously or periodically detects the three-dimensional position of the observation target object. Based on this feedback information, the observation control unit dynamically adjusts the field-of-view range to match the target's current position. This feedback mechanism ensures that even with extended observation intervals, the target object remains within the field-of-view, maintaining reliability while reducing phototoxicity from frequent imaging.

Inventive Principle:
Principle #23Feedback

3Reliability

If manual searching is performed to locate moving target objects, then target objects can be found, but user burden increases

Engineering Contradiction:
Improvetarget object locationVSAvoiduser burden
Core Design Contradiction:
ReliabilityVSEase of operation

Solution Approach 1:

The system implements self-service by automatically detecting the three-dimensional position of the observation target object and autonomously adjusting the field-of-view range to match the target. The detection unit captures images at multiple focal positions, identifies the target's location and depth, and the observation control unit automatically repositions the field-of-view without user intervention. This eliminates manual searching, significantly reducing user burden while maintaining reliable target object location.

Inventive Principle:
Principle #25Self-service

4Measurement precision

If observation is performed at high magnification to achieve detailed imaging, then observation detail is improved, but the field-of-view range becomes too narrow to locate moving targets

Engineering Contradiction:
Improveobservation detailVSAvoidfield-of-view range
Core Design Contradiction:
Measurement precisionVSArea of stationary object

Solution Approach 1:

The system transitions to another dimension by detecting the target object's three-dimensional position, including depth information along the optical axis. The detection unit captures images at multiple focal positions (different depths) to determine the target's vertical position. This three-dimensional detection capability allows the system to locate targets even when using high magnification with narrow horizontal field-of-view, as the depth dimension provides additional search space and the ability to adjust focal position independently of lateral field-of-view constraints.

Inventive Principle:
Principle #17Another dimension (Dimensionality change)

Data Source

PatentUS10890750B2Observation system, observation program, and observation method
Publication Date: 2021.01.12 SONY GROUP CORP
  • US10890750B2 patent drawing
  • US10890750B2 patent drawing
  • US10890750B2 patent drawing

AI summary

An observation system includes a microscope optical system, an image pickup unit, an image pickup control unit, a detection unit, and an observation control unit. The image pickup unit is configured to take an image of a field-of-view range of the microscope optical system. The image pickup control unit is configured to cause the image pickup unit to take images of an observation sample in the field-of-view range at a plurality of focal positions and generate detection images. The detection unit is configured to detect a three-dimensional position of an observation target object in the observation sample from the detection images. The observation control unit is configured to fit the field-of-view range of the microscope optical system to the three-dimensional position.