3D Temporal Analysis of 3D-Cultivated Cells Without Laser Damage

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current methods for observing 3D-cultivated cells, such as scan-type microscope systems and image processing, are inadequate for high-speed observation over time and may damage cells due to laser irradiation, limiting the ability to monitor temporal changes without inhibiting physiological states.

Innovation Solution

An analysis system and method that calculates feature amounts and reference positions from moving images captured at different focal positions, allowing for phase alignment and quantitative evaluation of movements without laser irradiation, enabling the analysis of 3-dimensional temporal changes in observation objects.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If a scan-type microscope system is used for 3D recognition, then 3-dimensional recognition of the observation object is achieved, but high-speed observation is difficult and laser irradiation may damage cells

Engineering Contradiction:
Improve3D recognition capabilityVSAvoidobservation speed
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the observation process by capturing multiple still images at different focal positions along the optical axis, then processing these segmented images through image processing to reconstruct 3D information. This avoids the need for continuous laser scanning while achieving 3D recognition.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent creates optical copies of the observation object at different focal planes by capturing multiple still images. These image copies are then processed to generate 3D information, eliminating the need for physical laser scanning of the actual specimen.

Inventive Principle:
Principle #26Copying

2Measurement precision

If a scan-type microscope system is used for 3D recognition, then 3-dimensional recognition of the observation object is achieved, but laser irradiation may damage cells and inhibit physiological states

Engineering Contradiction:
Improve3D recognition capabilityVSAvoidcell damage from laser irradiation
Core Design Contradiction:
Measurement precisionVSObject-affected harmful factors

Solution Approach 1:

The patent uses optical copying by capturing still images at different focal positions and processing these images computationally. This eliminates direct laser irradiation of the living cells while preserving 3D recognition capability through image-based reconstruction.

Inventive Principle:
Principle #26Copying

Solution Approach 2:

The patent replaces the mechanical laser scanning system with an image processing-based approach. Instead of physically scanning laser beams through the specimen, the system captures multiple images and uses computational methods to extract 3D information, thereby eliminating laser-induced cell damage.

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

3Measurement precision

If image processing is used to generate 3D images from still images, then 3D visualization is achieved, but temporal changes over time cannot be observed

Engineering Contradiction:
Improve3D image generation capabilityVSAvoidinability to capture temporal changes
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs preliminary action by capturing multiple still images at different focal positions at specific time points, then processes these images to generate 3D information. This preliminary image capture and processing enables subsequent temporal observation by repeating the process at different time points.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent enables continuous observation of temporal changes by repeatedly performing the image capture and processing sequence at different time points. The useful action of 3D image generation is made continuous through time-series observation, allowing tracking of temporal changes while maintaining 3D visualization capability.

Inventive Principle:
Principle #20Continuity of useful action

Data Source

PatentEP3076219B1Analysis system, analysis program, and analysis method
Publication Date: 2020.04.08 SONY GROUP CORP
  • EP3076219B1 patent drawingFigure 1
  • EP3076219B1 patent drawingFigure 2~3
  • EP3076219B1 patent drawingFigure 4

AI summary

[Object] To provide an analysis system, an analysis program, and an analysis method suited for analyzing a 3-dimensional temporal state of an observation object. [Solving Means] An analysis system according to the present technique includes a feature amount calculation section and a reference position calculation section. The feature amount calculation section calculates a feature amount in each of a plurality of moving images of a sample including an observation object, that have been captured at different focal positions, the plurality of moving images having the same phase of movements. The reference position calculation section calculates a reference position of the observation object in a focus direction based on the feature amount.