Brightfield Image Processing for Noninvasive Pulsation Propagation Analysis

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Current calcium imaging and multi-electrode array methods are invasive, complex, and difficult to use for evaluating pulsation propagation, especially in determining propagation speed and direction, requiring special preparation and equipment.

Innovation Solution

A device and method that uses image processing to noninvasively evaluate pulsation stability by capturing and analyzing motion data from cultured myocardial cells, calculating propagation speed and direction through motion detection and waveform analysis, without the need for special preparation or equipment.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If calcium imaging is used to detect pulsation propagation, then fluorescence emission allows visualization of pulsation, but the operation to fluorescence-stain cells is complicated and discoloration occurs

Engineering Contradiction:
Improvepulsation visualization capabilityVSAvoidfluorescence-staining operation complexity
Core Design Contradiction:
Measurement precisionVSDevice complexity

Solution Approach 1:

The patent extracts and removes the fluorescent staining step from the pulsation detection process. Instead of using calcium fluorescent indicators that require complex staining procedures, the invention uses brightfield imaging to directly observe cell contraction and relaxation, thereby eliminating the complicated fluorescence-staining operation while maintaining pulsation visualization capability

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent replaces the optical fluorescence detection system with a mechanical motion detection approach. By using brightfield imaging to capture cell shape changes during contraction and relaxation, the system substitutes the chemical-fluorescence mechanism with a direct optical-mechanical observation method, simplifying the overall procedure

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

2Measurement precision

If multi-electrode array is used to evaluate pulsation propagation, then potential change detection is achieved, but special culture dish is needed and only cells on electrodes can be evaluated

Engineering Contradiction:
Improvepotential change detection accuracyVSAvoidevaluation coverage of cells
Core Design Contradiction:
Measurement precisionVSAdaptability or versatility

Solution Approach 1:

The patent creates a universal imaging method that can evaluate pulsation propagation in any cell configuration and culture vessel type. The brightfield imaging approach with automated motion detection works with standard culture dishes and can assess all cells in the field of view, not just those on electrodes, making the system adaptable to various experimental setups

Inventive Principle:
Principle #6Universality (Multi-functionality)

Solution Approach 2:

The patent introduces automated image processing algorithms as an intermediary between the raw imaging data and pulsation propagation evaluation. This computational mediator extracts motion information from brightfield images, enabling comprehensive cell evaluation without requiring physical electrodes in contact with cells

Inventive Principle:
Principle #24Intermediary (Mediator)

3Object-affected harmful factors

If conventional image processing is used to observe pulsation propagation, then noninvasive observation is achieved, but propagation speed and propagation direction are difficult to acquire

Engineering Contradiction:
Improvecell invasivenessVSAvoidpropagation speed and direction data
Core Design Contradiction:
Object-affected harmful factorsVSLoss of information

Solution Approach 1:

The patent performs preliminary action by automatically detecting and tracking cell boundary positions in each frame before calculating propagation characteristics. The system pre-processes the image sequences to extract motion vectors and temporal changes, which are then used to compute propagation speed and direction, ensuring this information is captured before any potential cell disturbance

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The patent replaces conventional simple image processing with advanced automated motion analysis algorithms. By implementing sophisticated image processing that tracks cell boundary movements and calculates velocity vectors, the system extracts propagation speed and direction information from noninvasive brightfield images, substituting inadequate processing methods with comprehensive analytical algorithms

Inventive Principle:
Principle #28Mechanics substitution (Replace mechanical system)

Data Source

PatentEP3022714B1Image processing device, method, and program
Publication Date: 2020.06.03 SONY GROUP CORP
  • EP3022714B1 patent drawingFigure 1
  • EP3022714B1 patent drawingFigure 2
  • EP3022714B1 patent drawingFigure 3

AI summary

An image processing device includes processor circuitry configured to detect motion of objects in an observation area on the basis of a captured image, calculate amounts of each detected motion, and calculate at least one of a propagation speed and a propagation direction of the motion for pulsations of the objects.