Microscopy Image Processing for Efficient Time-Lapse Observation

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing image processing techniques for time-lapse microscopy require significant time to observe images obtained over a long period, as they focus on recognizing cells rather than efficiently summarizing changes over time.

Innovation Solution

An image processing device and method that acquire a sequence of images, analyze feature values, calculate an index of change between consecutive images, select images exceeding a threshold, and display these images in a temporal sequence, allowing for efficient observation of significant changes.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Loss of information

If all images in the time-lapse sequence are displayed for observation, then complete information about cell changes over time is preserved, but the observation time becomes excessively long

Engineering Contradiction:
Improveinformation completenessVSAvoidobservation time
Core Design Contradiction:
Loss of informationVSLoss of time

Solution Approach 1:

The patent extracts only the essential information from the complete image sequence by calculating change amounts between consecutive images and selecting only those images where significant changes occur. This extraction process removes redundant information while preserving the key developmental stages of cell changes, thereby reducing observation time without losing critical information.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent introduces a parameter-based selection criterion by calculating change amounts (parameters) between consecutive images and comparing them against threshold values. Images are selected for display based on whether their change parameter exceeds the threshold, transforming the observation process from viewing all images to viewing only those that meet specific parameter criteria, thus efficiently balancing information completeness with time reduction.

Inventive Principle:
Principle #35Parameter changes

2Measurement precision

If image processing focuses on detailed cell recognition and analysis, then measurement precision is improved, but productivity of image review deteriorates

Engineering Contradiction:
Improvecell recognition accuracyVSAvoidimage review efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent extracts and emphasizes only the essential features needed for cell change detection by calculating change amounts between consecutive images. This extraction focuses the analysis on meaningful variations rather than processing all image details, thereby maintaining measurement precision for detecting actual cell changes while improving productivity by reducing the volume of data requiring detailed review.

Inventive Principle:
Principle #2Taking out (Extraction)

Solution Approach 2:

The patent applies partial action by performing detailed image analysis only on selected frames where significant changes occur, rather than analyzing every image in the sequence. The change amount calculation is performed on all images, but full detailed recognition and review is applied only to those exceeding the threshold, thus achieving high measurement precision where needed while improving overall review efficiency.

Inventive Principle:
Principle #16Partial or excessive action

Data Source

PatentUS10330912B2Image processing device and image processing method
Publication Date: 2019.06.25 SONY GROUP CORP
  • US10330912B2 patent drawing
  • US10330912B2 patent drawing
  • US10330912B2 patent drawing

AI summary

An image processing device and image processing method are provided. A device for controlling display of a sequence of images of living objects obtained through microscopy may comprise a processor and a storage unit. The storage unit may store a program which, when executed by the processor, causes the processor to perform acts. The acts may include acquiring a first sequence of first images of living objects obtained through microscopy. The acts may further include extracting a second sequence of second images from the first sequence of first images, wherein a number of second images in the second sequence is less than a number of first images in the first sequence. The acts may further include controlling a display device to display the second sequence of second images.