Microscope Image Processing for Seamless Mosaic Boundaries

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

Existing microscope systems generate images with conspicuous boundaries between captured and uncaptured regions when partial images are pasted together, especially when white balance adjustment and shading are not adequately performed during fluorescence observation.

Innovation Solution

A microscope-image processing apparatus and method that generates a combined image by setting the pixel values of uncaptured regions based on the pixel values of rows of pixels at the edge portions of the captured-region image, making these regions similar to the background color, thereby making boundaries inconspicuous.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Area of stationary object

If partial images are pasted together to generate a combined image, then the coverage of the sample area is improved, but conspicuous boundaries appear between captured and uncaptured regions

Engineering Contradiction:
Improvecoverage of sample areaVSAvoidconspicuous boundaries between captured and uncaptured regions
Core Design Contradiction:
Area of stationary objectVSObject-generated harmful factors

Solution Approach 1:

The patent changes the color (pixel values) of the uncaptured region to match the background color of the captured region. Specifically, it extracts the background color from the captured images and applies it to the uncaptured region, making the boundary inconspicuous. This directly addresses the harmful effect of conspicuous boundaries while maintaining the benefit of extended sample area coverage.

Inventive Principle:
Principle #32Color changes

Solution Approach 2:

The patent creates homogeneity between the captured and uncaptured regions by making their colors similar. It calculates the average color of the background portions in captured images and applies this uniform color to the uncaptured region, ensuring visual consistency across the entire combined image. This eliminates the harsh contrast at boundaries while preserving the mosaic structure for area expansion.

Inventive Principle:
Principle #33Homogeneity

2Measurement precision

If white balance adjustment and shading correction are performed during fluorescence observation, then image quality is improved, but processing time and complexity increase

Engineering Contradiction:
Improveimage qualityVSAvoidprocessing time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent performs white balance adjustment and shading correction in advance during the image acquisition phase, rather than as post-processing steps. By correcting these issues when the images are first captured, it eliminates the need for time-consuming post-processing operations while maintaining high image quality. This preliminary action resolves the contradiction by improving image quality without adding processing time.

Inventive Principle:
Principle #10Preliminary action

Solution Approach 2:

The system performs self-correction by automatically adjusting white balance and shading during the fluorescence observation process itself. The microscope system handles these corrections inherently during image capture, making the processing efficient and eliminating the need for separate, time-consuming correction steps while ensuring high image quality.

Inventive Principle:
Principle #25Self-service

Data Source

PatentUS10386624B2Microscope-image processing apparatus, microscope-image processing method, and microscope-image processing program
Publication Date: 2019.08.20 EVIDENT CORP
  • US10386624B2 patent drawing
  • US10386624B2 patent drawing
  • US10386624B2 patent drawing

AI summary

A microscope-image processing apparatus including: a processor including hardware, wherein the processor is configured to implement: a captured-region-image generating portion configured to generate a captured-region image by pasting together a plurality of partial images acquired by using a microscope while changing a viewing field with respect to a sample; an uncaptured-region-color setting portion configured to set pixel values of an uncaptured region based on pixel values of rows of pixels at at least one side of the partial images that are positioned at edge portions of the captured-region image generated by the captured-region-image generating portion; and an image combining portion configured to generate a combined image by combining the captured-region image generated by the captured-region-image generating portion and an uncaptured-region image that has the pixel values set by the uncaptured-region-color setting portion.