Arithmetic Device for Microscope Phase Difference Image Parallax

Resolve Bottlenecks,
Find Innovative Solutions
Generate Solutions

Solution Overview

Problem

The efficiency of acquiring image data of biological body samples is significantly reduced due to the time-consuming process of detecting positions using existing methods, such as shifting the focal point of the optical lens and calculating correlations between stereo camera images, which is labor-intensive and inefficient.

Innovation Solution

An arithmetically operating device and method that acquire phase difference images, set a narrower retrieval range for pixels based on calculated parallaxes, and calculate correlations and parallaxes to enhance the efficiency of image acquisition, reducing the number of arithmetic operations required.

Engineering Contradictions & Design Principles

VSEngineering Contradiction Analysis

1Measurement precision

If the focal point of the optical lens is shifted every predetermined interval to detect positions on the biological body sample, then the positions can be detected, but it takes a lot of time and the efficiency of acquiring image data is remarkably reduced

Engineering Contradiction:
Improveposition detection accuracyVSAvoidimage data acquisition efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the image data into multiple channels (e.g., blue, green, red channels from phase difference images) and processes each channel independently to detect pixel displacements. This segmentation allows parallel processing and reduces the overall time required for position detection while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent performs preliminary action by calculating parallaxes for representative pixels first, then uses these results to determine appropriate retrieval ranges for other pixels. This preliminary calculation provides guidance for subsequent processing, reducing the search space and computational burden while maintaining detection precision.

Inventive Principle:
Principle #10Preliminary action

2Measurement precision

If correlations are calculated between all pixels in a wide retrieval range to detect positions, then position detection can be performed, but the number of arithmetic operations increases and efficiency is reduced

Engineering Contradiction:
Improveposition detection accuracyVSAvoidcorrelation calculation time
Core Design Contradiction:
Measurement precisionVSLoss of time

Solution Approach 1:

The patent applies local quality by setting different retrieval ranges for different pixels based on their parallaxes. Representative pixels use wider retrieval ranges for accurate parallax calculation, while other pixels use narrower retrieval ranges determined by nearby representative pixels. This localized adaptation reduces the total number of arithmetic operations while maintaining detection accuracy.

Inventive Principle:
Principle #3Local quality

Solution Approach 2:

The patent performs preliminary action by calculating parallaxes for representative pixels first, then uses these results to determine appropriate retrieval ranges for other pixels. This preliminary calculation provides guidance for subsequent processing, reducing the search space and computational burden while maintaining detection precision.

Inventive Principle:
Principle #10Preliminary action

3Measurement precision

If a stereo camera method is used to detect positions on the biological body sample, then position detection can be performed, but it still takes a lot of time to obtain correlations and the efficiency is remarkably reduced

Engineering Contradiction:
Improveposition detection accuracyVSAvoidimage data acquisition efficiency
Core Design Contradiction:
Measurement precisionVSProductivity

Solution Approach 1:

The patent segments the image data into multiple channels (e.g., blue, green, red channels from phase difference images) and processes each channel independently to detect pixel displacements. This segmentation allows parallel processing and reduces the overall time required for position detection while maintaining accuracy.

Inventive Principle:
Principle #1Segmentation

Solution Approach 2:

The patent applies local quality by setting different retrieval ranges for different pixels based on their parallaxes. Representative pixels use wider retrieval ranges for accurate parallax calculation, while other pixels use narrower retrieval ranges determined by nearby representative pixels. This localized adaptation reduces the total number of arithmetic operations while maintaining detection accuracy.

Inventive Principle:
Principle #3Local quality

Applied Scientific Principles

This section explains which scientific principles are used to turn an abstract innovation direction into a practical engineering solution.

Function Achieved in This Case

This approach greatly reduces the number of arithmetic operations needed, thereby enhancing the efficiency of acquiring subject images by optimizing the retrieval range settings and correlation calculations.

Implementation Method 1

a focal point of the optical lens is shifted in the optical axis direction of the optical lens every predetermined interval, and the positions on the biological body sample are detected in accordance with contrast of captured images in these focal points

Methodology Applied
Scientific EffectFocusing: Focusing

Implementation Method 2

an image acquiring portion configured to acquire phase difference images of a sample

Methodology Applied
Scientific EffectPhase difference:

Data Source

PatentUS8803965B2Arithmetically operating device, arithmetically operating method, arithmetically operating program, and microscope
Publication Date: 2014.08.12 SONY GROUP CORP
  • US8803965B2 patent drawing
  • US8803965B2 patent drawing
  • US8803965B2 patent drawing

AI summary

An arithmetically operating device is provided and includes: an image acquiring portion configured to acquire phase difference images of a sample; a retrieval range setting portion configured to set a range of pixels each to be made a retrieval object in the other image in the phase difference images for pixels each to be made a representative set in one image in the phase difference images, and pixels other than the pixels each to be made the representative; a correlation calculating portion configured to calculate correlations between the pixels for the one image, and the pixels in the range set for the pixels; and a parallax calculating portion configured to calculate parallaxes for the pixels for the one image in accordance with the correlations thus calculated.