Image Processing Apparatus for 3D Information Acquisition
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Scanning microscope systems face challenges in increasing speed and versatility, particularly when observing transparent objects like living cells, due to limitations in auto-focusing techniques and potential damage from laser irradiation, and struggle to accurately quantify movement and thickness changes in real-time.
Innovation Solution
An image processing apparatus that calculates luminance differences between pixels at various focal depths, generating a distribution of these differences to determine the proper focal depth and obtain three-dimensional information of the observation target, using an optical microscope without the need for specialized laser scanning equipment.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If laser scanning is used to obtain three-dimensional information, then measurement capability is improved, but observation speed deteriorates and the risk of damaging the observation target increases
Solution Approach 1:
The patent segments the three-dimensional information acquisition process into multiple two-dimensional images captured at different focal depths. Instead of scanning point-by-point with laser, the system captures entire focal planes simultaneously using a conventional optical microscope, dividing the depth range into discrete focal slices that are later processed to reconstruct 3D information.
Solution Approach 2:
The patent replaces the mechanical laser scanning system with an optical imaging system using conventional microscopes. Instead of using laser light to scan and detect three-dimensional information point-by-point, the system uses broad-spectrum optical imaging to capture multiple focal planes simultaneously, eliminating the speed limitation of sequential scanning.
2Measurement precision
If laser scanning is used to obtain three-dimensional information, then measurement capability is improved, but the harmful effect on the observation target increases
Solution Approach 1:
The patent uses conventional optical microscopes with standard illumination instead of expensive, high-intensity laser systems. The illumination light used is non-damaging and can be continuously applied without harming living cells, replacing the harmful high-energy laser while maintaining the capability to capture multiple focal planes for 3D reconstruction.
Solution Approach 2:
The patent converts the limitation of conventional optical microscopes (inability to directly measure depth) into a benefit by capturing multiple focal planes at different depths and using image processing to extract three-dimensional information. The broad-spectrum light that cannot focus to a tight point is transformed into an advantage by imaging entire focal slices simultaneously.
3Extent of automation
If auto focusing based on image contrast is used, then focusing automation is improved, but applicability to transparent objects deteriorates
Solution Approach 1:
The patent moves the focusing determination from the two-dimensional image contrast domain to the three-dimensional focal depth domain. Instead of relying on contrast variations in a single focal plane, the system captures images across multiple focal depths and determines the focal plane containing the observation target by analyzing the distribution of image features across the depth dimension.
Solution Approach 2:
The patent changes the parameter used for focusing determination from image contrast (which fails for transparent objects) to focal depth position. By capturing images at multiple predetermined focal depths and analyzing which depth plane contains the target object, the system makes focusing applicable to transparent objects that do not produce contrast variations.
4Measurement precision
If multiple images at different focal depths are captured, then three-dimensional information is improved, but the complexity of processing increases
Solution Approach 1:
The patent uses the observation target object itself to determine the focal depth. By analyzing the distribution of image features (such as edges or intensity patterns) across the multiple captured images, the system automatically identifies which focal plane contains the target without requiring external reference objects or complex alignment procedures. The target object's own imaging characteristics serve as the reference for focal depth determination.
Data Source
AI summary
[Object] To provide an image processing apparatus, an image processing program, and an image processing method capable of obtaining three-dimensional information of an observation target object.[Solving Means] An image processing apparatus includes a difference calculation unit and a difference distribution generation unit. The difference calculation unit calculates, for each of pixels that constitute a pickup image in each of a plurality of pickup images taken at different focal depths, a difference of a luminance value from an adjacent pixel. A difference image generation unit generates, on the basis of the difference and the focal depth at which the pickup image including the pixel whose difference is calculated is taken, a distribution of the difference with respect to the focal depth.