Integrating 2D and 3D Images for Specimen Observation
Find Innovative SolutionsGenerate Solutions
Solution Overview
Problem
Existing techniques for observing three-dimensionally cultured cells and tissue sections often fail to clearly display all objects present, as two-dimensional and three-dimensional observations are not effectively integrated, leading to unclear visualization of specimens.
Innovation Solution
An image display method and device that obtain multiple two-dimensional images at different focus positions, generate three-dimensional image data, and integrate selected two-dimensional images with three-dimensional images to provide a comprehensive, integrated image display.
Engineering Contradictions & Design Principles
Engineering Contradiction Analysis
1Measurement precision
If a single two-dimensional image is obtained by focusing on one position, then the image at that specific focus position is clear, but other objects at different depths remain unclear
Solution Approach 1:
The specimen is divided into multiple depth layers, with each layer captured as a separate two-dimensional image at its optimal focus position. This segmentation allows each object regardless of depth to be clearly imaged in its own layer, resolving the contradiction between single-point focus clarity and multi-depth visibility
Solution Approach 2:
The solution transitions from two-dimensional imaging to three-dimensional imaging by adding the depth dimension. Multiple two-dimensional images captured at different focus positions are integrated to form a three-dimensional image, enabling simultaneous observation of objects at various depths while maintaining clarity
2Loss of information
If only three-dimensional image data is displayed, then comprehensive spatial information is provided, but detailed surface information and texture are lost
Solution Approach 1:
The patent merges three-dimensional image data with selected two-dimensional images to create an integrated image. The three-dimensional component provides comprehensive spatial information and depth context, while the two-dimensional component preserves surface detail and texture, thus resolving the contradiction between spatial completeness and surface detail
3Loss of information
If multiple two-dimensional images at different focus positions are captured, then all objects in three-dimensional space can be observed, but the complexity of image processing and integration increases
Solution Approach 1:
Instead of processing all captured two-dimensional images, the system extracts and selects only the most appropriate images for integration. This extraction approach reduces processing complexity while maintaining completeness of object observation, as only relevant images need to be integrated rather than all captured images
Data Source
Figure 1
Figure 2
Figure 3
AI summary
An image display method includes the following operations (a) to (e). The (a) is of obtaining a plurality of two-dimensional images by two-dimensionally imaging a specimen, in which a plurality of objects to be observed are present three-dimensionally in the specimen, at a plurality of mutually different focus positions. The (b) is of obtaining image data representing a three-dimensional shape of the specimen. The (c) is of obtaining a three-dimensional image of the specimen based on the image data. The (d) is of obtaining the two-dimensional image selected from the plurality of two-dimensional images or a two-dimensional image generated to be focused on the plurality of objects based on the plurality of two-dimensional images as an integration two-dimensional image. The (e) is of integrating the integration two-dimensional image obtained in the (d) with the three-dimensional image obtained in the (c) and displaying an integrated image on a display unit.