Light field microscope-based image acquisition method and apparatus

The method enhances light field microscopy by rotating a disk with microlenses to generate high-resolution three-dimensional images without increasing lens count or reducing sensor size, addressing distortion and resolution issues in conventional methods.

JP7849080B2Active Publication Date: 2026-04-21QUVIT BIO INC
View PDF 6 Cites 0 Cited by

Patent Information

Authority / Receiving Office
JP · JP
Patent Type
Patents
Current Assignee / Owner
QUVIT BIO INC
Filing Date
2022-06-14
Publication Date
2026-04-21

AI Technical Summary

Technical Problem

Conventional fluorescence microscopes capture two-dimensional images, which require multiple shots to reconstruct three-dimensional images, risking distortion due to sample movement and having lower spatial resolution than normal microscopes, especially in light field microscopes with lens arrays.

Method used

A method to acquire three-dimensional images with high spatial resolution by rotating a disk with microlenses, generating a group of lenslet images, superimposing them to form a virtual lenslet image, and converting it into a sub-aperture image, then into a focal stack image, without increasing the number of microlenses or reducing image sensor size.

Benefits of technology

Enables high-resolution three-dimensional imaging of moving samples like muscle cells, reducing manufacturing costs and improving image acquisition speed and accuracy.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 0007849080000047
    Figure 0007849080000047
  • Figure 0007849080000048
    Figure 0007849080000048
  • Figure 0007849080000049
    Figure 0007849080000049
Patent Text Reader

Abstract

The present invention is characterized by including a lenslet synthesis processing unit that acquires a virtual lenslet image using a group of multiple lenslet images, a subaperture image conversion unit that converts the virtual lenslet image generated by the lenslet synthesis processing unit into a subaperture image, and a 3D conversion unit that converts the subaperture image generated by the subaperture image conversion unit into a focal stack image.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present invention relates to a light field microscope-based image acquisition method and apparatus that enables changes in a sample to be acquired as a three-dimensional image having high spatial resolution.

Background Art

[0002] Conventional fluorescence microscopes capture two-dimensional planar images of samples. Therefore, in order to confirm the distribution of fluorescence in three-dimensional space, a plurality of slice images are captured in the z-axis direction and then combined and reconstructed three-dimensionally.

[0003] That is, conventionally, a three-dimensional image has been obtained by precisely adjusting the focal distance of the z-axis and combining the images captured at each depth.

[0004] However, in the above-described method, since multiple shots are taken while changing the position of the z-axis, there is a risk of distortion due to changes in the fluorescence of the sample during the shooting time. In the case of moving cell aggregates (muscle cells), it is difficult to confirm three-dimensional information regarding the movement, and thus it is very difficult to obtain an overall image of the same time zone.

[0005] A light field microscope has been devised to solve such problems.

[0006] A light field microscope has an optical structure in which a lens array is added to the structure of a conventional fluorescence microscope, and it is possible to convert an image obtained from the optical structure into a three-dimensional image by a restoration method.

[0007] However, although a conventional light field microscope has the advantage of being able to acquire three-dimensional image information even in a single shot, since the spatial resolution depends on the number of lenses in the lens array, it has the disadvantage of having a lower spatial resolution than a normal microscope.

[0008] In other words, light field microscopes have the problem of significantly reduced resolution due to the gaps between the multiple lenses that make up the lens array.

[0009] Therefore, a method has been proposed to reduce the size of the lenses that make up the lens array, but this presents the problem that the pixel area of ​​the image sensor must also be reduced. For reference, the pixel area of ​​the image sensor affects the sensitivity of the acquired image, so it is important to maintain a large pixel size in order to apply it to fluorescence imaging, which requires high sensitivity.

[0010] Therefore, the applicant has proposed the present invention in order to solve the above-mentioned problems, and a relevant prior art document is Korean Registered Patent No. 10-2253320, "Method for displaying a three-dimensional image in an integrated image microscope system and an integrated image microscope system realizing the same." [Overview of the project] [Problems that the invention aims to solve]

[0011] The present invention was made to solve the aforementioned problems, and its objective is to provide a light field microscope-based image acquisition method and apparatus configured to acquire images with high spatial resolution without increasing the number of microlenses by reducing the size of the microlenses constituting the lens array. [Means for solving the problem]

[0012] To achieve the above objective, the present invention may include: a lenslet synthesis processing unit that acquires a virtual lenslet image using a group of multiple lenslet images; a sub-aperture image conversion unit that converts the virtual lenslet image generated by the lenslet synthesis processing unit into a sub-aperture image; and a three-dimensional conversion unit that converts the sub-aperture image generated by the sub-aperture image conversion unit into a focal stack image.

[0013] Furthermore, the multiple lenslet image group can be generated by acquiring information from multiple image frames via microlenses whose arrangement positions are changed according to time within a set image sensor area.

[0014] Furthermore, the multiple lenslet image group can be acquired by rotating a disk on which multiple microlenses are arranged for a set period of time.

[0015] Furthermore, the lenslet synthesis processing unit can superimpose multiple image frames that constitute a group of multiple lenslet images to understand the arrangement relationship of microlenses for each image.

[0016] Furthermore, the sub-aperture image conversion unit can search for pixels in the virtual lenslet image that correspond to the coordinates of the microlenses and map them to the coordinate positions of the sub-aperture image to be converted.

[0017] Furthermore, the sub-aperture image conversion unit generates pixel values ​​of a virtual lenslet image using the following formula 1,

number

[0018] Further, the three-dimensional conversion unit converts the sub-aperture image into a focal stack image having three-dimensional information on the x-axis, y-axis, and z-axis, and at the x-axis and y-axis positions of the focal stack image, two-dimensional image information at the corresponding z-axis coordinate points can be included.

[0019] Further, the three-dimensional conversion unit converts the sub-aperture image into a focal stack image using the following Mathematical Formulas 2 and 3.

Number

Number

[0020] Further, the disk can be connected to an actuator or a motor that provides power in the rotational direction or the linear direction.

[0021] Further, the linear movement range of the disk is characterized by being from 0 to 500 mm.

[0022] Further, it can include a first step of acquiring a multi-lenslet image group, a second step of acquiring a virtual lenslet image using the multi-lenslet image group acquired in the first step, a third step of converting the virtual lenslet image acquired in the second step into a sub-aperture image, and a fourth step of converting the sub-aperture image converted in the third step into a focal stack image.

Advantages of the Invention

[0023] The light field microscope-based image acquisition method and apparatus according to the present invention provides a configuration that can acquire a group of multiple lenslet images by rotating and linearly moving a disk on which microlenses are arranged, and generate a three-dimensional image using the group of multiple lenslet images, thereby enabling the acquisition of three-dimensional images with higher spatial resolution than conventional light field microscopes.

[0024] Furthermore, the light field microscope-based image acquisition method and apparatus according to the present invention enable the acquisition of three-dimensional image information of measurement samples (such as muscle cells) that exhibit movement, more quickly and accurately than conventional methods.

[0025] Furthermore, the light field microscope-based image acquisition method and apparatus according to the present invention can acquire images with high spatial resolution by preventing the phenomenon of reduced spatial resolution due to the gap between microlenses by changing the arrangement of microlenses through the rotation of the disk.

[0026] Furthermore, the light field microscope-based image acquisition method and apparatus according to the present invention can acquire images with high spatial resolution without increasing the number of microlenses arranged on the disk or reducing the size of the image sensor, by reducing the size of the microlenses. This reduces the manufacturing cost of the apparatus and significantly reduces the cost of image acquisition. [Brief explanation of the drawing]

[0027] [Figure 1] This is a block diagram showing the configuration of a light field microscope-based image acquisition system according to one embodiment of the present invention.

[0028] [Figure 2] This diagram schematically shows the configuration of a light field microscope to which an image acquisition device according to one embodiment of the present invention is applied.

[0029] [Figure 3] This figure shows the path of light from a disk according to one embodiment of the present invention until it reaches an image sensor.

[0030] [Figure 4] This diagram shows a method for acquiring multiple images within a unit of time by rotating a disk on which multiple microlenses are arranged for a unit of time.

[0031] [Figure 5] This figure shows how a group of multiple lenslet images is converted into a virtual lenslet image by the lenslet synthesis processing unit.

[0032] [Figure 6] This diagram illustrates in detail the process by which a set of multiple lenslet images is converted into a virtual lenslet image.

[0033] [Figure 7] This diagram shows a method for generating pixel values ​​using a virtual lenslet image.

[0034] [Figure 8] This figure shows the processing process of the sub-aperture image conversion unit according to one embodiment of the present invention.

[0035] [Figure 9] This diagram shows the processing steps of the 3D transformation unit that takes a sub-aperture image as input.

[0036] [Figure 10] This diagram shows various arrangement patterns of microlenses provided on a disk.

[0037] [Figure 11] This is a flowchart of a light-field microscope-based image acquisition method according to one embodiment of the present invention. [Modes for carrying out the invention]

[0038] The advantages and features of the present invention, as well as methods for achieving them, should become clear upon closer examination of the embodiments described below in conjunction with the accompanying drawings.

[0039] However, the present invention is not limited to the embodiments disclosed below, but can be realized in a variety of different forms, and these embodiments are merely provided to complete the disclosure of the present invention and to fully inform those who are ordinary skill in the art to which the present invention pertains, and the present invention is defined solely by the scope of the claims.

[0040] Hereinafter, with reference to Figures 1 to 11, a light-field microscope-based image acquisition method and apparatus according to one embodiment of the present invention will be described in detail. In describing the present invention, specific descriptions of related known functions or configurations will be omitted in order to avoid obscuring the essence of the present invention.

[0041] Figure 1 is a block diagram showing the configuration of a light field microscope-based image acquisition device according to one embodiment of the present invention; Figure 2 is a schematic diagram showing the configuration of a light field microscope to which the image acquisition device according to one embodiment of the present invention is applied; Figure 3 is a diagram showing the path of light from light passing through a disk to reaching an image sensor according to one embodiment of the present invention; Figure 4 is a diagram showing a method for acquiring multiple images within a unit time by rotating a disk on which multiple microlenses are arranged for a unit time; Figure 5 is a diagram showing how a group of multiple lenslet images is converted into a virtual lenslet image by a lenslet synthesis processing unit; Figure 6 is a diagram showing in detail the process by which a group of multiple lenslet images is converted into a virtual lenslet image; Figure 7 is a diagram showing a method for generating pixel values ​​with a virtual lenslet image; Figure 8 is a diagram showing the processing process of a sub-aperture image conversion unit according to one embodiment of the present invention; Figure 9 is a diagram showing the processing process of a 3D conversion unit that takes a sub-aperture image as input; Figure 10 is a diagram showing various arrangement patterns of microlenses provided on a disk; and Figure 11 is a flowchart of a light field microscope-based image acquisition method according to one embodiment of the present invention.

[0042] As shown in Figures 1 and 2, a light field microscope-based image acquisition device 100 according to one embodiment of the present invention may include: a lenslet synthesis processing unit 200 that acquires a virtual lenslet image using a multiple lenslet image group 10; a sub-aperture image conversion unit 300 that converts the virtual lenslet image generated by the lenslet synthesis processing unit 200 into a sub-aperture image; and a three-dimensional conversion unit 400 that converts the sub-aperture image generated by the sub-aperture image conversion unit 300 into a focal-stack image.

[0043] The light field microscope-based image acquisition device 100, configured as described above, can acquire a group of multiple lenslet images 10 by changing the arrangement position of the microlenses according to the time period by rotating or linearly moving a disk D on which multiple microlenses ML are arranged, thereby acquiring multiple images.

[0044] For reference, Figure 2 schematically shows a light-field microscope to which disk D according to one embodiment of the present invention is applied.

[0045] As shown in Figure 2, when a fluorescently stained sample is irradiated with light of a specific wavelength that reacts with the phosphor through a light source, fluorescent light of that specific wavelength is emitted from the sample and can pass through the objective lens. The light that has passed through the objective lens can then pass through a dichroic mirror. In a dichroic mirror, the wavelength of the light source is reflected, and only the fluorescent wavelength passes through.

[0046] The fluorescent light that has passed through the dichroic mirror passes through the tube lens and the optical tube and reaches its focal plane, where a disk D according to one embodiment of the present invention is positioned.

[0047] Multiple microlenses ML on disk D align the light that converges at the focal plane according to the position of each lens. The light that has passed through the microlenses ML then passes through a relay lens. The relay lens adjusts the difference in physical distance between the arrangement of the microlenses ML and the image sensor. The light that has passed through the relay lens reaches the image sensor, which then acquires an image. The path information of the light acquired through this image can be reconstructed into a 3D image by a software algorithm.

[0048] The disk D may have a portion of its area positioned between the optical tube and the relay lens. The central portion of the disk D may also be connected to a drive unit M, which consists of a known actuator or motor for transmitting rotational or linear power.

[0049] Therefore, disk D is capable of linear reciprocating motion in the Z-axis direction shown in Figure 2, and further, rotational motion in the R direction shown in Figure 2. For reference, the linear movement range of disk D is preferably 0 to 500 mm. Of course, the rotational speed and linear movement speed of disk D can be set to various values ​​depending on the sample to be measured, the measurement method, and the image information to be acquired.

[0050] As the disk D rotates, the arrangement position of the microlenses ML is changed, allowing different images to be acquired over time depending on the changed arrangement position of the microlenses ML.

[0051] Therefore, as shown in Figures 4 to 6, the disk D can be rotated for a set time to acquire a group of multiple lenslet images 10.

[0052] In other words, multiple image frame information can be acquired by microlenses ML whose arrangement position is changed according to the time period within a set image sensor area, and a group of multiple lenslet images 10 can be acquired based on this information. At this time, the method for changing the arrangement position of the microlenses ML can be realized by a structure in which a disk D on which multiple microlenses ML are arranged is rotated and moved linearly for a set time.

[0053] Figure 4 shows a method for acquiring multiple images within a unit of time while rotating disk D for a unit of time.

[0054] As shown in Figure 4, images are acquired from the image sensor while rotating disk D, which has microlenses ML arranged according to time zones. It can be confirmed that the arrangement position of the microlenses ML corresponding to each image is set to be different.

[0055] As mentioned above, it is possible to obtain a group of multiple lenslet images 10 by combining information from multiple image frames acquired within a set time period through the arrangement position of microlenses ML which is changed according to the time of day.

[0056] For reference, Figure 3 shows the path of light from the microlens ML to the image sensor. The light that has passed through the tube lens is focused at the position where the microlens ML is located, and the light that has passed through the microlens ML spreads out again as it passes through the relay lens. The light that has passed through the relay lens is then focused again. At the point where light converges and passes the focal point, the image sensor can convert the light information into a digital image signal and acquire it.

[0057] Note that while Figure 4 shows multiple microlenses ML arranged in a grid pattern on disk D, this is not the only possible arrangement.

[0058] For example, as shown in Figure 10, microlenses ML can be arranged on a disk in Nipkow patterns, honeycomb patterns, or random patterns.

[0059]

[0060] The lenslet synthesis processing unit 200 can superimpose multiple image frames that make up the multiple lenslet image group 10 to understand the arrangement relationship of microlenses for each image.

[0061] As shown in Figure 5, a group of multiple lenslet images 10, consisting of multiple lenslet images acquired within a unit of time, can be used as the input image for the lenslet synthesis processing unit 200 to acquire a virtual lenslet image. In Figure 5, a virtual lenslet image is shown as being acquired with six lenslet images, but this is not the only option, and the number of lens images can be adjusted.

[0062] Furthermore, the size of the output virtual lenslet image is linearly larger than the s and t resolutions of the input image, where the magnification n is adjustable according to the settings.

[0063] Figure 6 shows in detail the process by which the multiple lenslet image group 10 is converted into a virtual lenslet image.

[0064] As shown in Figure 6, the lenslet synthesis processing unit 200 can understand the arrangement relationship of microlenses for each image frame by superimposing multiple image frames that make up the multiple lenslet image group 10. A virtual lenslet image is an arrangement of virtual microlenses ML in image space, and these virtual microlenses ML may be superimposed in image space, or they may be arranged in a non-superimposed form within the virtual lenslet image according to their positional order.

[0065]

[0066] The sub-aperture image conversion unit 300 can convert a virtual lenslet image into a sub-aperture image 30.

[0067] At this time, the sub-aperture image conversion unit 300 can find pixels in the virtual lenslet image that correspond to the coordinates of the microlens ML and map them to the coordinate positions of the sub-aperture image to be converted.

[0068] Figure 8 shows the processing steps of the sub-aperture image conversion unit 300.

[0069] As shown in Figure 8, the lenslet image contains information about the light passing through the arrangement of microlenses ML, so a circular image appears in the shape of the arrangement. Depending on the number of microlenses ML in the image, the horizontal and vertical positions of each microlens ML are represented by s and t coordinates, and the number of microlenses ML in the image can be represented by the spatial resolution of the light field image. Each microlens ML has a predetermined number of pixel regions, and the position of each pixel within the microlens ML is represented by the u and v coordinates of that microlens ML, and the number of u and v is represented by the angular resolution of the light field image.

[0070] Since the position of each pixel in a light field image is aligned to the s, t, u, and v coordinates, a process is needed to convert the lenslet image into an aligned image, and the sub-aperture image conversion unit 300 performs the process of converting the lenslet image into a sub-aperture image. The process involves finding the pixels corresponding to the s, t, u, and v coordinate positions in each lenslet image and mapping them to the s, t, v, and u image positions of the sub-aperture image. The converted sub-aperture image consists of u × v block images with a size of s × t, and each block image has angle information corresponding to the u and v coordinates.

[0071] Figure 7 shows an example of how the sub-aperture image conversion unit 300 generates pixel values ​​in a virtual lenslet image.

[0072] As shown in Figure 7, a virtual lenslet image Any lenslet image corresponding to positions i and j in TIFF0007849080000012.tif1216 has pixel sizes of u and v. To generate such lenslet images, a virtual lenslet image By finding adjacent lenslet images within TIFF0007849080000013.tif1216, the pixel values ​​of the virtual lenslet image can be calculated using the following formula 1.

[0073]

number

[0074]

[0075] Here, It is TIFF0007849080000015.tif2774, It is TIFF0007849080000016.tif1449, JPEG0007849080000017.jpg1554 contains pixel values ​​corresponding to the i, j, u, and v coordinates. TIFF0007849080000018.tif2025 is a weight value corresponding to the distance between the k-th lenslet image and the virtual lenslet image. TIFF0007849080000019.tif1619 is the distance between the k-th lenslet image and a virtual lenslet image.

[0076]

[0077] As described above, the 3D conversion unit 400 can convert the sub-aperture image generated by the sub-aperture image conversion unit 300 into a focal stack image.

[0078] Figure 9 shows the processing steps of the 3D conversion unit 400, which takes a sub-aperture image as input.

[0079] As shown in Figure 9, the 3D conversion unit 400 can convert the sub-aperture image into a focal stack image having 3D information for the x, y, and z axes.

[0080] The x and y axis positions of a focal stack image contain 2D image information at the corresponding z-axis coordinate points, and the depth information of the image can be determined according to the number of z-axis coordinates.

[0081] The method for converting a sub-aperture image to a focal stack image in the 3D transformation unit 400 can be expressed using the following equations 2 and 3.

[0082]

number

[0083]

[0084]

number

[0085]

[0086] Here, JPEG0007849080000022.jpg2048 contains the transformed sub-aperture values ​​corresponding to the s, t, u, and v coordinates and a specific alpha value. The transformed sub-aperture values ​​are necessary for obtaining the focal stack image, and the focal stack coordinate values ​​correspond to the alpha value. The file JPEG0007849080000023.jpg1942 can be obtained. Note that x and y are the x and y coordinate values ​​corresponding to a 3D focal stack image. Also, JPEG0007849080000024.jpg1115 represents the number of u and v coordinates, where a specific z coordinate is matched to a specific α value. When α=1, it corresponds to the center position of the focal costack image, and the range is 0 < α < 1 + i. By adjusting the range of α, it is possible to adjust the measurement range of the z axis.

[0087]

[0088] Next, with reference to Figure 11, a light-field microscope-based image acquisition method according to one embodiment of the present invention will be described.

[0089] As shown in Figure 11, a light field microscope-based image acquisition method according to one embodiment of the present invention is

[0090] The process may include a first stage S100 for acquiring a group of multiple lenslet images, a second stage S200 for acquiring a virtual lenslet image using the group of multiple lenslet images obtained in the first stage S100, a third stage S300 for converting the virtual lenslet image acquired in the second stage S200 into a sub-aperture image, and a fourth stage S400 for converting the aperture image converted in the third stage S300 into a focal stack image.

[0091] In the first step S100, multiple image frame information can be acquired through microlenses ML whose arrangement position is changed according to the time period within the set image sensor area, and a group of multiple lenslet images can be acquired by rotating a disk D on which multiple microlenses ML are arranged for a set time.

[0092] In the second step S200, multiple image frames constituting the multiple lenslet image group can be superimposed to understand the arrangement relationship of microlenses for each image, and this second step S200 can be performed by the lenslet synthesis process 200.

[0093] In the third step S300, pixels corresponding to the coordinates of the microlenses can be found in the virtual lenslet image and mapped to the coordinate positions of the sub-aperture image to be transformed. This third step S300 can be performed by the sub-aperture image transformation unit 300.

[0094] In the fourth step S400, the sub-aperture image is converted into a focal stack image having three-dimensional information of the x, y, and z axes, and the x and y axis positions of the focal stack image may include two-dimensional image information at the corresponding z-axis coordinate point. This fourth step S400 can be performed by the three-dimensional conversion unit 400.

[0095] The light field microscope-based image acquisition method according to one embodiment of the present invention generates high-resolution three-dimensional images based on the configuration described for the light field microscope-based image acquisition apparatus 100 according to one embodiment of the present invention. Therefore, in order to avoid repetition of the explanation, a detailed explanation will be omitted.

[0096] While specific embodiments of the present invention have been described so far, it goes without saying that various modifications are possible without departing from the scope of the present invention.

[0097] Therefore, the scope of the present invention should not be limited to the embodiments described above, but should be defined not only by the claims described below, but also by equivalent claims, etc. [Industrial applicability]

[0098] This invention can be applied to and sold in various industrial fields that use safety equipment, component testing, substance testing, measurement, and analysis instruments.

Claims

1. A lenslet synthesis processing unit that acquires a virtual lenslet image using a set of multiple lenslet images, A sub-aperture image conversion unit converts a virtual lenslet image generated by the lenslet synthesis processing unit into a sub-aperture image, The unit includes a three-dimensional conversion unit that converts the sub-aperture image generated by the sub-aperture image conversion unit into a focal stack image, The aforementioned group of multiple lenslet images is It is generated by acquiring information from multiple image frames via multiple microlenses whose arrangement positions are changed according to the time period within a set image sensor area. The aforementioned lenslet synthesis processing unit is By superimposing multiple image frames that make up a group of multiple lenslet images, the arrangement relationship of microlenses in each image can be understood. The sub-aperture image conversion unit is: In the virtual lenslet image, find the pixels corresponding to the microlens coordinates, map them to the coordinate positions of the sub-aperture image to be transformed, and generate the pixel values ​​of the virtual lenslet image using the following formula 1. [Math 1] Here, 【number】 And, 【number】 And, 【number】 These are the pixel values ​​corresponding to the i, j, u, and v coordinates. 【number】 This is a weight value corresponding to the distance between the k-th lenslet image and the virtual lenslet image. 【number】 This is characterized by being the distance between the k-th lenslet image and a virtual lenslet image. A light-field microscope-based image acquisition system.

2. The aforementioned group of multiple lenslet images is The light field microscope-based image acquisition apparatus according to claim 1, characterized in that it acquires images by rotating a disk on which multiple microlenses are arranged for a set time.

3. The aforementioned three-dimensional conversion unit is The aforementioned sub-aperture image is converted into a focal stack image having three-dimensional information for the x, y, and z axes. The light field microscope-based image acquisition apparatus according to claim 1, characterized in that the x-axis and y-axis positions of the focal stack image include two-dimensional image information at the corresponding z-axis coordinate point.

4. The three-dimensional conversion unit converts the sub-aperture image into a focal stack image using the following equations 2 and 3. [Math 2] [Math 3] Here, 【number】 These are the transformed sub-aperture values ​​corresponding to the s, t, u, v coordinates and a specific alpha value. 【number】 x and y are the focal stack coordinate values ​​corresponding to the alpha value, and x and y are the x and y coordinate values ​​corresponding to the 3D focal stack image. 【number】 The light field microscope-based image acquisition device according to claim 3, characterized in that is the number of u and v coordinates.

5. The light field microscope-based image acquisition apparatus according to claim 2, characterized in that the disk is connected to an actuator or motor that provides rotational or linear power.

6. The light field microscope-based image acquisition apparatus according to claim 2, characterized in that the linear movement range of the disk is 0 to 500 mm.

7. The first stage involves acquiring a set of multiple lenslet images, The second step involves acquiring a virtual lenslet image using the multiple lenslet image set acquired in the first step, The third step involves converting the virtual lenslet image acquired in the second step into a sub-aperture image, The fourth step includes converting the sub-aperture image converted in the third step into a focal stack image, In the first stage, multiple image frame information is acquired through multiple microlenses whose arrangement positions are changed according to the time period within the set image sensor area. In the second stage described above, multiple image frames constituting the multiple lenslet image group are superimposed to understand the arrangement relationship of microlenses for each image, In the third stage described above, pixels corresponding to the coordinates of the microlenses are found in the virtual lenslet image, mapped to the coordinate positions of the sub-aperture image to be transformed, and pixel values ​​of the virtual lenslet image are generated using the following formula 1. [Math 1] Here, 【number】 And, 【number】 And, 【number】 These are the pixel values ​​corresponding to the i, j, u, and v coordinates. 【number】 This is a weight value corresponding to the distance between the k-th lenslet image and the virtual lenslet image. 【number】 This is characterized by being the distance between the k-th lenslet image and a virtual lenslet image. A light-field microscope-based image acquisition method.

8. The light field microscope-based image acquisition method according to claim 7, characterized in that, in the first step, a disk on which a plurality of microlenses are arranged is rotated for a set time to acquire a group of multiple lenslet images.

9. In the aforementioned fourth stage, The aforementioned sub-aperture image is converted into a focal stack image having three-dimensional information for the x, y, and z axes. The light field microscope-based image acquisition method according to claim 7, characterized in that the x-axis and y-axis positions of the focal stack image include two-dimensional image information at the corresponding z-axis coordinate point.

10. In the fourth stage described above, the sub-aperture image is converted to a focal stack image using the following equations 2 and 3. [Math 2] [Math 3] Here, 【number】 These are the transformed sub-aperture values ​​corresponding to the s, t, u, v coordinates and a specific alpha value. 【number】 x and y are the focal stack coordinate values ​​corresponding to the alpha value, and x and y are the x and y coordinate values ​​corresponding to the 3D focal stack image. 【number】 The light field microscope-based image acquisition method according to claim 9, characterized in that is the number of u and v coordinates.

Citation Information

Patent Citations

  • Multi-view fundus camera

    JP2014530697A

  • 3D light field camera and image capturing method

    JP2020126245A

  • Method for displaying 3 dimension image in integral imaging microscope system, and integral imaging microscope system implementing the same

    KR102253320B1

  • 3-d light field camera and photography method

    US20160330432A1

  • Observation system, optical component, and observation method

    WO2016092674A1