Image processing method, image processing device, ophthalmological device, and program
Patent Information
- Application Number
- JP2024510010
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-03-10
- Filing Date
- 2023-03-10
- Publication Date
- 2024-11-28
- Estimated Expiration
- 2043-03-10
AI Technical Summary
Optical coherence tomography (OCT) systems face challenges in reducing information loss and maintaining resolution when generating three-dimensional images of the eye's fundus, as they integrate four-dimensional frequency information into three-dimensional data, leading to incomplete restoration of images outside the depth of focus.
The implementation of a double projection method using a four-dimensional aperture formed by optical systems with different numerical apertures, where the irradiation-side optical system has a zero or small numerical aperture and the detection-side optical system has a larger numerical aperture, reduces information loss by projecting frequency information onto a three-dimensional space, effectively correcting distorted OCT images.
This approach enhances the precision of OCT images by maintaining resolution and reducing information loss, allowing for the generation of highly accurate, high-resolution images that faithfully represent the eye's fundus structure.
Abstract
Description
Image processing method, image processing device, ophthalmic device, and program
[0001] The technology of the present disclosure relates to an image processing method, an ophthalmic apparatus, and a program.
[0002] Optical coherence tomography (OCT) is a method for measuring the structure of a subject's eye using light reflected from different layers of the fundus of the subject's eye, and can obtain one-dimensional depth images, two-dimensional tomographic images, and three-dimensional images. For example, a technique for generating data on the structure of a subject's eye using an OCT is known (U.S. Pat. No. 1,023,8281).
[0003] A first aspect of the technology of the present disclosure is an image processing method in an image processing device performed by a processor, the image processing method including: irradiating light from a light source onto an irradiated object using an optical system with a first numerical aperture; detecting interference light between signal light, which is returned from the irradiated object by the irradiated light and propagated using an optical system with a second numerical aperture, and reference light, which is obtained by dividing the light from the light source, to obtain information indicating the interference light; performing a first process of projecting the information indicating the interference light onto a four-dimensional frequency aperture formed by the optical system with the first numerical aperture and the optical system with the second numerical aperture in a four-dimensional space of the frequency of the light source and the three-dimensional light frequency indicating the irradiated object; and a second process of projecting the projected information into three-dimensional space.
[0004] A second aspect of the technology of the present disclosure is an image processing device comprising a memory and a processor, wherein the processor performs the following steps: irradiating light from a light source onto an irradiated object via an optical system with a first numerical aperture; detecting interference light between signal light returned from the irradiated object by the irradiated light and propagated via an optical system with a second numerical aperture, and reference light obtained by dividing the light from the light source, thereby acquiring information indicating the interference light; projecting the information indicating the interference light onto a four-dimensional frequency aperture formed by the optical system with the first numerical aperture and the optical system with the second numerical aperture in a four-dimensional space of the frequency of the light source and the three-dimensional light frequency indicating the irradiated object; and projecting the projected information onto the three-dimensional space.
[0005] A third aspect of the technology of the present disclosure is a program that causes a computer to perform the following processes: a first process of irradiating a test eye with light from a light source using an optical system with a first numerical aperture, and detecting interference light between signal light returned from the test eye by the irradiated light and propagated through an optical system with a second numerical aperture and reference light obtained by dividing the light from the light source, thereby acquiring information indicating the interference light; projecting the information indicating the interference light onto a four-dimensional frequency aperture formed by the optical system with the first numerical aperture and the optical system with the second numerical aperture in a four-dimensional space of the frequency of the light source and the frequency of the light from the test eye by the signal light; and a second process of projecting the projected information into a three-dimensional space.
[0006] It is a schematic diagram of an ophthalmologic system according to an embodiment. It is a schematic diagram of an ophthalmologic apparatus according to an embodiment. It is a conceptual diagram of an OCT image. It is a conceptual diagram of an example showing information about an OCT image in an OCT system in a four-dimensional frequency space. Four-dimensional aperture A 4 1 is a conceptual diagram showing an example of a four-dimensional aperture A. 4 FIG. 1 is a conceptual diagram showing a part of the OCT system; FIG. 2 is an explanatory diagram showing the concept of correction processing of an OCT image by a double projection method; FIG. 3 is a conceptual configuration diagram of an optical system in an OCT system; FIG. 4 is an explanatory diagram of functions realized by an image processing program; FIG. 5 is a flowchart showing an example of the flow of image processing; FIG. 6 is a conceptual diagram showing an example of an OCT image according to the present embodiment; FIG. 7 is a conceptual diagram showing a comparative example of an OCT image.
[0007] An ophthalmic system 100 according to an embodiment of the present invention will be described below with reference to the drawings. FIG. 1 illustrates a schematic configuration of the ophthalmic system 100. As illustrated in FIG. 1, the ophthalmic system 100 includes an ophthalmic apparatus 110, a server apparatus (hereinafter referred to as the "server") 140, and a display device (hereinafter referred to as the "viewer") 150. The ophthalmic apparatus 110 acquires fundus images. The server 140 stores, in association with patient IDs, multiple fundus images acquired by photographing the funduses of multiple patients using the ophthalmic apparatus 110 and axial lengths measured by an axial length measurement device (not shown). The viewer 150 displays the fundus images acquired by the server 140 and analysis results. In this embodiment, a case will be described in which a subject's eye is used as an example of an "irradiated object" of the technology disclosed herein. The ophthalmic apparatus 110 is an example of an "ophthalmic apparatus" of the technology disclosed herein. The ophthalmic apparatus is also an example of an "image processing device" of the technology disclosed herein.
[0008] The ophthalmic apparatus 110, the server 140, and the viewer 150 are connected to each other via a network 130. The network 130 may be any network such as a LAN, a WAN, the Internet, or a wide area Ethernet network. For example, when the ophthalmic system 100 is established in a medical facility such as a hospital, a LAN may be used as the network 130.
[0009] The viewer 150 is a client in a client-server system, and multiple viewers 150 are connected via a network. Multiple servers 140 may also be connected via a network to ensure system redundancy. If the ophthalmic apparatus 110 has an image processing function and the image viewing function of the viewer 150, the ophthalmic apparatus 110 can acquire, process, and view fundus images in a standalone state. If the server 140 has the image viewing function of the viewer 150, the configuration of the ophthalmic apparatus 110 and the server 140 can acquire, process, and view fundus images.
[0010] In addition, other ophthalmic devices (examination equipment for visual field measurement, intraocular pressure measurement, etc.) and diagnostic support devices that perform image analysis using AI (Artificial Intelligence) may be connected to the ophthalmic device 110, the server 140, and the viewer 150 via the network 130.
[0011] Next, the configuration of the ophthalmologic apparatus 110 will be described with reference to FIG.
[0012] For ease of explanation, a scanning laser ophthalmoscope will be referred to as an "SLO," and an optical coherence tomography will be referred to as an "OCT."
[0013] When the ophthalmic apparatus 110 is placed on a horizontal plane, the horizontal direction is defined as the "X direction," the vertical direction relative to the horizontal plane is defined as the "Y direction," and the direction connecting the center of the pupil of the anterior segment of the subject's eye 12 and the center of the eyeball is defined as the "Z direction." Therefore, the X direction, Y direction, and Z direction are perpendicular to each other.
[0014] The ophthalmologic apparatus 110 includes an imaging device 14 and a control device 16. The imaging device 14 is equipped with an SLO unit 18 and an OCT unit 20, and acquires a fundus image of the subject's eye 12. Hereinafter, a two-dimensional fundus image acquired by the SLO unit 18 will be referred to as an SLO image. Furthermore, a tomographic image or a front image (en-face image) of the retina created based on OCT data acquired by the OCT unit 20 may also be referred to as an OCT image.
[0015] The control device 16 comprises a computer having a CPU (Central Processing Unit) 16A, a RAM (Random Access Memory) 16B, a ROM (Read-Only Memory) 16C, and an input / output port (I / O) 16D.
[0016] The control device 16 includes an input / display device 16E connected to the CPU 16A via an I / O port 16D. The input / display device 16E has a graphic user interface that displays an image of the subject's eye 12 and receives various instructions from the user. An example of the graphic user interface is a touch panel display.
[0017] The control device 16 also includes an image processor 17 connected to an I / O port 16D. The image processor 17 generates an image of the subject's eye 12 based on data obtained by the photographing device 14. The control device 16 is connected to a network 130 via a communication interface 16F. The image processor 17 also includes a memory 17M, which is a non-volatile storage device capable of storing an image processing program, which will be described later.
[0018] 2 , the control device 16 of the ophthalmic apparatus 110 includes the input / display device 16E, but the technology of the present disclosure is not limited to this. For example, the control device 16 of the ophthalmic apparatus 110 may not include the input / display device 16E, but may instead include an input / display device that is physically independent from the ophthalmic apparatus 110. In this case, the display device may include an image processing processor unit, and the image processing processor unit may display an SLO image or the like based on an image signal output from the ophthalmic apparatus 110.
[0019] The imaging device 14 operates under the control of the CPU 16A of the control device 16. The imaging device 14 includes an SLO unit 18, an imaging optical system 19, and an OCT unit 20. The imaging optical system 19 includes an optical scanner 22 and a wide-angle optical system 30.
[0020] The optical scanner 22 performs two-dimensional scanning in the X and Y directions with the light emitted from the SLO unit 18. The optical scanner 22 may be any optical element that can deflect a light beam, such as a polygon mirror or a galvanometer mirror, or a combination thereof.
[0021] The wide-angle optical system 30 combines the light from the SLO unit 18 and the light from the OCT unit 20 .
[0022] The wide-angle optical system 30 may be a reflective optical system using a concave mirror such as an elliptical mirror, a refractive optical system using a wide-angle lens, or a catadioptric optical system combining concave mirrors and lenses. By using a wide-angle optical system using an elliptical mirror or a wide-angle lens, it becomes possible to photograph the retina in the peripheral part of the fundus as well as the center of the fundus.
[0023] When a system including an elliptical mirror is used, the system using the elliptical mirror described in International Publication WO2016 / 103484 or International Publication WO2016 / 103489 may be used, the disclosures of which are each incorporated herein by reference in their entirety.
[0024] The wide-angle optical system 30 enables observation of a wide field of view (FOV) region 12A of the fundus. The FOV region 12A indicates the range that can be photographed by the imaging device 14. The FOV region 12A can be expressed as a field of view. In this embodiment, the field of view can be defined by an internal illumination angle and an external illumination angle. The external illumination angle is the illumination angle of the light beam irradiated from the ophthalmic device 110 to the subject's eye 12, defined with the pupil 27 as the reference. The internal illumination angle is the illumination angle of the light beam irradiated to the fundus F, defined with the center O of the eyeball as the reference. The external illumination angle and the internal illumination angle correspond to each other. For example, if the external illumination angle is 120 degrees, the internal illumination angle corresponds to approximately 160 degrees. In this embodiment, the internal illumination angle is 200 degrees.
[0025] Here, an SLO fundus image captured at an internal illumination angle of 160 degrees or more is referred to as a UWF-SLO fundus image. UWF stands for Ultra Wide Field. The wide-angle optical system 30, which provides an ultra-wide field of view (FOV) of the fundus, can capture an image of the area extending from the posterior pole of the fundus of the subject's eye 12 beyond the equator.
[0026] The ophthalmologic apparatus 110 can capture an image of an area 12A with an internal illumination angle of 200°, with the center O of the eyeball of the subject's eye 12 as the reference position. Note that the internal illumination angle of 200° corresponds to an external illumination angle of 110° with the pupil of the eyeball of the subject's eye 12 as the reference. In other words, the wide-angle optical system 30 irradiates the laser light from the pupil at an angle of view with an external illumination angle of 110°, and captures an image of a fundus area of 200° with an internal illumination angle.
[0027] 2, the SLO system is realized by a control device 16, an SLO unit 18, and an imaging optical system 19. The SLO system includes a wide-angle optical system 30, and therefore enables fundus imaging in a wide FOV region 12A.
[0028] The SLO unit 18 includes a light source 40 including a light source for B light (blue light), a light source for G light (green light), a light source for R light (red light), and a light source for IR light (infrared light (e.g., near-infrared light)). The light of each color from the light source 40 is guided along the same optical path.
[0029] The SLO unit 18 is configured to be switchable between a light source that emits laser light of different wavelengths or a combination of light sources that emit light, such as a mode that emits R light and G light and a mode that emits infrared light. Note that the technology disclosed herein is not limited to having four light sources: a light source of B light, a light source of G light, a light source of R light, and a light source of IR light. For example, the SLO unit 18 may further include a light source of white light and emit light in various modes, such as a mode that emits G light, R light, and B light, or a mode that emits only white light.
[0030] Light incident on the photographing optical system 19 from the SLO unit 18 is scanned in the X and Y directions by the optical scanner 22. The scanned light passes through the wide-angle optical system 30 and the pupil 27 and is then irradiated onto the fundus. The light reflected by the fundus passes through the wide-angle optical system 30 and the optical scanner 22 and is incident on the SLO unit 18.
[0031] The SLO unit 18 includes a beam splitter 60 that guides light from the posterior segment (fundus) of the subject's eye 12 to a detecting element 70. The detecting element 70 detects the light from the posterior segment (fundus) of the subject's eye 12. Note that a beam splitter 60 and a detecting element 70 may be provided for each color. For example, beam splitters for B light, G light, R light, and IR light are arranged on the optical axis, and detecting elements of the corresponding colors are arranged downstream of each beam splitter. The beam splitter for B light may reflect B light and transmit light other than B light. Similarly, the beam splitter for G light may reflect G light and transmit light other than G light, the beam splitter for R light may reflect R light and transmit light other than R light, and the beam splitter for IR light may reflect IR light.
[0032] The image processor 17, which operates under the control of the CPU 16A, generates a UWF-SLO image using light (light reflected by the fundus) that is incident on the SLO unit 18 via the wide-angle optical system 30 and the optical scanner 22, i.e., signals from the detection elements 70 based on light of each color.
[0033] The control device 16 also controls the light sources 40 for each color to emit light simultaneously. By simultaneously photographing the fundus of the subject's eye 12 with B light, G light, and R light, a G-color fundus image, a R-color fundus image, and a B-color fundus image, each of which corresponds to each other, are obtained. An RGB color fundus image is obtained from the G-color fundus image, the R-color fundus image, and the B-color fundus image. By simultaneously controlling the light sources 40 for each color to emit light simultaneously and simultaneously photographing the fundus of the subject's eye 12 with G light and R light, a G-color fundus image and a R-color fundus image, each of which corresponds to each other, are obtained. An RG color fundus image is obtained from the G-color fundus image and the R-color fundus image.
[0034] The wide-angle optical system 30 makes the field of view (FOV) of the fundus an ultra-wide angle, and can capture an image of the area from the posterior pole of the fundus of the subject's eye 12 beyond the equator.
[0035] The OCT system is realized by the control device 16, OCT unit 20, and imaging optical system 19 shown in FIG. 2. The OCT system includes a wide-angle optical system 30, which enables OCT imaging of the peripheral part of the fundus, similar to the above-described SLO fundus image capture. That is, the wide-angle optical system 30, which provides an ultra-wide field of view (FOV) of the fundus, enables OCT imaging of the area extending from the posterior pole of the fundus to the equator of the subject's eye 12. OCT data of the peripheral part of the fundus can be acquired, and a tomographic image and a 3D structure of the fundus can be obtained by image processing the OCT data.
[0036] The OCT unit 20 includes a light source 20A, a sensor (detection element) 20B, a first optical coupler 20C, a reference optical system 20D, and an irradiation and detection optical system 20E including a second optical coupler 200 (FIG. 3).
[0037] Light emitted from the light source 20A is split by the first optical coupler 20C. One of the split lights is incident on the imaging optical system 19 via the irradiation and detection optical system 20E as measurement light. The measurement light is irradiated onto the fundus via the wide-angle optical system 30 and the pupil 27. The measurement light reflected by the fundus is incident on the OCT unit 20 via the wide-angle optical system 30 and the optical scanner 22, and then incident on the sensor 20B via the irradiation and detection optical system 20E and the first optical coupler 20C. The other light split by the first optical coupler 20C is incident on the reference optical system 20D, and its return light is incident on the sensor 20B via the first optical coupler 20C as reference light.
[0038] The light incident on the sensor 20B, i.e., the measurement light reflected from the fundus and the reference light, interfere with each other to generate interference light. The interference light is received by the sensor 20B. The image processor 17, which operates under the control of the CPU 16, generates OCT data detected by the sensor 20B. Based on the OCT data, it is possible to generate a tomographic image and an OCT image.
[0039] The OCT unit 20 described above can scan a predetermined range (e.g., a rectangular range of 6 mm x 6 mm) in one OCT imaging session. The predetermined range is not limited to 6 mm x 6 mm, and may be a square range of 12 mm x 12 mm or 23 mm x 23 mm, or a rectangular range of 14 mm x 9 mm, 6 mm x 3.5 mm, or any other rectangular range. It may also be a circular range with a diameter of 6 mm, 12 mm, or 23 mm.
[0040] By using the wide-angle optical system 30, the ophthalmic apparatus 110 can scan an area 12A with an internal illumination angle of 200°. That is, by controlling the optical scanner 22, OCT imaging of a predetermined range is performed. The ophthalmic apparatus 110 can generate OCT data through the OCT imaging. Therefore, the ophthalmic apparatus 110 can generate OCT images, such as a tomographic image of the fundus (B-scan image), OCT volume data, and an en-face image (a front image generated from the OCT volume data) that is a cross section of the OCT volume data.
[0041] The OCT data (or image data of the OCT image) is sent from the ophthalmologic apparatus 110 to the server 140 via the communication interface 16F and stored in a storage device.
[0042] Incidentally, OCT systems can simultaneously acquire depth information at the fundus. FIG. 3 shows an example of an image (OCT image) of dots aligned on an optical axis simultaneously acquired by an OCT system using optical systems (e.g., objective lenses) with different numerical apertures (NA). FIG. 3 also shows an example of images of dots aligned on an optical axis for optical systems with NA=0.1, NA=0.3, and NA=0.5. In the figure, the depth axis at the same position on the x-axis is designated cτ. Note that c indicates a light flux, and in the figure, cτ=τ. Hereinafter, the unit system of c=1 will be used. The depth of focus of the optical system is designated DOF. As shown in the example in FIG. 3, the image of the dots acquired by the OCT system becomes an incomplete dot image as the depth direction position at the fundus becomes farther from the focal position (e.g., the depth of focus) of the optical system. That is, as the position where fundus information is acquired moves away from the focal position (e.g., the focal depth) of the imaging optical system 19, the resolution gradually decreases. Therefore, as the distance from the focal depth increases, the image gradually becomes an incomplete dot image with blurring and distortion. Fundus information outside the focal depth, which is a predetermined distance (e.g., about 10 times) away, is partially lost, and it is difficult to completely restore the lost information using commonly used image processing. While there are techniques for correcting blurring and distortion in images outside the focal depth using processes known as deconvolution and refocusing, the correction is incomplete because some information is lost when the information is acquired.
[0043] The reason why the restoration of the OCT image by the OCT system is incomplete is thought to be that the information acquired by the OCT system does not reflect all of the information about the fundus of the subject's eye 12, and is therefore incomplete.
[0044] FIG. 4 shows an example of information about an OCT image. FIG. 4 shows an example of information about an OCT image formed by an optical system (e.g., an objective lens) of an OCT system with an NA = 0.9, shown in four-dimensional frequency space. In the figure, ν denotes the frequency of light from the light source 20A (in this embodiment, the frequency of light irradiated onto the fundus), and fx, fy, and fz denote object frequencies (in this embodiment, the frequency of light reflected from the fundus). The frequency ν may be expressed as an angular frequency ω (ω = 2πν). For simplicity, the axis of the object frequency fy is omitted. FIG. 4 also shows an example of an OCT system in which the same optical path is used in the optical system (e.g., an objective lens), i.e., the optical path of the measurement light irradiated and the optical path of the light reflected from the test eye 12 are the same, and both have an NA = 0.9.
[0045] Here, the object frequency (fx, fy, fz) is uniform in the ν direction. In addition, in the four-dimensional frequency space, since the frequency in the real space is within a predetermined range, the four-dimensional aperture A is used as the device function of the OCT system. 4 A window function representing a 4-D aperture is defined. 4 is the aperture space in the four-dimensional frequency space. Therefore, the OCT system can capture the object frequencies with the four-dimensional aperture A 4 However, the frequency within the 4-dimensional aperture A 4 The frequencies (fourth-dimensional information) within the four-dimensional aperture A are not all acquired, but are integrated in the fz direction during detection and acquired as three-dimensional information. 4 When the frequencies in are integrated in the fz direction, part of the four-dimensional information disappears.
[0046] Therefore, in this embodiment, an OCT system is provided that can reduce information loss, which is the loss of part of four-dimensional information.
[0047] For example, in a system such as an interference microscope that allows three-dimensional scanning, the image frequency is a four-dimensional aperture A 4 Therefore, the 4-dimensional aperture A 4By applying the ν integral of the object frequency in the sine wave, it is possible to reduce the information loss in which part of the four-dimensional information is lost.
[0048] In this embodiment, as an OCT system that reduces information loss, a four-dimensional aperture A 4 The optical system is provided with an optical system that makes the aperture sufficiently thin. This makes it possible to reduce information loss, in which part of the four-dimensional information is lost even when fz integration is performed. Specifically, the optical system is formed so that the NA of the optical system on the irradiation side that irradiates light onto the subject's eye 12 and the NA of the optical system on the detection side that detects light from the subject's eye 12 (for example, reflected light from the fundus) have different NAs. For example, if the NA of the optical system on the irradiation side of the light onto the subject's eye 12 is made sufficiently small, for example, approximately zero, even if the NA of the optical system on the detection side of the light from the subject's eye 12 is larger than the NA of the optical system on the irradiation side, the four-dimensional aperture A 4 In this embodiment, an optical system with a sufficiently small NA is referred to as an "NA is zero (NA=0)." In other words, an optical system with an NA of zero includes an optical system with an NA greater than zero and an aperture angle smaller than the image height formed by the light beam. In addition, an optical system with an NA of zero includes, for example, an optical system that is formed so that incident light or outgoing light becomes a parallel light beam, and can be considered to have an NA of zero.
[0049] In addition, an optical system with a zero NA can be applied to the optical system of an OCT system that uses full-field illumination, which uniformly illuminates an object on the irradiated side, such as the subject's eye 12, or illuminates a predetermined area of the object on the irradiated side all at once.
[0050] 4D Aperture A 4 Even if the aperture A is thinly formed, 4 The object frequency within the range has a sufficient amount of information (including fz information), and it is possible to reduce information loss, in which part of the information (four-dimensional information) about the subject's eye 12 is lost even when fz integration is performed.
[0051] That is, in this embodiment, an optical system is formed so that the NA of the irradiation-side optical system differs from the NA of the detection-side optical system for the subject's eye 12. Specifically, an optical system is formed in which the NA of the irradiation-side optical system is sufficiently small, i.e., zero, and an optical system is formed in which the NA of the detection-side optical system is larger than the NA of the irradiation-side optical system. As a result, as shown in FIG. 5, a four-dimensional aperture A 4 More specifically, the four-dimensional aperture A at a predetermined frequency (frequency ν of light from the light source 20A) can be formed thinly. 4 As shown by the arrow, the shape having information in the fz direction (a crescent shape in the figure) changes to a linear shape. A series of linear apertures is the four-dimensional aperture A in this embodiment. 4 (Figure 5)
[0052] 4D Aperture A 4 In the optical system for forming the thin optical element, one optical element has an NA of zero or close to zero, and the other optical element has an NA larger than the NA of the first optical element. For example, an example of a sufficiently small NA in an optical system such as a microscope includes NA=0.2. Therefore, in this embodiment, the NA of the optical system on the irradiation side, which is the excitation side, is set to 4-dimensional aperture A. 4 From the viewpoint of forming the lens thin, it is preferable that the following relationship be satisfied as a condition for a small NA: 0≦NA≦0.2
[0053] Thinly formed 4-dimensional aperture A 4 is an example of a "four-dimensional frequency aperture" of the technique of the present disclosure.
[0054] In the following, as an example, a case will be described in which the NA of the optical system on the side where light is irradiated onto the subject's eye 12 is an optical system with an NA of zero, and the NA of the optical system on the side where light from the subject's eye 12 is detected is an optical system with an NA of a finite value, but the technology of the present disclosure is not limited to this. For example, the NA of the optical system on the detection side may be an optical system with an NA of zero, and the NA of the optical system on the irradiation side may be an optical system with an NA of a finite value. Furthermore, the optical system with an NA of zero may have an NA of a finite value. In other words, the NA of the optical system on the irradiation side and the NA of the optical system on the detection side may be formed to be different, and by making the NAs of the two different, the four-dimensional aperture A is smaller than when both have the same NA. 4It is possible to make the thickness thinner.
[0055] In this embodiment, a four-dimensional aperture A capable of reducing information loss is used. 4 That is, the OCT image is corrected by a method (double projection method) of performing two-stage processing using frequency information of the OCT image. As shown in FIG. 7 as a concept of the processing for correcting the OCT image, in the first stage processing, frequency information (I) of the OCT image G1 is projected onto a thinly formed four-dimensional aperture A 4 In the second stage, the projected 4D aperture A 4 The information (-I) of the image G2 in the second stage is further projected in the ν (=2π / ω) direction, that is, in the (fx, fy, fz) plane. The information (-I') of the image G3 projected in the second stage processing has reduced information loss (four-dimensional information) about the subject's eye 12. Therefore, by using the above-mentioned double projection method, it is possible to correct, for example, a distorted OCT image into an image equivalent to a normal microscope image. Furthermore, since the information loss is reduced, the resolution is maintained, and the thinly formed four-dimensional aperture A 4 It is possible to generate an OCT image with higher accuracy than when not using the above method.
[0056] That is, the four-dimensional aperture A 4 (four-dimensional aperture) is a quantity independent of the object frequency, and is defined by an optical system with a first numerical aperture and an optical system with a second numerical aperture. In this embodiment, the four-dimensional aperture can be expressed as a window function capable of expressing a physical quantity determined by the configuration of the optical system in the OCT system. Also, in this embodiment, the object frequency is a physical quantity that expresses the subject's eye 12 using light components. Since the object frequency does not depend on ν, it becomes a uniform four-dimensional physical quantity in the ν direction. Note that the frequency ν is the optical frequency of the light source and also the optical frequency of the signal light. The four-dimensional aperture A is calculated by dividing this object frequency by 4 The value of the three-dimensional function obtained by fz integration of the four-dimensional function (obtainable image frequency) multiplied by is obtained as the detection value by the optical system. 4The value of the three-dimensional function representing the fz integral of the four-dimensional function multiplied by is acquired by a sensor in the optical system of the OCT system.
[0057] When the value of NA is a finite value, the four-dimensional aperture A 4 has a finite thickness. Therefore, a four-dimensional aperture A 4 When using a 4-dimensional aperture A 4 This aperture surface is a four-dimensional aperture A. 4 A predetermined plane (e.g., a 4-dimensional aperture A) away from the origin 4 4D aperture A, which is the surface farthest from the origin 4 It is preferable to apply the coating layer (the outermost surface of the coating layer).
[0058] The above-mentioned four-dimensional aperture A 4 The frequency information of the OCT image used in the correction of the OCT image using the above formula can be expressed by the following formula (1).
[0059]
[0060] Here, τ represents the distance in the depth direction of the subject's eye 12 (in the example of time-domain OCT, the adjustment amount for adjusting the optical path length in the reference optical system 20D, for example, the movement amount of a mirror).
[0061] Projected 4D aperture A 4 The information (-I) of the image G2 in can be expressed as follows (2).
[0062]
[0063] 4D Aperture A 4 The information (-I') of the image G3 projected from can be expressed as follows (3).
[0064]
[0065] The control device 16 generates an OCT image using the above-mentioned equations (1) to (3) by using the image processor 17 that operates under the control of the CPU 16A. The process of generating the OCT image will be described later.
[0066] Next, the configuration of the optical system in the OCT system according to this embodiment will be further described with reference to Fig. 8. Note that in Fig. 8, the wide-angle optical system 30 is omitted for simplicity of description.
[0067] The sensor 20B of the OCT unit 20 includes a pair of lenses 20B-1 and a detection element 20B-2. The sensor 20B collimates the light branched by the first optical coupler 20C, i.e., interference light resulting from interference between the measurement light reflected by the fundus and the reference light, into parallel light using the pair of lenses 20B-1, and then focuses the light on the detection element 20B-2.
[0068] The reference optical system 20D includes a pair of lenses 20D-1 and a mirror 20D-2. In the reference optical system 20D, the light branched by the first optical coupler 20C, i.e., the measurement light, is collimated into parallel light by the pair of lenses 20D-1 and then converged on the mirror 20D-2. The mirror 20D-2 is configured to be movable in the optical axis direction (the direction indicated by the arrow τ in FIG. 8). The light reflected by the mirror 20D-2 is returned to the first optical coupler 20C as reference light via the pair of lenses 20D-1.
[0069] 8, a configuration in which the mirror 20D-2 is movable is applied as the reference optical system 20D, but the OCT system according to this embodiment is not limited to a configuration in which the mirror 20D-2 is movable, and the mirror 20D-2 may be fixed. That is, the OCT system according to this embodiment can be applied to OCT systems of various types, such as TD-OCT (Time-Domain OCT), which is known as time-domain OCT, SS-OCT (Swept-Source OCT), which is known as Fourier-domain OCT, and SD-OCT (Spectral-Domain OCT) using a spectroscope.
[0070] Therefore, the OCT system may be configured according to the OCT system to be used. For example, when applying time-domain OCT (TD-OCT), the mirror 20D-2 may be moved to perform sweeping. Furthermore, when applying SD-OCT, a type of Fourier-domain OCT, the mirror 20D-2 may be fixed and spectral detection may be performed. For spectral detection, a light source that emits multiple light beams at multiple wavelengths may be used. Furthermore, when applying SS-OCT, a one-pixel detector may be used for the detection element 20B-2, and the mirror 20D-2 may be fixed to sweep the wavelength of a broadband light source. For wavelength sweeping, a broadband light source, such as a laser device that emits broadband laser light for wavelength sweeping, may be used as the light source 20A. Furthermore, as an optical system with zero NA, an optical system of an OCT system using full-field illumination that uniformly illuminates an object on the irradiated side, such as the subject's eye 12, or that collectively illuminates a predetermined area on the irradiated side may be used. That is, the technology of the present disclosure is not limited to the above-described laser scanning optical system that scans with laser light, but can also be applied to an optical system that uses a CCD (Charge Coupled Device) camera, etc. In this case, a CCD camera including an element such as a CCD may be used as the detection element 20B-2.
[0071] The illumination / detection optical system 20E includes a second optical coupler 200, an illumination optical system 210, and a detection optical system 220. The second optical coupler 200 has a function of guiding light emitted from the light source 20A (measurement light branched by the first optical coupler 20C) to the illumination optical system 210 as illumination light, and a function of guiding light from the detection optical system 220 (i.e., returned light from the test eye 12) to the first optical coupler 20C (i.e., toward the sensor 20B) as detection light. Thus, the test eye 12 is illuminated with light propagating through the illumination optical system 210 as light from the light source 20A, and returned light (reflected light from the test eye 12) of the light that has propagated through the illumination optical system 210 and irradiated the test eye 12 propagates through the detection optical system 220 and is incident on the sensor 20B as measurement light. In FIG. 8, the optical path of the irradiation optical system 210 in the irradiation and detection optical system 20E is shown by a solid line, and the optical path of the detection optical system 220 is shown by a dotted line.
[0072] The irradiation optical system 210 includes a pair of lenses, a lens 212 and a lens 214. The lens 212 is disposed so that one end face of the irradiation-side fiber 211 is located at the focal position of the incident side of the lens 212 on the optical axis of the irradiation optical system 210. The irradiation-side fiber 211 is formed of a single-mode fiber, and the other end face is connected to the second optical coupler 200. The lens 214 is disposed so that the reflecting surface of the optical scanner 22 is located at the focal position of the exit side of the lens 214 on the optical axis of the irradiation optical system 210. Therefore, the lens 212 collimates the light from the light source 20A (the measurement light branched by the first optical coupler 20C) into parallel light, and the lens 214 converges the parallel light collimated by the lens 212 onto the reflecting surface of the optical scanner 22. The light reflected by the optical scanner 22 is then collimated into parallel light by the lens 12B of the subject's eye 12 and irradiates the fundus 12C. Therefore, the light from the light source 20A that passes through the irradiation optical system 210 is irradiated onto the fundus 12C of the subject's eye 12 as parallel light.
[0073] The irradiation optical system 210 is an optical system that emits parallel light toward the subject's eye 12, thereby forming an optical system with an NA of zero. The NA of the irradiation optical system 210 is an example of the "first numerical aperture" of the technology of the present disclosure. The irradiation optical system 210 is also an example of the "optical system with a first numerical aperture" of the technology of the present disclosure.
[0074] The detection optical system 220 includes a beam splitter 222 and a pair of lenses, namely, a lens 214 and a lens 216. The beam splitter 222 is disposed between the lenses 212 and 214 in the irradiation optical system 210 and extracts return light (reflected light) from the subject's eye 12 by its reflection function. The beam splitter 222 is disposed such that its reflective surface is located at the focal position on the optical axis of the irradiation optical system 210, on the exit side of the lens 214, where the return light (reflected light) from the subject's eye 12 is emitted. The lens 224 is disposed such that its reflective surface is located at the focal position on the entrance side of the lens 224, on the optical axis of the detection optical system 220. The lens 226 is disposed such that one end face of a detection-side fiber 228 is located at the focal position on the exit side of the lens 226, on the optical axis of the detection optical system 220. The detection-side fiber 228 is formed by a single-mode fiber, and the other end face is connected to the second optical coupler 200. Therefore, the lens 224 collimates the light from the beam splitter 222 into parallel light, and the lens 226 converges the parallel light collimated by the lens 224 onto the end face of the detection-side fiber 228. Therefore, in the detection optical system 220, light reflected at a point on the fundus 12C of the subject's eye 12 is emitted toward the sensor 20B.
[0075] The detection optical system 220 is an optical system having a focal point on the side of the test eye 12, thereby forming an optical system having a finite NA and a different NA from that of the irradiation optical system 210. The NA of the detection optical system 220 is an example of the "second numerical aperture" of the technology of the present disclosure. The detection optical system 220 is also an example of the "optical system with a second numerical aperture" of the technology of the present disclosure.
[0076] In this embodiment, an OCT image is generated in the ophthalmic apparatus 110 using information with reduced information loss of four-dimensional information obtained using the OCT system including the above-described zero-NA irradiation optical system 210. The OCT image is generated by executing an image processing program using the image processor 17 operating under the control of the CPU 16A. Note that, although this embodiment describes a case where the OCT image is generated in the ophthalmic apparatus 110, it goes without saying that the OCT image may also be generated by an external device such as the server 140.
[0077] The ROM 16C of the ophthalmologic apparatus 110 or the memory 17M of the image processor 17 stores an image processing program shown in FIG.
[0078] The ROM 16C and the memory 17M are examples of the "memory" of the technology of the present disclosure. The CPU 16A is an example of the "processor" of the technology of the present disclosure. The image processing program is an example of the "program" of the technology of the present disclosure.
[0079] In the ophthalmologic apparatus 110 according to this embodiment, the CPU 16A reads and executes an image processing program to realize various functions. The image processing program includes a display control function, an image processing function, and a processing function. That is, when the CPU 16A executes the image processing program having these functions, the CPU 16A operates as a display control unit 204, an image processing unit 206, and a processing unit 208, as shown in FIG. 9 . The image processing function includes an image processing function using the above-described two-stage processing method (double projection method).
[0080] Next, the image processing according to this embodiment will be described in detail with reference to Fig. 10. The CPU 16A of the ophthalmic apparatus 110 reads and executes an image processing program from the ROM 16C or the memory 17M, thereby realizing the image processing shown in the flowchart of Fig. 10. The image processing process shown in Fig. 10 is an example of an image processing method according to the present disclosure.
[0081] In step S200, the image processing unit 206 of the CPU 16A acquires OCT data from the image processor 17. The OCT data is data obtained by performing OCT imaging on the subject's eye 12 using the ophthalmic apparatus 110. The OCT data includes data at positions with different depths in the optical axis direction (Z-axis direction). The OCT data is obtained by performing OCT imaging using the ophthalmic apparatus 110 as described above.
[0082] In step S202, the image processing unit 206 executes a first stage of processing in which information (OCT data) obtained by the OCT system is projected onto a four-dimensional aperture. That is, the image processing unit 206 expresses the acquired OCT data using the above formula (1) and projects frequency information (I) of the OCT image G1 onto a thinly formed four-dimensional aperture A.4 In the process of projecting the OCT image onto the target object, the frequency information of the OCT image is derived using the above formula (2). The derived information is temporarily stored in the RAM 16B.
[0083] In the next step S204, the image processing unit 206 calculates the four-dimensional aperture A 4 A second stage of processing is performed to project the information projected onto the four-dimensional aperture A into three-dimensional space. 4 In the second stage of processing, the image processing unit 206 projects the information (-I) of the image G2 at 4 As a process of projecting the information of the OCT data projected onto the four-dimensional aperture A using the above formula (3), 4 The information of the OCT image after double projection projected into three-dimensional space is derived from the image data. The derived information is temporarily stored in the RAM 16B.
[0084] Next, in step S206, the image processing unit 206 generates an OCT image using the information projected by the double projection method. The generated OCT image is stored in the RAM 16B by the processing unit 208.
[0085] The OCT image corrected using the double projection method described above may be generated at a predetermined depth in the optical axis direction, i.e., the depth direction of the subject's eye 12, or may be generated at multiple different depths. For example, an OCT image may be generated at a predetermined depth, such as 10 times the focal depth, based on the focal position of the detection optical system 220 on the subject's eye 12 side. Alternatively, multiple OCT images may be generated at different depths based on the focal position, or at a predetermined number of positions at predetermined intervals. When multiple OCT images are generated, each of the multiple OCT images may be stored in RAM 16B or memory 17M. The predetermined depth, different depths, and predetermined number may be predetermined and can be set arbitrarily by the user, for example.
[0086] When generating the above-described OCT image, image processing such as noise removal may be performed to improve the sharpness of the image.
[0087] 10 is performed by the image processing unit 206, whereby, for example, an OCT image at a predetermined depth is generated based on the focal position on the subject's eye 12 side of the detection optical system 220. The generated OCT image has reduced information loss and maintains resolution, resulting in a high-precision OCT image that faithfully reflects the state of the fundus of the subject's eye 12.
[0088] The image processing described above may further include a process for generating display screen information for displaying the generated OCT images. The process for generating display screen information for displaying OCT images may also generate display screen information for displaying a series of predetermined sample OCT images side by side. Furthermore, when multiple OCT images are generated, it is possible to generate display screen information for displaying the multiple OCT images side by side. When controlling the display of multiple OCT images side by side, for example, by generating display screen information for displaying the OCT images side by side in a direction of increasing depth, changes in the size, shape, and other aspects of the subject's eye 12 in the depth direction can be visualized and presented to the user.
[0089] The OCT image obtained by correction using the above-described double projection method based on information from a single point detected by the ophthalmic device 110 is, for example, corrected from a distorted OCT image as shown in FIG. 11B to an OCT image equivalent to a normal microscope image as shown in FIG. 11A. FIG. 11A shows an example in which the illumination / detection optical system 20E in the OCT unit 20 is configured so that the NA of the illumination optical system 210 and the NA of the detection optical system are different, and the OCT image is corrected using the double projection method. Here, the NA of the illumination optical system 210 is formed as an optical system that irradiates the subject's eye with a parallel beam, resulting in an NA of zero, while the NA of the detection optical system 220 is formed as an optical system that has an NA of 0.9. Also, FIG. 11A shows an OCT image generated at a depth position 30 times the focal depth. FIG. 11B shows a comparative example in which the NA of the illumination optical system 210 and the NA of the detection optical system 220 are formed so that they match, at 0.9.
[0090] 11A, by applying the OCT system according to this embodiment, it is possible to obtain an OCT image as an image of one point (point image) from information on one point detected in the subject's eye 12. On the other hand, as shown in FIG. 11B, when the NAs of the irradiation optical system 210 and the detection optical system 220 are made to match, the OCT image has a distorted shape, and the state of the fundus of the subject's eye 12 is obtained as a deformed image. Therefore, as can be seen from FIGS. 11A and 11B, the four-dimensional aperture A 4 is formed thinly, and a four-dimensional aperture A 4 By generating an OCT image from information obtained by a double projection method in which an OCT image is projected via a light source, it is possible to generate an OCT image with high accuracy.
[0091] As described above, according to this embodiment, the NA of the irradiation optical system 210 and the NA of the detection optical system 220 are different, and one of the optical systems (the irradiation optical system 210 in the above example) is set to zero. As a result, the aperture for the OCT image in the four-dimensional space taking frequency into consideration is set to a thin aperture (four-dimensional aperture A) that can suppress the influence even when fz integration is performed. 4 ) can be treated as a thin four-dimensional aperture A 4By using the above, the information of the OCT image projected by the double projection method has reduced information loss (four-dimensional information) about the subject's eye 12. Therefore, by correcting the OCT image by the above-mentioned image processing, it is possible to correct, for example, a distorted OCT image to an image equivalent to a normal microscope image. In addition, since the information loss is reduced, the resolution is maintained, and the thinly formed four-dimensional aperture A 4 It is possible to generate an OCT image with higher accuracy than when not using the above method.
[0092] In the above embodiment, the image processing (Figure 10) is described as being performed by the ophthalmic device 110, but the technology of the present disclosure is not limited to this and may be performed by either the ophthalmic device 110, the server 140, the viewer 150, or an additional image processing device further provided on the network 130, or a combination of these.
[0093] As described above, the technique of the present disclosure is a thinly formed four-dimensional aperture A 4 It is preferable that image processing is realized using information obtained by utilizing the above, and therefore the following techniques are included.
[0094] (First technology) An image processing device comprising: an acquisition unit that irradiates light from a light source onto an illuminated object using an optical system with a first numerical aperture, and detects interference light between signal light that is returned from the illuminated object by the irradiated light and propagated through an optical system with a second numerical aperture, and reference light that is obtained by splitting the light from the light source, and acquires information indicating the interference light; and a processing unit that performs a first process of projecting the information indicating the interference light onto a four-dimensional frequency aperture formed by the optical system with the first numerical aperture and the optical system with the second numerical aperture in a four-dimensional space of the frequency of the light source and the three-dimensional light frequency that indicates the illuminated object, and a second process of projecting the projected information into three-dimensional space.
[0095] The image processing unit 206 is an example of the "acquisition unit" and the "processing unit" of the technology of the present disclosure.
[0096] (Second technology) An ophthalmic device comprising: a detection unit that detects interference light between signal light obtained by irradiating a test eye with light from a light source and reference light split from the light from the light source; an irradiation optical system formed with a first numerical aperture so as to irradiate the test eye with light from the light source; a detection optical system formed with a second numerical aperture different from the first numerical aperture so as to propagate return light from the test eye caused by the light irradiated by the irradiation optical system to the detection unit as the signal light; a processing unit that performs a first process of projecting information indicating the interference light detected by the detection unit onto a four-dimensional frequency aperture formed by the optical system of the first numerical aperture and the optical system of the second numerical aperture in a four-dimensional space of the frequency of the light source and a three-dimensional light frequency representing the test eye, and a second process of projecting the projected information into three-dimensional space; and an image generation unit that generates a plurality of images corresponding to a plurality of planes with different depths in the optical axis direction, based on the information processed by the processing unit.
[0097] The sensor 20B is an example of an "acquisition unit" of the technology of the present disclosure. The irradiation optical system 210 is an example of an "irradiation optical system" of the technology of the present disclosure, and the detection optical system 220 is an example of a "detection optical system" of the technology of the present disclosure. The image processing unit 206 is an example of a "processing unit" and an "image generation unit" of the technology of the present disclosure.
[0098] Although the technology of the present disclosure has been described above using embodiments, the technical scope of the technology of the present disclosure is not limited to the scope described in the above embodiments. Various modifications or improvements can be made to the above embodiments without departing from the gist of the technology, and such modifications or improvements are also included in the technical scope of the disclosed technology.
[0099] In the above embodiment, the processing is performed by executing a program stored in a storage device such as a memory, but at least a part of the processing of the program may be realized by hardware. The processing flow of the program described in the above embodiment is also an example, and unnecessary steps may be deleted, new steps may be added, or the processing order may be changed within the scope of the gist.
[0100] Furthermore, in order to execute the processing in the above-described embodiment by a computer, a program in which the above-described processing is written in code that can be processed by a computer may be stored on a storage medium such as an optical disk and distributed.
[0101] In the above-described embodiment, a CPU has been used as an example of a general-purpose processor. However, in the above-described embodiment, the term "processor" refers to a processor in a broad sense, and includes general-purpose processors (e.g., CPU: Central Processing Unit, etc.) and dedicated processors (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.).
[0102] Furthermore, the operation of the processor in the above-described embodiments may not only be performed by a single processor, but may also be performed by multiple processors working together, or may be performed by multiple processors located in physically separate locations working together.
[0103] All documents, patent applications, and technical standards described herein are incorporated by reference herein to the same extent as if each individual document, patent application, and technical standard were specifically and individually indicated to be incorporated by reference. In addition, the disclosure of Japanese Patent Application No. 2022-048770, filed March 24, 2022, is incorporated by reference in its entirety herein.
Claims
1. An image processing method in an image processing device performed by a processor, comprising: light from a light source is irradiated onto an irradiated object by an optical system having a first numerical aperture, and return light from the irradiated object due to the irradiated light is detected as interference light between a signal light propagated by an optical system having a second numerical aperture and a reference light obtained by dividing the light from the light source, and information indicating the interference light is obtained; a first process of projecting information representing the interference light onto a four-dimensional frequency aperture formed by an optical system with the first numerical aperture and an optical system with the second numerical aperture in a four-dimensional space of a frequency of the light source and a three-dimensional light frequency representing the illuminated object; and a second process of projecting the projected information onto the three-dimensional space. An image processing method comprising:
2. The image processing device is provided in an ophthalmic device, The object to be irradiated is an eye to be inspected. The image processing method according to claim 1 .
3. The information indicating the interference light is OCT data obtained by detection by a detection unit that detects the interference light in an optical coherence tomography included in the image processing device, The processor, The OCT data is obtained as information indicating the interference light. The image processing method according to claim 1 .
4. The information indicating the interference light is obtained by applying OCT data obtained by detecting the interference light in a time domain type optical coherence tomography or a Fourier domain type optical coherence tomography. The image processing method according to claim 3.
5. The processor, generating a plurality of images corresponding to a plurality of planes having different depths based on the OCT data; The image processing method according to claim 3.
6. The processor, Acquire information indicating the interference light obtained by the signal light from an optical system with a first numerical aperture, the numerical aperture of which is zero or greater than zero, and an optical system with a second numerical aperture, the second numerical aperture being greater than the first numerical aperture. The image processing method according to claim 1 .
7. The processor, The optical system having the first numerical aperture irradiates the light from the light source onto the illuminated object with a parallel light beam, and the optical system having the second numerical aperture, which is a predetermined numerical aperture, acquires information indicating the interference light obtained by the signal light from the optical system having the first numerical aperture and the second numerical aperture, which is a predetermined numerical aperture. The image processing method according to claim 5.
8. The processor, Acquire information indicating the interference light obtained by the signal light from an optical system including an optical system having the first numerical aperture that satisfies the condition of 0≦NA≦0.
2. The image processing method according to claim 6.
9. Generate information for a display screen that displays the information projected into the three-dimensional space as an image. The image processing method according to claim 1 .
10. An image processing device including a memory and a processor, The processor, light from a light source is irradiated onto an irradiated object by an optical system having a first numerical aperture, and return light from the irradiated object due to the irradiated light is detected as interference light between a signal light propagated by an optical system having a second numerical aperture and a reference light obtained by dividing the light from the light source, and information indicating the interference light is obtained; a first process of projecting information representing the interference light onto a four-dimensional frequency aperture formed by an optical system with the first numerical aperture and an optical system with the second numerical aperture in a four-dimensional space of a frequency of the light source and a three-dimensional light frequency representing the illuminated object; and a second process of projecting the projected information onto the three-dimensional space. An image processing device that performs the above.
11. a detection unit that detects interference light between a signal light obtained by irradiating the subject's eye with light from a light source and a reference light obtained by splitting the light from the light source; an illumination optical system formed with a first numerical aperture so as to illuminate the subject's eye with light from the light source; a detection optical system formed with a second numerical aperture different from the first numerical aperture so that return light from the subject's eye due to the light irradiated by the irradiation optical system is propagated to the detection unit as the signal light; a processing unit that performs a first process of projecting the information indicating the interference light detected by the detection unit onto a four-dimensional frequency aperture formed by the optical system of the first numerical aperture and the optical system of the second numerical aperture in a four-dimensional space of a frequency of the light source and a three-dimensional light frequency indicating the subject's eye, based on information indicating the interference light detected by the detection unit, and a second process of projecting the projected information onto the three-dimensional space; an image generating unit that generates a plurality of images corresponding to a plurality of planes having different depths in an optical axis direction based on the information processed by the processing unit; An ophthalmic device comprising:
12. On the computer, light from a light source is irradiated onto an irradiated object by an optical system having a first numerical aperture, and return light from the irradiated object due to the irradiated light is detected as interference light between a signal light propagated by an optical system having a second numerical aperture and a reference light obtained by dividing the light from the light source, and information indicating the interference light is obtained; a first process of projecting information representing the interference light onto a four-dimensional frequency aperture formed by an optical system with the first numerical aperture and an optical system with the second numerical aperture in a four-dimensional space of a frequency of the light source and a three-dimensional light frequency representing the illuminated object; and a second process of projecting the projected information onto the three-dimensional space. A program that executes a process.
