Image processing method, image processing device, and program

By enhancing contrast and binarizing the choroidal image, combined with OCT volume data, stereoscopic images of intrachoroidal blood vessels are extracted and generated, which solves the vascular visualization problem in the prior art and improves the accuracy and efficiency of diagnosis.

CN118984672APending Publication Date: 2024-11-19NIKON CORP
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202380033100.1
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2022-04-13
Filing Date
2023-04-06
Publication Date
2024-11-19

AI Technical Summary

Technical Problem

The existing technology is difficult to effectively visualize blood vessels in the choroid, especially in subtle areas around the vortex veins, resulting in limited diagnostic efficiency and accuracy.

Method used

By acquiring the captured choroidal image, the contrast enhancement process is performed, and the blood vessel area in the choroid is extracted from the image, and stereoscopic images of blood vessels are generated using OCT volume data, including the extraction of ampulla, thick blood vessels and thin blood vessels. deal with.

Benefits of technology

The efficient visualization of intrachoroidal blood vessels is achieved, especially in the subtle areas around the vortex veins, which improves the accuracy and efficiency of diagnosis, reduces the amount of calculation, and avoids complex processing of dynamic contrast differences.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN118984672A_ABST
    Figure CN118984672A_ABST
Patent Text Reader

Abstract

The image processing method by the processor comprises: a step of acquiring an image in which a choroid is captured; a step for performing an enhancement process for enhancing the contrast of the acquired image; a step in which binarization processing is performed on the image on which the enhancement processing has been performed; and a step for extracting a region corresponding to a choroid blood vessel in the choroid from the image subjected to the binarization processing.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to an image processing method, an image processing device, and a program. Background Art

[0002] US Patent No. 10238281 discloses a technique for generating volume data of a subject's eye using an optical coherence tomography scanner. Conventionally, it has been desired to visualize blood vessels based on the volume data of a subject's eye. Summary of the invention

[0003] The first aspect is an image processing method performed by a processor, which includes: a step of acquiring an image of the choroid; a step of performing an enhancement process to enhance the contrast of the acquired image; a step of performing a binarization process on the image that has undergone the enhancement process; and a step of extracting an area corresponding to choroidal blood vessels in the choroid from the image that has undergone the binarization process.

[0004] The second aspect is an image processing device, which comprises: an image acquisition unit, which acquires an image captured of the choroid; an enhancement processing unit, which performs enhancement processing to enhance the contrast of the acquired image; a binarization processing unit, which performs binarization processing on the image that has undergone the enhancement processing; and a region extraction unit, which extracts a region corresponding to the choroidal blood vessels in the choroid from the image that has undergone the binarization processing.

[0005] The third aspect is a program for performing image processing, which causes the processor to process the following steps: acquiring an image of the choroid; performing an enhanced processing image to enhance the contrast of the acquired image; performing a binarization processing image relative to the enhanced image; and extracting an area corresponding to the choroidal blood vessels in the choroid from the binarization processed image. BRIEF DESCRIPTION OF THE DRAWINGS

[0006] Figure 1 It is a schematic configuration diagram of an ophthalmologic system according to an embodiment.

[0007] Figure 2 It is a schematic diagram of the configuration of an ophthalmologic apparatus according to an embodiment.

[0008] Figure 3 This is a schematic diagram of the server structure.

[0009] Figure 4 This is a diagram for explaining the functions implemented by the image processing program in the CPU of the server.

[0010] Figure 5 This is a flowchart showing an example of the flow of image processing by the server.

[0011] Figure 6 This is a flowchart showing an example of the flow of the choroidal blood vessel imaging process.

[0012] Figure 7 : is a flowchart showing an example of the flow of the first image processing based on the first blood vessel extraction processing.

[0013] Figure 8 : is a flowchart showing an example of the flow of the second image processing based on the second blood vessel extraction processing.

[0014] Fig. 9 : is a flowchart showing an example of the flow of the third image processing based on the third blood vessel extraction processing.

[0015] Fig.10 It is a schematic diagram showing the relationship between the eyeball and the position of the vortex vein.

[0016] Fig.11 It is a diagram showing the relationship between OCT volume data and en-face images.

[0017] Fig.12 This is a diagram showing an example of a fundus image of choroidal blood vessels including vortex veins.

[0018] Fig.13 This is a conceptual diagram of a three-dimensional image of a vortex vein.

[0019] Fig.14 This is an explanatory diagram related to contrast enhancement processing.

[0020] Fig.15 This is an explanatory diagram related to fine region connection processing.

[0021] Fig.16 This is a diagram showing an example of a stereoscopic image of choroidal blood vessels around vortex veins.

[0022] Fig.17 This is a diagram showing an example of a display screen of a stereoscopic image using vortex veins. DETAILED DESCRIPTION

[0023] Hereinafter, an ophthalmologic system 100 according to an embodiment of the present disclosure will be described with reference to the drawings.

[0024] Figure 1 Schematic diagram of the ophthalmic system 100 is shown. Figure 1As shown, the ophthalmologic system 100 includes an ophthalmologic apparatus 110, a server apparatus (hereinafter referred to as a "server") 140, and a display apparatus (hereinafter referred to as a "viewer") 150. The ophthalmologic apparatus 110 acquires a fundus image. The server 140 stores a plurality of fundus images obtained by photographing the fundus of a plurality of patients using the ophthalmologic apparatus 110 and an axial length measured by an axial length measuring apparatus (not shown) in correspondence with a patient ID. The viewer 150 displays the fundus image acquired by the server 140 and the analysis result.

[0025] The server 140 is an example of the “image processing device” in the present disclosure.

[0026] The ophthalmologic apparatus 110, the server 140, and the viewer 150 are connected to each other via a network 130. The network 130 is any network such as a LAN, a WAN, the Internet, or a wide area Ethernet. For example, when the ophthalmologic system 100 is built in a hospital, the network 130 can be a LAN.

[0027] The viewer 150 is a client in the client server system, and multiple servers are connected via a network. In addition, in order to ensure the redundancy of the system, multiple servers 140 can also be connected via a network. Alternatively, as long as the ophthalmic device 110 has an image processing function and an image viewing function of the viewer 150, the ophthalmic device 110 can acquire, process, and view fundus images in an independent state. In addition, as long as the server 140 has the image viewing function of the viewer 150, the ophthalmic device 110 and the server 140 can acquire, process, and view fundus images.

[0028] Furthermore, a diagnosis support device that performs image analysis using other ophthalmic equipment (examination equipment such as visual field measurement and intraocular pressure measurement) or AI (Artificial Intelligence) may be connected to the ophthalmic apparatus 110 , the server 140 , and the viewer 150 via the network 130 .

[0029] Next, refer to Figure 2 , describing the structure of the ophthalmic device 110.

[0030] For convenience of explanation, a scanning laser ophthalmoscope is referred to as “SLO” and an optical coherence tomography is referred to as “OCT”.

[0031] In addition, when the ophthalmologic apparatus 110 is placed on a horizontal plane, the horizontal direction is referred to as the “X direction”, the direction perpendicular to the horizontal plane is referred to as the “Y direction”, and the direction connecting the center of the pupil of the anterior ocular portion of the detected eye 12 and the center of the eyeball is referred to as the “Z direction”. Therefore, the X direction, the Y direction, and the Z direction are perpendicular to each other.

[0032] The ophthalmologic apparatus 110 includes an imaging device 14 and a control device 16. The imaging device 14 has an SLO unit 18 and an OCT unit 20, and acquires a fundus image of the detected eye 12. Hereinafter, the two-dimensional fundus image acquired by the SLO unit 18 is referred to as an SLO image. In addition, a tomographic image, an en-face image, etc. of the retina created based on the OCT data acquired by the OCT unit 20 is referred to as an OCT image.

[0033] The control device 16 includes a computer having a CPU (Central Processing Unit) 16A, a RAM (Random Access Memory) 16B, a ROM (Read-Only Memory) 16C, and an input / output (I / O) port 16D.

[0034] The control device 16 includes an input / display device 16E connected to the CPU 16A via an I / O port 16D. The input / display device 16E includes a graphical user interface for displaying an image of the detected eye 12 or accepting various instructions from the user. The graphical user interface may be, for example, a touch screen display.

[0035] The control device 16 also includes an image processor 17 connected to the I / O port 16D. The image processor 17 generates an image of the subject's eye 12 based on data obtained by the imaging device 14. The control device 16 is also connected to a network 130 via a communication interface (I / F) 16F.

[0036] As mentioned above, in Figure 2 In the embodiment, the control device 16 of the ophthalmologic device 110 includes the input / display device 16E, but the present disclosure is not limited thereto. For example, the control device 16 of the ophthalmologic device 110 may be configured such that the control device 16 does not include the input / display device 16E, but includes an additional input / display device physically independent of the ophthalmologic device 110. In this case, the display device includes the display control unit 204 (see FIG. 20A ) of the CPU 16A of the control device 16. Figure 4 ) is an image processing processor unit that operates under the control of the display control unit 204. The image processing processor unit can display an SLO image or the like based on an image signal instructed by the display control unit 204 output.

[0037] The imaging device 14 operates under the control of the CPU 16A of the control device 16. The imaging device 14 includes an SLO unit 18, an imaging optical system 19, and an OCT unit 20. The imaging optical system 19 includes an optical scanner 22 and a wide-angle optical system 30.

[0038] The optical scanner 22 two-dimensionally scans the light emitted from the SLO unit 18 in the X direction and the Y direction. The optical scanner 22 may be any optical element capable of deflecting a light beam, and for example, a polygon mirror, a galvano mirror, etc., may be used. In addition, a combination of these may be used.

[0039] The wide-angle optical system 30 combines the light from the SLO unit 18 and the light from the OCT unit 20 .

[0040] In addition, the wide-angle optical system 30 may be a reflective optical system using a concave mirror such as an elliptical mirror, a refractive optical system using a wide-angle mirror, or a reflective refractive optical system combining a concave mirror and a lens. By using a wide-angle optical system using an elliptical mirror, a wide-angle lens, etc., not only the central part of the fundus can be photographed, but also the retina of the peripheral part of the fundus can be photographed.

[0041] When a system including an elliptical mirror is used, a system using an elliptical mirror described in International Publication WO2016 / 103484 or International Publication WO2016 / 103489 may be used. The disclosure of International Publication WO2016 / 103484 and International Publication WO2016 / 103489 are hereby incorporated by reference in their entirety into this specification.

[0042] Observation based on a wide field of view (FOV: Field of View) 12A is achieved in the fundus using a wide-angle optical system 30. FOV12A shows the range that can be photographed using the photographic device 14. FOV12A can be expressed as a viewing angle. In this embodiment, the viewing angle can be specified using an internal illumination angle and an external illumination angle. The external illumination angle refers to an illumination angle obtained by specifying the illumination angle of a light beam irradiated from the ophthalmic device 110 to the detected eye 12 based on the pupil 27. In addition, the internal illumination angle refers to an illumination angle obtained by specifying the illumination angle of a light beam irradiated to the fundus based on the center of the eyeball O. The external illumination angle and the internal illumination angle are in a corresponding relationship. For example, when the external illumination angle is 120 degrees, the internal illumination angle is approximately equivalent to 160 degrees. In this embodiment, the internal illumination angle is set to 200 degrees.

[0043] Here, the SLO fundus image captured at a shooting angle of view of 160 degrees or more at an internal illumination angle is referred to as a UWF-SLO fundus image. In addition, UWF is the abbreviation of Ultra Wide Field. The wide-angle optical system 30 that sets the viewing angle (FOV) of the fundus to an ultra-wide angle can be used to capture the area beyond the equator from the posterior pole of the fundus of the eye to be detected 12, and structures located in the peripheral part of the fundus such as vortex veins can be captured.

[0044] The ophthalmologic apparatus 110 can capture the region 12A with an internal illumination angle of 200°, with the center O of the eyeball of the detected eye 12 as the reference position. In addition, in the case of an internal illumination angle of 200°, the external illumination angle with the pupil of the eyeball of the detected eye 12 as the reference is 110°. That is, the wide-angle optical system 30 irradiates the laser from the pupil at a viewing angle of 110°, and captures the fundus region with an internal illumination angle of 200°.

[0045] SLO system utilization Figure 2 The control device 16, SLO unit 18, and photographic optical system 19 are shown. The SLO system has a wide-angle optical system 30, and thus can realize fundus photography with a wide FOV 12A.

[0046] The SLO unit 18 includes optical systems 48, 50, 52, 54, and 56 that reflect or transmit the light from the light source 40 of B light (blue light), the light source 42 of G light (green light), the light source 44 of R light (red light), and the light source 46 of IR light (infrared light (e.g., near infrared light)), and the light sources 40, 42, 44, and 46, and guide them to one optical path. The optical systems 48 and 56 are reflectors, and the optical systems 50, 52, and 54 are beam splitters. The B light is reflected by the optical system 48, transmitted through the optical system 50, reflected by the optical system 54, the G light is reflected by the optical systems 50 and 54, the R light is transmitted through the optical systems 52 and 54, and the IR light is reflected by the optical systems 52 and 56, and guided to one optical path, respectively.

[0047] The SLO unit 18 is configured to be switchable between a mode of emitting R light and G light and a mode of emitting infrared light, etc., which are light sources emitting laser light of different wavelengths or a combination of light sources. Figure 2 In the example shown, four light sources are provided, namely, a light source 40 for B light, a light source 42 for G light, a light source 44 for R light, and a light source 46 for IR light, but the present disclosure is not limited thereto. For example, the SLO unit 18 may also include a light source for white light, and may be configured to emit light in various modes, such as a mode of emitting G light, R light, and B light, or a mode of emitting only white light.

[0048] The light incident on the photographic optical system 19 from the SLO unit 18 is scanned in the X direction and the Y direction by the optical scanner 22. The scanned light is irradiated to the fundus via the wide-angle optical system 30 and the pupil 27. The reflected light reflected by the fundus is incident on the SLO unit 18 via the wide-angle optical system 30 and the optical scanner 22.

[0049] The SLO unit 18 includes a beam splitter 64 that reflects B light and transmits light other than B light, and a beam splitter 58 that reflects G light and transmits light other than G light, from the light that has passed through the beam splitter 64. The SLO unit 18 includes a beam splitter 60 that reflects R light and transmits light other than R light, from the light that has passed through the beam splitter 58. The SLO unit 18 includes a beam splitter 62 that reflects IR light from the light that has passed through the beam splitter 60. The SLO unit 18 includes a B light detection element 70 that detects B light reflected by the beam splitter 64, a G light detection element 72 that detects G light reflected by the beam splitter 58, an R light detection element 74 that detects R light reflected by the beam splitter 60, and an IR light detection element 76 that detects IR light reflected by the beam splitter 62.

[0050] The light incident on the SLO unit 18 via the wide-angle optical system 30 and the optical scanner 22 (reflected light reflected from the fundus) is reflected by the beam splitter 64 and received by the B light detection element 70 when it is B light, and is reflected by the beam splitter 58 and received by the G light detection element 72 when it is G light. The incident light is transmitted through the beam splitter 58 when it is R light, reflected by the beam splitter 60, and received by the R light detection element 74. The incident light is transmitted through the beam splitters 58 and 60 when it is IR light, reflected by the beam splitter 62, and received by the IR light detection element 76. The image processor 17 operating under the control of the CPU 16A generates a UWF-SLO image using the signals detected by the B light detection element 70, the G light detection element 72, the R light detection element 74, and the IR light detection element 76.

[0051] The UWF-SLO image generated using the signal detected by the B light detection element 70 is called a B-UWF-SLO image (B color fundus image). The UWF-SLO image generated using the signal detected by the G light detection element 72 is called a G-UWF-SLO image (G color fundus image). The UWF-SLO image generated using the signal detected by the R light detection element 74 is called an R-UWF-SLO image (R color fundus image). The UWF-SLO image generated using the signal detected by the IR light detection element 76 is called an IR-UWF-SLO image (IR fundus image). The UWF-SLO image includes these R color fundus images, G color fundus images, B color fundus images to IR fundus images. In addition, it also includes a UWF-SLO image of fluorescence obtained by photographing fluorescence.

[0052] In addition, the control device 16 controls the light sources 40, 42, and 44 to emit light simultaneously. By simultaneously photographing the fundus of the detected eye 12 with G light and R light, a G-color fundus image, an R-color fundus image, and a B-color fundus image corresponding to each other at each position are obtained. An RGB color fundus image is obtained from the G-color fundus image, the R-color fundus image, and the B-color fundus image. The control device 16 controls the light sources 42 and 44 to emit light simultaneously, and by simultaneously photographing the fundus of the detected eye 12 with G light and R light, a G-color fundus image and an R-color fundus image corresponding to each other at each position are obtained. An RG color fundus image is obtained from the G-color fundus image and the R-color fundus image. In addition, a full-color fundus image can also be generated using the G-color fundus image, the R-color fundus image, and the B-color fundus image.

[0053] The wide-angle optical system 30 can set the field of view (FOV) of the fundus to an ultra-wide angle, and can image a region extending beyond the equator of the fundus of the eye 12 to be detected.

[0054] OCT system utilization Figure 2 The control device 16, OCT unit 20, and photographic optical system 19 shown are implemented. The OCT system is equipped with a wide-angle optical system 30, so that, similar to the photography of the SLO fundus image described above, OCT photography of the peripheral part of the fundus can be performed. That is, by using the wide-angle optical system 30 that sets the viewing angle (FOV) of the fundus to an ultra-wide angle, OCT photography of the area beyond the equatorial part 178 from the posterior pole of the fundus of the detected eye 12 can be performed. OCT data of structures in the peripheral part of the fundus where vortex veins exist, etc. can be obtained, and the 3D structure of the vortex veins can be obtained by image processing the tomographic image of the vortex veins and the OCT data.

[0055] The OCT unit 20 includes a light source 20A, a sensor (detection element) 20B, a first optical coupler 20C, a reference optical system 20D, a collimator lens 20E, and a second optical coupler 20F.

[0056] The light emitted from the light source 20A is branched by the first optical coupler 20C. The branched light is collimated into parallel light by the collimator lens 20E as measurement light and then enters the photographic optical system 19. The measurement light is irradiated to the fundus via the wide-angle optical system 30 and the pupil 27. The measurement light reflected at the fundus enters the OCT unit 20 via the wide-angle optical system 30, and enters the second optical coupler 20F via the collimator lens 20E and the first optical coupler 20C.

[0057] The other light emitted from the light source 20A and branched by the first optical coupler 20C enters the reference optical system 20D as reference light, and enters the second optical coupler 20F via the reference optical system 20D.

[0058] The light incident on the second optical coupler 20F, that is, the measurement light and the reference light reflected on the fundus, are interfered by the second optical coupler 20F to generate interference light. The interference light is received by the sensor 20B. Figure 4 ) generates OCT data detected by the sensor 20B. Based on the OCT data, the image processor 17 can also generate OCT images such as tomographic images and en-face images.

[0059] Here, the OCT unit 20 can scan a predetermined range (e.g., a rectangular range of 6 mm×6 mm) by a single OCT imaging. The predetermined range is not limited to 6 mm×6 mm, and can be a square range of 12 mm×12 mm, 23 mm×23 mm, or a rectangular range of 14 mm×9 mm, 6 mm×3.5 mm, etc., and can be set to any rectangular range. In addition, it can be a range of a circle diameter of 6 mm, 12 mm, 23 mm, etc.

[0060] By using the wide-angle optical system 30, the ophthalmologic apparatus 110 can scan the region 12A having an internal irradiation angle of 200 degrees. That is, the ophthalmologic apparatus 110 can perform OCT imaging of a predetermined range including vortex veins by controlling the optical scanner 22. The ophthalmologic apparatus 110 can generate OCT data using this OCT imaging.

[0061] Therefore, the ophthalmologic apparatus 110 can generate a tomographic image (B-scan image) of the fundus including the vortex veins as an OCT image, OCT volume data including the vortex veins, and an en-face image (a front image generated based on the OCT volume data) as a cross-section of the OCT volume data. In addition, of course, the OCT image includes an OCT image of the central part of the fundus (the posterior pole of the eyeball where the macula, optic disc, etc. exist).

[0062] The OCT data (or image data of the OCT image) is sent from the ophthalmic device 110 to the server 140 via the communication interface 16F and stored in the server 140. Figure 3 The storage device 254 described in .

[0063] In the present embodiment, the light source 20A is exemplified by a wavelength scanning type SS-OCT (Swept-Source OCT), but may be an OCT system of various types such as SD-OCT (Spectral-Domain OCT) and TD-OCT (Time-Domain OCT).

[0064] Next, refer to Figure 3 , describing the composition of the electrical system of the server 140. Figure 3 As shown, the server 140 includes a computer body 252. The computer body 252 includes a CPU 262, a RAM 266, a ROM 264, and an input / output (I / O) port 268. The input / output (I / O) port 268 is connected to a storage device 254, a display 256, a mouse 255M, a keyboard 255K, and a communication interface (I / F) 258. The storage device 254 is composed of, for example, a nonvolatile memory. The input / output (I / O) port 268 is connected to the network 130 via the communication interface (I / F) 258. Therefore, the server 140 can communicate with the ophthalmologic apparatus 110 and the viewer 150.

[0065] The image processing program ( Figures 5 to 9 ).

[0066] The ROM 264 or the storage device 254 is an example of the “memory” of the present disclosure. The CPU 262 is an example of the “processor” of the present disclosure. The image processing program is an example of the “program” of the present disclosure.

[0067] The server 140 stores the data received from the ophthalmologic apparatus 110 in the storage device 254 .

[0068] The various functions realized by the CPU 262 of the server 140 executing the image processing program are described below. Figure 4As shown, the image processing program executed by the CPU 262 has a display control function, an image processing function, and a processing function. When the CPU 262 executes the image processing program having these functions, the CPU 262 functions as the display control unit 204, the image processing unit 206, and the processing unit 208.

[0069] The image processing unit 206 is an example of the “image acquisition unit”, “enhancement processing unit”, and “region extraction unit” in the present disclosure.

[0070] Next, use Figure 5 , which illustrates the main flow chart of image processing based on the server 140. The CPU 262 of the server 140 executes the image processing program to achieve Figure 5 The image processing (image processing method) shown.

[0071] First, in step S10, the image processing unit 206 acquires a fundus image from the storage device 254. The fundus image includes data related to vortex veins to be displayed stereoscopically based on the user's instruction.

[0072] Next, in step S20 , the image processing unit 206 acquires the OCT volume data including the choroid corresponding to the fundus image from the storage device 254 .

[0073] In the next step S30 , the image processing unit 206 extracts the choroidal blood vessels based on the OCT volume data, and performs an imaging process of the choroidal blood vessels to generate a stereoscopic image (3D image) of the vortex vein blood vessels (details will be described later).

[0074] If a stereoscopic image (3D image) of the vortex vein is generated, in step S40, the processing unit 208 outputs the generated stereoscopic image (3D image) of the vortex vein, specifically stores it in the RAM 266 or the storage device 254, and ends the image processing.

[0075] Here, based on the user's instruction, the display screen including the stereoscopic image of the vortex vein (described later) Fig.17 The display screen (showing an example of a display screen) is generated by the display control unit 204. The generated display screen is output as an image signal to the viewer 150 by the processing unit 208. The display screen is displayed on the display of the viewer 150.

[0076] Next, use Figure 6 The choroidal blood vessel imaging process of step S30 for generating a stereoscopic image of the vortex vein (VV) will be described in detail.

[0077] Here, Fig.10 The positional relationship between the choroid 12M and the vortex veins 12V1 and V2 in the eyeball is shown.

[0078] exist Fig.10 In FIG. 1 , the grid-like pattern shows the choroidal blood vessels of the choroid 12M. The choroidal blood vessels circulate blood throughout the choroid. Then, the blood flows out of the eyeball from the vortex veins that exist in the test eye 12 in multiple (usually four to six) forms. Fig.10 , the upper vortex vein 12V1 and the lower vortex vein 12V2 existing on one side of the eyeball are shown. The vortex vein is mostly present near the equator. Therefore, in order to photograph the vortex vein existing in the inspected eye 12 and the choroidal blood vessels around the vortex vein, for example, an ophthalmic device 110 capable of scanning at an internal illumination angle of 200° is used.

[0079] First, the image processing unit 206 acquires a fundus image in step S10 and determines a vortex vein (VV) to be displayed in stereoscopic form. Here, as an example, a UWF-SLO image is acquired from the storage device 254 as a UWF fundus image. Next, the image processing unit 206 creates a choroidal vascular image as a binary image based on the acquired UWF-SLO image. Then, the site indicated by the user is determined as a vortex vein to be displayed in stereoscopic form.

[0080] Fig.12 Fundus image of the choroidal vessels including the vortex veins. Fig.12 The fundus image shown is an example of a choroidal vascular image as a binary image created from a UWF-SLO image. Fig.12 As shown in FIG. 1 , the choroidal vascular image is a binarized image in which pixels corresponding to the choroidal vessels and vortex veins are white and pixels in other regions are black.

[0081] in addition, Fig.12 The image 302 shows the presence of choroidal blood vessels connected to the vortex vein. The image 302 shows a situation where the region including the choroidal blood vessels is determined based on the image of the upper vortex vein 12V1 included in the user's designated region 310A, that is, the vortex vein 310V1 is determined as the vortex vein (VV) of the stereoscopic display object.

[0082] The choroidal vascular image including the vortex vein (VV) is generated by performing image processing on the image data of the R-UWF-SLO image (R color fundus image) captured using red light (laser with a wavelength of 630 to 660 nm) and the G-UWF-SLO image (G color fundus image) captured using green light (laser with a wavelength of 500 to 550 nm). Specifically, the retinal blood vessels are extracted from the G color fundus image, the retinal blood vessels are removed from the R color fundus image, and image processing is performed to enhance the choroidal blood vessels, thereby generating a choroidal vascular image. In addition, regarding the method of generating a choroidal vascular image, the entire disclosure of International Publication WO2019 / 181981 is referenced in its entirety and is incorporated into this specification.

[0083] In addition, the above describes the case where the vortex veins of the stereoscopic display object are determined according to the user's instructions, but the present disclosure is not limited to this. The position of the vortex veins of the stereoscopic display object can be detected manually or automatically. In the case of manual detection, for example, it is sufficient to detect the position of the choroidal blood vessels that the user visually observes and indicates. In the case of automatic detection, it is sufficient to extract the choroidal blood vessels from, for example, a choroidal blood vessel image, infer the movement direction (blood vessel travel direction) of each choroidal blood vessel, and infer the position of the vortex veins based on the position where the choroidal blood vessels are concentrated.

[0084] Next, in Figure 6 In step S31, the image processing unit 206 obtains the OCT volume data 400 (see Fig.11 ) extracts a region corresponding to the choroid, and based on the extracted region, extracts (acquires) OCT volume data of the choroid portion.

[0085] like Fig.11 As shown, the OCT volume data 400 is OCT volume data 400 of a predetermined area (e.g., a rectangular area of ​​6 mm×6 mm) including the vortex vein VV, obtained by performing OCT photography of one of the multiple vortex veins VV in the detected eye using the ophthalmic device 110. N planes of different depths from the first plane f401 to the Nth plane f40N are set with respect to the OCT volume data 400. The OCT volume data 400 can be obtained in advance by performing OCT on each of the multiple vortex veins VV in the detected eye using the ophthalmic device 110.

[0086] In this embodiment, the OCT volume data 400 including the vortex vein and the choroidal blood vessels around the vortex vein is described as an example of the OCT volume data 400D. In this case, the choroidal blood vessels refer to the vortex vein and the choroidal blood vessels around the vortex vein.

[0087] Specifically, the image processing unit 206 extracts the following OCT volume data 400D from the OCT volume data scanned in a manner that includes the vortex veins and the choroidal blood vessels around the vortex veins. The OCT volume data 400D is data of the area from the retinal pigment epithelial cell layer 400R (Retinal Pigment Epithelium, hereinafter referred to as the RPE layer) to the area below in the OCT volume data 400 where the choroidal blood vessels are located.

[0088] First, the image processing unit 206 specifies the RPE layer 400R by performing image processing for specifying the boundary surface of each layer on the OCT volume data 400. In addition, the highest brightness layer in the OCT volume data can be specified as the RPE layer 400R.

[0089] Then, the image processing unit 206 extracts pixel data of the choroid region in a predetermined range deeper than the RPE layer 400R (a predetermined range farther than the RPE layer from the center of the eyeball) as OCT volume data 400D. The OCT volume data of the deep region may also be uneven, so the image processing unit 206 may extract pixel data of the choroid region in a predetermined range deeper than the RPE layer 400R as OCT volume data 400D. Fig.11 As shown, the region from the RPE layer 400R to the bottom surface 400E obtained by the above-mentioned image processing for determining the boundary surface is extracted as OCT volume data 400D.

[0090] The region of the choroid within a predetermined range deeper than the RPE layer 400R is an example of the “choroid portion” in the present disclosure.

[0091] Through the above processing, OCT volume data 400D for generating a stereoscopic image of choroidal blood vessels is extracted.

[0092] Next, in step S32, the image processing unit 206 performs a first blood vessel extraction process (extracting the ampulla) using the OCT volume data 400D. The first blood vessel extraction process is a process for extracting choroidal blood vessels (hereinafter referred to as the ampulla) forming the ampulla as the first blood vessel. In the first blood vessel extraction process (extracting the ampulla), Figure 7 The first image processing is shown.

[0093] In step S322, the image processing unit 206 performs binarization processing on the OCT volume data 400D as a pre-processing of the first blood vessel extraction processing (extraction of the ampulla). Specifically, by setting the binarization threshold to a predetermined threshold value that leaves the ampulla of the blood vessel, the ampulla of the blood vessel in the OCT volume data D is a black pixel, and the rest is a white pixel.

[0094] Next, the image processing unit 206 performs a noise removal process to remove the noise region in the binarized OCT volume data 400D in step S324. Specifically, the image processing unit 206 extracts the first choroidal blood vessel, which is the ampulla, from the OCT volume data by removing the noise region from the binarized OCT volume data 400D. Thus, a first stereoscopic image is generated. The noise region is an isolated black pixel region or an area equivalent to a small blood vessel. In order to remove such a noise region, the image processing unit 206 applies a median filter, an open process, or a shrink process to the binarized OCT volume data 400D to remove the noise region.

[0095] Furthermore, in step S326, the image processing unit 206 performs segmentation processing (dynamic contour, graph cutting, or image processing such as U-net) on the OCT volume data from which the noise region has been deleted in order to smooth the surface of the extracted ampulla. This step S326 can be omitted. In addition, the "segmentation" mentioned here refers to image processing that performs a binarization process to separate the background and the foreground with respect to the image to be analyzed.

[0096] By performing the first blood vessel extraction process, only the region of the ampulla is left from the OCT volume data 400D, and a blood vessel extraction image is generated. Fig.13 The stereoscopic image 680B of the blood vessels of the ampulla is shown. The image data of the stereoscopic image 680B of the blood vessels of the ampulla is stored in the RAM 266 by the processing unit 208 .

[0097] Fig.13 The blood vessels of the ampulla shown are examples of the “first choroidal blood vessels” of the present disclosure, and the stereoscopic image 680B of the blood vessels of the ampulla is an example of the “first stereoscopic image” of the present disclosure.

[0098] In addition, the image processing unit 206 Figure 6 In step S33 shown, the second blood vessel extraction process (thick blood vessel extraction) is performed using the OCT volume data 400D. The second blood vessel extraction process is a process for extracting a thick linear second blood vessel extending from the ampulla, which is a choroidal blood vessel (hereinafter referred to as a thick blood vessel) that exceeds a predetermined threshold, that is, a predetermined diameter. In the second blood vessel extraction process (thick blood vessel extraction), the linear second blood vessel extending from the ampulla is extracted. The thick blood vessel mainly refers to a blood vessel arranged in the large blood vessel (Haller) layer. In the second blood vessel extraction process (thick blood vessel extraction), the second blood vessel is extracted. Figure 8 The second image processing is shown.

[0099] In addition, the threshold value (i.e., the predetermined predetermined diameter) may use a predetermined value so that blood vessels with a diameter of several 100 μm are left as thick blood vessels. In addition, the threshold value specified so as to leave thin blood vessels described later may use a value lower than the value of several 100 μm in diameter specified so as to leave thick blood vessels, or may be fixed to a value smaller than the value specified in advance so as to leave thick blood vessels. For example, the predetermined value may be used so as to leave blood vessels with a diameter of several 10 μm as thin blood vessels.

[0100] The image processing unit 206 first Figure 8 In step S331 shown, image processing for pre-processing is performed on the OCT volume data 400D. In one example of pre-processing, blur processing such as noise removal is performed. This blur processing can be applied to eliminate the influence of speckle noise and perform processing for extracting linear blood vessels that accurately reflects the shape of blood vessels. As speckle noise processing, there is, for example, Gaussian blur processing.

[0101] In the next step S332 , the image processing unit 206 performs line extraction processing (extracts thick linear blood vessels) on the pre-processed OCT volume data 400D, thereby extracting the second choroidal blood vessels as thick linear portions from the OCT volume data 400D.

[0102] Specifically, the image processing unit 206 performs image processing using, for example, an intrinsic value filter, a Gabor filter, etc., to extract a linear blood vessel region from the OCT volume data 400D. In the OCT volume data 400D, the blood vessel region is a low-brightness pixel (black pixel), and a region where low-brightness pixels are continuous is left as a blood vessel portion.

[0103] In step S333, the image processing unit 206 performs binarization processing on the OCT volume data 400D. Specifically, by setting the binarization threshold to a predetermined threshold that leaves thick blood vessels, the thick blood vessels in the OCT volume data D are black pixels and the rest are white pixels.

[0104] Furthermore, the image processing unit 206 performs image processing such as deleting isolated regions not connected to surrounding blood vessels, median filter processing, opening processing, and shrinking processing on the extracted and binarized linear blood vessel regions in step S334 to remove discrete micro-regions.

[0105] Through the above-described image processing, a second stereoscopic image related to the second choroidal blood vessels, which are thick blood vessels, is generated.

[0106] By performing the second blood vessel extraction process, only the thick blood vessel region is left from the OCT volume data 400D to generate Fig.13The image data of the stereoscopic image 680L of the thick blood vessel is stored in the RAM 266 by the processing unit 208 .

[0107] in addition, Fig.16 It is shown that using the above image processing ( Figure 5 ) is an example of a stereoscopic image of the choroidal vessels in the vicinity of the vortex vein VV obtained.

[0108] By performing the second blood vessel extraction process, only the thick blood vessel region is left from the OCT volume data 400D to generate Fig.16 The image data of the stereoscopic image 681L of the thick blood vessel is also stored in the RAM 266 by the processing unit 208 .

[0109] Fig.13 as well as Fig.16 The linear blood vessels shown are examples of the “second choroidal blood vessels” of the present disclosure, and the stereoscopic image 680L and the stereoscopic image 681L of the linear blood vessels are examples of the “second stereoscopic image” of the present disclosure.

[0110] The image processing unit 206 performs alignment of the stereoscopic image 680B of the ampulla and the stereoscopic image 680L of the linear blood vessels, and performs a logical sum operation on the two images to synthesize the stereoscopic image 680L of the linear blood vessels and the stereoscopic image 680B of the ampulla. In this way, a stereoscopic image 680M ( Fig.13 ) In the above-mentioned process of extracting thick blood vessels, thin blood vessels smaller than the above-mentioned predetermined diameter may be removed.

[0111] Furthermore, when observing vortex veins, in addition to the thick blood vessels located in the large blood vessel (Haller) layer, it is also important to mainly observe the thin blood vessels arranged in the medium blood vessel (Sattler) layer. For example, the analysis of the thin blood vessels in the medium blood vessel layer will effectively function for the diagnosis of hypertrophic choroidal disease, etc. Therefore, the present disclosure includes a process of extracting a thin line-shaped third blood vessel extending from the ampulla, which is a choroidal blood vessel (hereinafter referred to as a thin blood vessel) below a predetermined threshold value (i.e., a predetermined diameter predetermined in advance).

[0112] Specifically, the image processing unit 206 Figure 6In step S34 shown, the third blood vessel extraction process (extracting thin blood vessels) is performed using the OCT volume data 400D. The third blood vessel extraction process is a process for extracting thin linear third blood vessels extending from the ampulla, and the third blood vessels are choroidal blood vessels (hereinafter referred to as thin blood vessels) below a predetermined threshold value (i.e., a predetermined predetermined diameter). In the third blood vessel extraction process (extracting thin blood vessels), the linear third blood vessels extending from the ampulla are extracted. The thin blood vessels mainly represent blood vessels arranged in the middle blood vessel (Sattler) layer. In the third blood vessel extraction process (extracting thin blood vessels), the third blood vessels are extracted. Fig. 9 The third image processing is shown.

[0113] In the process of extracting the third blood vessel as the small blood vessel, the image processing unit 206 performs pre-processing for the small blood vessel including the first pre-processing and the second pre-processing on the OCT volume data 400D. Fig. 9 In step S341 shown, image processing for performing first pre-processing on the OCT volume data 400D is executed. An example of the first pre-processing is processing for performing noise removal, which is the same blurring processing as in step S331 described above.

[0114] In the next step S342, the image processing unit 206 performs image processing for performing the second pre-processing on the OCT volume data 400D to which the first pre-processing has been performed. Contrast enhancement processing is applied to an example of the second pre-processing. Contrast enhancement processing functions effectively when extracting fine blood vessels. Contrast enhancement processing is a process for increasing the contrast of an image compared to before the processing, that is, increasing the difference between light and dark. For example, the difference between the maximum value and the minimum value of the degree of brightness (e.g., brightness) is increased by a predetermined value from the value of the difference before the processing. The predetermined value can be set appropriately.

[0115] The contrast enhancement process is an example of the “enhancement process” of the present disclosure.

[0116] Fig.14 FIG. 2 shows an example of an image related to the contrast enhancement process applied to the second pre-processing. Fig.14 In the figure, the white image represents the image of the fine blood vessels.

[0117] The image G10 including the fine blood vessels in the OCT volume data 400D has a lower contrast than the image including the thick blood vessels, and when binarization is performed after noise removal, the fine blood vessels may not be depicted as shown in the image G11. Therefore, when contrast enhancement processing (image G12) is performed on the image G10 including the fine blood vessels and binarization is performed, the fine blood vessels appear as continuous lines as shown in the image G13, and the separation of the continuous fine blood vessels can be reduced.

[0118] Furthermore, in step S342 , the image processing unit 206 performs image processing using, for example, an eigenvalue filter, a Gabor filter, or the like, and can extract a region of linear blood vessels, which are capillaries, from the OCT volume data 400D.

[0119] Next, the image processing unit 206 Fig. 9 In step S343, image processing for binarization is performed on the contrast-enhanced OCT volume data 400D. Specifically, by setting the binarization threshold to a predetermined threshold that leaves only small blood vessels, small blood vessels in the OCT volume data D are black pixels, and other portions are white pixels.

[0120] Furthermore, the image processing unit 206 performs the same operation as in step S334 ( Figure 8 ) Similarly, discrete micro-regions are removed from the binarized image (including the region of small blood vessels). Here, image processing such as deleting the region that is inferred to be speckle noise and the region that is isolated at a predetermined distance and is not continuous with the surrounding blood vessels is performed to remove the discrete micro-regions. In addition, the removal of micro-regions can be applied to removing regions that are less than a predetermined area. In addition, it is also possible to remove regions that are predetermined shapes as micro-regions. For example, processing is performed to make the discrete micro-regions approximate to an ellipse, and it is possible to remove the region whose approximate elliptical shape becomes less than a predetermined ellipticity as the region to be removed.

[0121] In the next step S345, the image processing unit 206 performs fine region connection processing on the OCT volume data 400D from which the fine region is removed as post-processing, thereby extracting the third choroidal blood vessels as fine blood vessels in the thin line-shaped portion from the OCT volume data 400D. Specifically, the image processing unit 206 performs image processing such as morphological processing using closing processing, etc., and connects the discretely detected fine blood vessels, thereby extracting the third choroidal blood vessels as fine blood vessels from the OCT volume data 400D. Specifically, the third choroidal blood vessels within a predetermined distance that is predetermined in advance are connected.

[0122] The fine region connection process is an example of the “connection process” of the present disclosure.

[0123] Fig.15 An example of an image related to fine region connection processing is shown. Fig.15 In the figure, the white image represents the image of the fine blood vessels.

[0124] Sometimes, the curvature of a thin blood vessel becomes larger than that of a thick blood vessel. Sometimes, when the above-mentioned line extraction process is performed on an image including a thin blood vessel having a larger curvature than that of the thick blood vessel ( Figure 8Therefore, when the image G20 including the fine blood vessels in the OCT volume data 400D is binarized, as shown in the image G21, the part with large curvature in the fine blood vessels may not be drawn. Therefore, by performing the fine region connection processing on the image G21, as shown in the image G22, even the fine blood vessels with large curvature appear as continuous lines, and the separation of continuous fine blood vessels can be reduced.

[0125] Furthermore, in step S346, the image processing unit 206 performs segmentation processing (dynamic contour, graph cutting, or U-net or other image processing) on ​​the OCT volume data connected to the fine region in order to smooth the surface of the extracted fine blood vessels. In other words, the image to be analyzed performs processing to separate the background and foreground.

[0126] Through the above image processing, a third stereoscopic image related to the third choroidal blood vessels, which are thin blood vessels, is generated.

[0127] By performing the third blood vessel extraction process, only the region of the thin blood vessels is left from the OCT volume data 400D, and a Fig.16 The image data of the stereoscopic image 681S of the capillary blood vessels is stored in the RAM 266 by the processing unit 208 .

[0128] Fig.16 The linear blood vessels shown as the capillaries are examples of the “third choroidal blood vessels” of the present disclosure, and the stereoscopic image 681S of the capillaries is an example of the “third stereoscopic image” of the present disclosure.

[0129] The processing of steps S32, S33, and S34 is not limited to the above processing order, and one of the processing may be executed first, or they may be performed simultaneously in parallel.

[0130] When the processing of steps S32, S33, and S34 is completed, in step S35, the image processing unit 206 reads the stereoscopic image of the ampulla, the stereoscopic image of the thick blood vessels, and the stereoscopic image of the thin blood vessels from the RAM 266. Then, these stereoscopic images are aligned, and the logical sum of each image is calculated, thereby synthesizing the stereoscopic image of the ampulla, the stereoscopic image of the thick blood vessels, and the stereoscopic image of the thin blood vessels. In this way, a stereoscopic image 681M of the choroidal blood vessels including the vortex veins is generated (see Fig.16 ). The image data of the stereoscopic image 681M is stored in the RAM 266 and the storage device 254 by the processing unit 208 .

[0131] The stereoscopic image 681M of the choroidal blood vessels including the vortex veins is an example of the “stereoscopic image of the choroidal blood vessels” of the present disclosure.

[0132] The following describes a display screen for displaying a generated stereoscopic image (3D image) of choroidal blood vessels including vortex veins. The display screen is generated by the display control unit 204 of the server 140 based on the user's instruction, and is output as an image signal to the viewer 150 through the processing unit 208. The viewer 150 displays the display screen on the display based on the image signal.

[0133] exist Fig.17 Display screen 500A is shown in FIG. Fig.17 As shown, display screen 500A has information area 502 and image display area 504A. Image display area 504A includes comment field 506 for displaying the patient's treatment history.

[0134] The information area 502 includes a patient ID display field 512, a patient name display field 514, an age display field 516, a visual acuity display field 518, a right eye / left eye display field 520, and an axial length display field 522. In each display area from the patient ID display field 512 to the axial length display field 522, the viewer 150 displays each information based on the information received from the server 140.

[0135] The image display area 504A is mainly an area for displaying images of the detected eye, etc. The image display area 504A is provided with the following display fields, specifically, a UWF fundus image display field 542 and a choroidal vascular stereoscopic image display field 548. Although not shown, in the image display area 504A, an OCT volume data conceptual diagram display field and a tomographic image display field 546 can be displayed in an overlapping manner.

[0136] The comment field 506 included in the image display area 504A functions as a display of the patient's treatment history and as a remark column in which the user's ophthalmologist's observation results and diagnosis results can be arbitrarily input.

[0137] The UWF-SLO fundus image 542B obtained by photographing the fundus of the eye under examination using the ophthalmologic apparatus 110 is displayed in the UWF fundus image display field 542. A range 542A indicating the position where the OCT volume data was acquired is displayed superimposed on the UWF-SLO fundus image 542B. When there are multiple OCT volume data associated with the UWF-SLO image, multiple ranges are displayed superimposed, and the user can select a position from the multiple ranges. Fig.17 , the scan range including the vortex vein in the upper right of the UWF-SLO image is shown.

[0138] The choroidal vascular stereoscopic image display field 548 displays a stereoscopic image (3D image) 548B of the choroidal vascular system obtained by image processing the OCT volume data. The stereoscopic image 548B can be rotated along three axes according to the user's operation. In addition, the choroidal vascular stereoscopic image 548B can display the image of the second choroidal vascular system (stereoscopic image of thick blood vessels) and the image of the third choroidal vascular system (stereoscopic image of thin blood vessels) extending from the ampulla 548X in different display forms. Fig.17 In the figure, the stereoscopic image 548L of the thick blood vessels extending from the ampulla 548X is indicated by solid lines, and the stereoscopic image 548S of the thin blood vessels can also be indicated by dotted lines. In addition, the stereoscopic image 548L of the thick blood vessels and the stereoscopic image 548S of the thin blood vessels can be displayed in different colors, and the background (filling) of the image can also be made different in form.

[0139] In addition, in the choroidal blood vessel stereoscopic image display area 548, the layer obtained by the segmentation process can be displayed superimposed on the above-mentioned OCT volume data. Fig.17 , an example of displaying a layer boundary 548T with a long dashed line is shown. This boundary 548T can be used as a standard for identifying the large blood vessel layer and the medium blood vessel layer.

[0140] The image display area 504A of the display screen 500A can confirm a stereoscopic image of choroidal blood vessels including thick blood vessels and thin blood vessels. If the range including the vortex vein is scanned, the choroidal blood vessels including the vortex vein and the thick blood vessels and thin blood vessels around it can be displayed in a stereoscopic image, and the user can obtain more information for diagnosis.

[0141] In addition, the position of the OCT volume data on the UWF-SLO image can be grasped based on the image display area 504A.

[0142] Furthermore, the cross section of the stereoscopic image can be arbitrarily selected according to the image display area 504A, and the user can obtain detailed information on the choroidal blood vessels by displaying the tomographic image.

[0143] In addition, in the stereoscopic display of choroidal blood vessels based on this embodiment, OCT-A (OCT-angiography) is not used, and the stereoscopic display of choroidal blood vessels can be performed. A stereoscopic image of choroidal blood vessels can be generated without performing a complex and computationally intensive process of taking a difference in OCT volume data and obtaining a dynamic contrast. In order to take a difference in OCT-A, multiple OCT volume data are required at different times, but in this embodiment, a dynamic contrast extraction process is not performed, and a stereoscopic image of choroidal blood vessels can be generated based on a single OCT volume data.

[0144] As described above, in this embodiment, choroidal blood vessels including vortex veins and their surrounding thick and thin blood vessels are extracted based on OCT volume data including the choroid, and a stereoscopic image of each choroidal blood vessel is generated, thereby enabling the choroid including the thick and thin blood vessels to be three-dimensionally visualized.

[0145] In addition, in the present embodiment, a stereoscopic image of choroidal blood vessels including thick blood vessels and thin blood vessels is generated based on OCT volume data without using OCT-A (OCT-angiography). Therefore, in the present embodiment, a complex and computationally intensive process of taking a difference in OCT volume data and extracting dynamic contrast is not performed, and a stereoscopic image of choroidal blood vessels including thick blood vessels and thin blood vessels can be generated, which can reduce the amount of calculation.

[0146] In the above-mentioned embodiment, the image processing ( Figure 5 ) is executed by the server 140, but the present disclosure is not limited to this and can be executed by an additional image processing device further provided in the ophthalmologic apparatus 110, the viewer 150, or the network 130.

[0147] In the present disclosure, each constituent element (device, etc.) may exist in only one or in two or more forms, unless a contradiction occurs.

[0148] In each of the examples described above, the case where image processing is implemented by utilizing the software configuration of a computer is illustrated, but the present disclosure is not limited to this, and at least a portion of the processing may be implemented by utilizing a hardware configuration. In addition, the above description uses a CPU as an example of a general-purpose processor, but a processor refers to a processor in a broad sense, including a general-purpose processor (e.g., CPU: Central Processing Unit, etc.), a dedicated processor (e.g., GPU: Graphics Processing Unit, ASIC: Application Specific Integrated Circuit, FPGA: Field Programmable Gate Array, programmable logic device, etc.). Therefore, image processing may be performed using only a hardware configuration, or a portion of the image processing may be performed using a software configuration, and the remaining processing may be performed using a hardware configuration.

[0149] In addition, the operations of the above-mentioned processors may be executed not only by one processor but also by a plurality of processors in cooperation with each other, or by a plurality of processors located in physically separated positions in cooperation with each other.

[0150] Furthermore, in order to execute the above-described processing by a computer, a program in which the above-described processing is described using codes that can be processed by a computer may be stored in a storage medium such as an optical disk and distributed.

[0151] As described above, the present disclosure includes both cases where image processing is realized by a software configuration using a computer and cases where it is not realized, and therefore includes the following techniques.

[0152] (First Technology)

[0153] An image processing device comprising:

[0154] an acquisition unit for acquiring OCT volume data including the choroid;

[0155] The generating unit extracts choroidal blood vessels exceeding a predetermined diameter and choroidal blood vessels below the predetermined diameter based on the OCT volume data, and generates a stereoscopic image of the choroidal blood vessels.

[0156] (Second Technology)

[0157] An image processing method, comprising:

[0158] The acquisition unit acquires OCT volume data including the choroid; and

[0159] The generation unit extracts choroidal blood vessels exceeding a predetermined diameter and choroidal blood vessels below the predetermined diameter based on the OCT volume data, and generates a stereoscopic image of the choroidal blood vessels.

[0160] The image processing unit 206 is an example of the “acquisition unit” and the “generation unit” in the present disclosure.

[0161] The following techniques are proposed from the above disclosure.

[0162] (Third Technology)

[0163] In a computer program product for performing image processing,

[0164] The computer program product itself has a computer-readable storage medium which is not a temporary signal,

[0165] The computer readable storage medium stores a program.

[0166] The program causes the processor to process the following steps:

[0167] The step of acquiring OCT volume data including the choroid;

[0168] A step of extracting choroidal blood vessels exceeding a predetermined diameter and choroidal blood vessels below the predetermined diameter based on the OCT volume data, and generating a stereoscopic image of the choroidal blood vessels.

[0169] The server 140 is an example of a “computer program product” in the present disclosure.

[0170] The above-mentioned embodiments are used to explain the technology of the present disclosure, but the above-mentioned image processing is only an example, and the technical scope of the present disclosure is not limited to the scope described in the above-mentioned embodiments. Therefore, it is possible to delete unnecessary processing within the scope of the main purpose, or add new processing, or interchange the processing order, etc. to add various changes or improvements to the above-mentioned embodiments, and the form of adding such changes or improvements is also included in the scope of the technology of the present disclosure.

[0171] In addition, the disclosure of Japanese Patent Application No. 2022-066635 is incorporated herein by reference in its entirety. All documents, patent applications, and technical standards described in this specification are incorporated herein by reference as if each document, patent application, and technical standard were specifically and individually described as being cited by reference.

Claims

1. An image processing method, which is performed by a processor, wherein the image processing method is characterized in that it includes: The step of acquiring an image of the choroid; A step of performing an enhancement process to enhance the contrast of the acquired image; A step of performing a binarization process on the image subjected to the enhancement process; as well as A step of extracting a region corresponding to choroidal blood vessels in the choroid from the image subjected to the binarization process.

2. The image processing method according to claim 1, characterized in that: The step of extracting the region corresponding to the choroidal blood vessels includes the step of performing a connection process of connecting the plurality of extracted regions.

3. The image processing method according to claim 2, characterized in that: In the step of performing the linking process, An expansion process is performed to expand each of the first region and the second region as the plurality of regions extracted, and an end portion of the first region and an end portion of the second region intersecting due to the expansion are connected.

4. The image processing method according to claim 2, characterized in that: In the step of performing the linking process, The first region and the second region, which are the plurality of regions to be extracted, are respectively extended in the long axis direction, and the end of the first region and the end of the second region that intersect due to the extension are connected.

5. The image processing method according to any one of claims 1 to 4, characterized in that: The step of extracting the region corresponding to the choroidal blood vessels includes the step of removing the region discretely extracted in the image.

6. The image processing method according to any one of claims 1 to 5, characterized in that: It also includes the following steps: A choroidal blood vessel image is generated based on the extracted region corresponding to the choroidal blood vessels.

7. The image processing method according to claim 6, characterized in that: The step of generating the choroidal blood vessel image comprises: A step of generating a first choroidal blood vessel image based on the first region extracted from the image acquired in the first step, wherein the first step includes a step of performing the enhancement process, a step of performing the binarization process, and a step of extracting a region corresponding to the choroidal blood vessel; A step of generating a second choroidal blood vessel image based on a second region extracted from the image in a second step different from the first step, the second region corresponding to another choroidal blood vessel having a diameter different from that of the choroidal blood vessel; and The step of synthesizing the first choroidal vascular image and the second choroidal vascular image to generate the choroidal vascular image.

8. The image processing method according to claim 7, characterized in that: The step of generating the choroidal blood vessel image comprises: The step of generating the first choroidal blood vessel image; The step of generating the second choroidal blood vessel image; A step of generating a third choroidal blood vessel image based on a third region extracted from the image in a third step different from the first step and the second step, the third region corresponding to a choroidal blood vessel different from the choroidal blood vessel and the other choroidal blood vessels; and The step of synthesizing the first choroidal vascular image, the second choroidal vascular image, and the third choroidal vascular image to generate the choroidal vascular image.

9. The image processing method according to any one of claims 1 to 8, characterized in that: It also includes the following steps: Based on the multiple choroidal vascular images, a stereoscopic image of the choroidal vascular is generated.

10. The image processing method according to claim 8, characterized in that: It also includes the following steps: A stereoscopic image of the choroidal blood vessels is generated based on the first choroidal blood vessel image and the second choroidal blood vessel image.

11. The image processing method according to any one of claims 1 to 10, characterized in that: In the step of acquiring the image, the image is acquired by scanning a region including at least the vortex veins of the fundus.

12. An image processing device, characterized in that: have: an image acquisition unit that acquires an image of the choroid; an enhancement processing unit, which performs enhancement processing for enhancing the contrast of the acquired image; A binarization processing unit that performs binarization processing on the image subjected to the enhancement processing; and A region extracting unit extracts a region corresponding to a choroidal blood vessel in the choroid from the image after the binarization process.

13. A program for performing image processing, wherein the program is characterized in that: Let the processor process the following steps: Acquiring an image of the choroid; Performing enhancement processing to enhance the contrast of the acquired image; performing a binarization process on the image subjected to the enhancement process; as well as A region corresponding to the choroidal blood vessels in the choroid is extracted from the image after the binarization process.