Ophthalmic image processing program and ophthalmic image processing device

Abstract

To favorably compare information based on OCT data and information based on OCT motion contrast data.SOLUTION: An ophthalmologic image processing program causes a computer to execute: an acquisition step of acquiring three-dimensional OCT data and three-dimensional MC data of a subject eye; a setting step of setting a first slab for the three-dimensional OCT data and a second slab for the three-dimensional MC data; a calculation processing step of acquiring a front OCT image and a shape analysis map based on the first slab of the three-dimensional OCT data as first information and a front MC image or a blood vessel analysis map based on the second slab of the three-dimensional MC data as second information; and a display control step of simultaneously displaying the first information and the second information. The setting step independently sets the depth positions of the first slab and the second slab.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The present disclosure relates to an ophthalmic image processing program and an ophthalmic image processing device. [Background technology]

[0002] By performing various processes on OCT data obtained by optical coherent tomography (OCT), various information can be obtained depending on the processing content. For example, images showing the morphology (structure) of the subject's eye and analysis results related to the morphology (structure) can be obtained. The examiner uses the various information obtained from the OCT data to understand the condition of the subject's eye.

[0003] For example, the fundus has a layered structure based on the composition of nerve cells, etc. The layered structure of the fundus can be visualized using OCT data.

[0004] For example, several vascular networks exist at different depths in the fundus. Furthermore, for example, a vascular network caused by neovascularization may occur near a lesion. The vascular structure in the vascular network is visualized using motion contrast data. Motion contrast data is generated based on multiple OCT data taken at different times at the same measurement position. Motion contrast is information that captures, for example, blood flow in the subject's eye or changes in retinal tissue.

[0005] Patent Document 1 discloses a technology that makes it easy to compare a vascular analysis map based on motion contrast data and a morphological analysis map based on OCT data by generating them for a common layer region and displaying them side by side. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Japanese Patent Application Publication No. 2017-077414 Summary of the Invention [Problem to be solved by the invention]

[0007] In the fundus, the depth position of each layer and the depth position of each vascular network do not necessarily coincide anatomically. Furthermore, when observing a lesion, OCT data is used to determine the size of the lesion, while motion contrast data may be used to identify the abnormal vascular network associated with the lesion. In this case, the lesion and the abnormal vascular network that the examiner wants to confirm may be located at different depths.

[0008] For this reason, there are cases where it is desired to compare information based on OCT data with information based on motion contrast data such as a blood vessel image or a blood vessel analysis map between different layer regions.

[0009] Therefore, the present inventors have investigated a method for more appropriately setting regions to be compared for each of information based on OCT data and information based on motion contrast data.

[0010] In view of at least one of the problems of the prior art, the present disclosure has as its technical objective the provision of an ophthalmic image processing program and an ophthalmic image processing device that can effectively compare information based on OCT data with information based on OCT motion contrast data. [Means for solving the problem]

[0011] An ophthalmologic image processing program according to a first aspect of the present disclosure includes, when executed by a processor of a computer, an acquisition step of acquiring three-dimensional OCT data and three-dimensional motion contrast data of a subject's eye, and a setting step of setting a first slab for the three-dimensional OCT data and a second slab for the three-dimensional motion contrast data. a setting step of independently setting the depth positions of the first slab and the second slab; and acquiring a frontal OCT image or a morphological analysis map based on the first slab of the three-dimensional OCT data as first information, and acquiring a frontal OCT image or a morphological analysis map based on the second slab of the three-dimensional motion contrast data as first information. Motion Contrastan ophthalmologic image processing program that causes a computer to execute a calculation step of acquiring an image or a vascular analysis map as second information, and a display control step of simultaneously displaying the first information and the second information, wherein the setting step includes: The method includes a first setting step of setting the first slab or the second slab for either the three-dimensional OCT data or the three-dimensional motion contrast data, and a second setting step of setting the first slab or the second slab for the other of the three-dimensional OCT data and the three-dimensional motion contrast data according to the features included in the section of the slab set in the first setting step. An ophthalmologic image processing program according to a second aspect of the present disclosure is executed by a processor of a computer, and includes: an acquisition step of acquiring three-dimensional OCT data and three-dimensional motion contrast data of a subject's eye; a setting step of setting a first slab for the three-dimensional OCT data and a second slab for the three-dimensional motion contrast data, wherein depth positions of the first slab and the second slab are set independently; and a setting step of acquiring a front OCT image or a morphological analysis map based on the first slab of the three-dimensional OCT data as first information, and acquiring a front motion contrast image or a vascular analysis map based on the second slab of the three-dimensional motion contrast data. An ophthalmologic image processing program that causes a computer to execute a calculation step of acquiring a map as second information, and a display control step of simultaneously displaying the first information and the second information, wherein when the first slab and the second slab are set to different depth positions in the setting step, the program further executes a modification step of changing the depthwise positions of the first slab and the second slab in accordance with a common operation input while maintaining the relative positional relationship between the first slab and the second slab, and in the display control step, simultaneously displays the first information based on the first slab and the second information based on the second slab after each has been changed in the modification step.

[0012] The present disclosure 3 The ophthalmologic image processing device according to the aspect includes: According to the first or second aspect Run the ophthalmic image processing program. [Effects of the Invention]

[0013] According to the present disclosure, it is possible to more appropriately set regions to be compared for each of information based on OCT data and information based on motion contrast data. [Brief explanation of the drawings]

[0014] [Figure 1] 1 is a block diagram showing an outline of the present embodiment; [Figure 2] FIG. 1 is a diagram illustrating an example of an optical system of an OCT device. [Figure 3] FIG. 10 is a diagram illustrating acquisition of motion contrast. [Figure 4] FIG. 10 is a diagram showing a comparison screen according to the first embodiment. [Figure 5] FIG. 10 is a diagram for explaining an example of slab settings suitable for each disease. [Figure 6] FIG. 10 is a diagram showing a comparison screen according to the second embodiment. [Figure 7] FIG. 11 is a diagram showing a comparison screen according to the third embodiment. [Figure 8] FIG. 13 is a diagram showing a comparison screen according to the fourth embodiment. [Figure 9] FIG. 13 is a diagram showing a comparison screen according to the fifth embodiment. [Figure 10] FIG. 10 is a diagram showing a display mode of a tomographic image for checking the setting state of a slab. DETAILED DESCRIPTION OF THE INVENTION

[0015] "overview" The ophthalmologic image processing device (computer) exemplified in the present disclosure executes an ophthalmologic image processing program using a processor, thereby executing at least an acquisition step, a setting step, a calculation processing step, and a display control step.

[0016] In the acquisition step, three-dimensional OCT data of the subject's eye and three-dimensional motion contrast data of the subject's eye are acquired. For ease of explanation, the motion contrast data will be referred to as "MC data" hereinafter. In the setting step, a first slab in the depth direction is set for the three-dimensional OCT data. Similarly, a second slab in the depth direction is set for the three-dimensional MC data. In the calculation step, a front image or an analysis map based on the first slab of the three-dimensional OCT data is acquired as first information. In the calculation step, a front image or an analysis map based on the three-dimensional MC data of the second slab is acquired as second information. The first information and the second information are simultaneously displayed in the display control step.

[0017] Note that a front image based on 3D OCT data is also referred to as a front OCT image, and an analysis map based on 3D OCT data is also referred to as a morphological analysis map. A front image based on 3D MC data is also referred to as a front MC image, and an analysis map based on 3D MC data is also referred to as a vascular analysis map. Furthermore, a front OCT image and a front MC image are also referred to as en-face images.

[0018] In this embodiment, a slab is, for example, a layer region at a certain depth position in each of the OCT data and the MC data. The layer region to be a slab may be set to include a region sandwiched between two layer boundaries, or may be set as a region near one of the layer boundaries. Furthermore, the slab may be set automatically based on, for example, a segmentation process for either the OCT data or the MC data. Alternatively, the slab may be set manually based on an operational input.

[0019] In this embodiment, in the setting step, the depth positions of the first slab for the 3D OCT data and the second slab for the 3D MC data are set independently. In this case, the depth positions of the upper end (hereinafter also referred to as the starting layer) and the lower end (hereinafter also referred to as the ending layer) of each slab may be set independently.

[0020] For example, even if the region where an abnormality in the layer structure occurs due to a disease and the region where an abnormality in the vascular network occurs are different, the first slab and the second slab can be set appropriately for each. As a result, the region to be compared can be set more appropriately, and the first information (a frontal OCT image or a morphological analysis map based on the first slab of the 3D OCT data) and the second information (a frontal MC image or a vascular analysis map based on the second slab of the 3D MC data) can be simultaneously displayed.

[0021] Furthermore, each analysis map may be, for example, a two-dimensional graph showing a two-dimensional distribution of measurement results for the subject's eye. More specifically, each analysis map may be a color map color-coded according to the measurement value. A morphological analysis map based on 3D OCT data may be, for example, a map of layer thickness, a map of the degree of structural abnormality, or a map of other measurement results. The degree of structural abnormality may be obtained based on a probability distribution obtained by inputting 3D OCT data into a trained model that acquires a probability distribution for identifying tissue in an image (for more details, see Japanese Patent Application Laid-Open No. 2020-18794 filed by the present applicant). A vascular analysis map based on 3D MC data may be, for example, a map of vascular density. Each analysis map may be a map showing the measurement value itself, a comparison map or deviation map showing the results of a comparison with a normal eye, or a follow-up analysis map showing the difference from measurements obtained on other examination dates. For further specific methods for generating morphological analysis maps and vascular analysis maps, see, for example, Patent Document 1, cited above.

[0022] <Change (reset) the first and second slabs> The ophthalmologic image processing program of this embodiment may further cause the ophthalmologic image processing device to execute a modification step. The modification step modifies the depthwise positions of the first slab and the second slab while maintaining the relative positional relationship between the first slab and the second slab. In this case, the positional relationship between the centers of the slabs may be maintained before and after the modification, or the positional relationship between the boundary positions of the slabs may be maintained. The first information based on the first slab and the second information based on the second slab after each modification by the modification step are simultaneously displayed by a display control step.

[0023] Furthermore, the change step may alternatively execute a first change process or a second change process. This changes each of the first slab and the second slab using a method appropriate for the process. In the first change process, as described above, the positions of the first slab and the second slab in the depth direction are changed while maintaining the relative positional relationship between the first slab and the second slab. Meanwhile, in the second change process, the positions of the first slab and the second slab in the depth direction are changed independently.

[0024] <Slab settings using configuration information> Furthermore, for example, a plurality of pieces of setting information defining combinations of depth positions of the first slab and the second slab may be prepared in advance, and in the setting step, one of the plurality of pieces of setting information may be selected for each subject's eye. Each piece of setting information may differ from other pieces of setting information in either or both of the boundary position in the first slab and the boundary position in the second slab. The first slab and the second slab may be set based on the selected setting information.

[0025] Since one of the combinations of depth positions of the first slab and the second slab prepared in advance is selected according to the eye to be examined, for example, the task of setting the first slab and the second slab according to the eye to be examined becomes easy.

[0026] In this case, the ophthalmologic image processing program may further cause the ophthalmologic image processing device to execute an operation accepting step. In the operation accepting step, a selection operation of setting information is accepted. As a result, the first slab and the second slab are set based on the selected setting information.

[0027] <Setting information is prepared for each disease type> For example, the setting information may be prepared for each type of disease. That is, each piece of setting information may specify a combination of the depth position of the first slab and the depth position of the second slab according to the type of disease. In the setting step, information indicating the type of disease in the subject's eye (hereinafter referred to as disease information) is acquired, and the first slab and the second slab are set to appropriate depth positions according to the type of disease. Therefore, the first information and the second information are displayed appropriately according to the type of disease, and the two can be compared visually.

[0028] A disease information acquiring step may further be executed to acquire information identifying disease information in the subject's eye.

[0029] The disease information may be acquired based on, for example, an operation input by an examiner. Alternatively, the ID or the like of a subject, which is information indicating past diagnostic and test results for the subject, may be associated in advance with the disease information, and the disease information may be acquired based on the ID or the like of the subject.

[0030] Alternatively, disease information may be acquired as a processing result of at least one of 3D OCT data, 3D MC data, and other test results (hereinafter collectively referred to as test data). For example, a process for detecting features in the test data may be performed on the test data. The features may be features indicating abnormalities associated with a disease. The features to be detected may be, for example, image features that appear when the 3D OCT data, 3D MC data, etc. are visualized, or quantitative features that appear when the test data are analyzed. The quantitative features may be features in a morphological analysis map or a vascular analysis map. In this case, the features may be detected based on, for example, image processing or analysis processing of the 3D OCT data or 3D MC data. In the feature detection process, a specific type of feature may be detected, or multiple types of features may be detected while distinguishing the type of feature. The presence or absence of a feature (and the type) may be manually input.

[0031] <If one slab is set manually, the other slab is set automatically> Furthermore, for example, in the operation receiving step, an operation for specifying the depth position of the first slab or the second slab for either the three-dimensional OCT data or the three-dimensional MC data may be received as a selection operation.

[0032] When the depth position of the first or second slab is specified for either the 3D OCT data or the 3D MC data by a selection operation, the first or second slab for the other (remaining) of the 3D OCT data or the 3D MC data is automatically set according to the specified depth position. In this case, a combination corresponding to the depth position of the first or second slab specified by the selection operation may be selected from a plurality of combinations of first and second slabs prepared in advance as setting information. Note that in this case, the selection operation may be an operation of specifying the upper and lower ends of the first or second slab, an operation of specifying a reference position (e.g., the depth position of the center), or an operation of selecting a tissue to be set as the first or second slab.

[0033] <Setting one slab according to the characteristics present in the other slab section> When a first or second slab is set for either the 3D OCT data or the 3D MC data (initial slab setting), the first or second slab may be set for the other (the remaining one) of the 3D OCT data and the 3D MC data according to the features included in the slab section of the first slab. In this way, the layer region to be compared between the 3D OCT data and the 3D MC data is appropriately set according to the features included in the slab section set in the initial slab setting.

[0034] Here, the initial slab setting for one of the 3D OCT data and the 3D MC data may be performed based on, for example, a setting operation. Alternatively, the initial slab setting may be automatically set without requiring a setting operation. For example, the first slab or the second slab may be automatically set to a depth region predetermined as a default value in one of the 3D OCT data and the 3D MC data.

[0035] In either the 3D OCT data or the 3D MC data, the features included in the slab section based on the initial slab setting may be features indicating abnormalities associated with a disease. The process of detecting features from the slab section in either the 3D OCT data or the 3D MC data can use the method described in the section <Setting information is prepared for each disease type>. The presence or absence of features (and the type) may also be manually input. In this case, when the initial slab setting is performed, the first information or second information corresponding to the slab section based on the initial slab setting may be displayed, and an input operation for the presence or absence of features (and the type) may be accepted.

[0036] <First Example> Examples of embodiments of the present disclosure will be described with reference to the drawings. Unless otherwise specified, the device configurations of the examples are the same.

[0037] An ophthalmologic image processing apparatus 1 shown in FIG. 1 processes OCT data and MC data acquired via an OCT device 10.

[0038] The ophthalmologic image processing device 1 includes, for example, a control unit 70. The control unit 70 is realized, for example, by a general CPU (Central Processing Unit) 71, a flash ROM 72, a RAM 73, etc. The flash ROM 72 stores, for example, an ophthalmologic image processing program for processing OCT data and MC data, a program for controlling the operation of the OCT device 10 to obtain OCT data and MC data, initial values, etc. The RAM 73 temporarily stores, for example, various types of information.

[0039] 1, the control unit 70 is electrically connected to, for example, a storage unit (e.g., non-volatile memory) 74, an operation unit 76, and a display unit 75. The storage unit 74 is, for example, a non-transitory storage medium that can retain stored contents even when the power supply is cut off. For example, a hard disk drive, a flash ROM, a removable USB memory, etc. can be used as the storage unit 74.

[0040] In the operation unit 76, various operation instructions by the examiner are input. The operation unit 76 outputs a signal corresponding to the input operation instruction to the CPU 71. The operation unit 76 may be at least any one of user interfaces such as a mouse, a joystick, a keyboard, a touch panel, etc.

[0041] The display unit 75 may be a display mounted on the main body of the apparatus 1 or a display connected to the main body. For example, a display of a personal computer (hereinafter referred to as "PC") may be used. The display unit 75 displays, for example, OCT data and MC data obtained by the OCT device 10.

[0042] Note that, for example, an OCT device 10 is connected to the ophthalmic image processing apparatus 1 of the first embodiment. The ophthalmic image processing apparatus 1 may have an integrated configuration housed in the same housing as the OCT device 10, for example, or may have a separate configuration. The control unit 70 may acquire MC data from the connected OCT device 10. The control unit 70 may acquire OCT data and MC data obtained by the OCT device 10 via a storage medium.

[0043] <OCT device> Hereinafter, the outline of the OCT device 10 will be described based on FIG. 2. For example, the OCT device 10 irradiates the test eye E with measurement light and acquires an OCT signal obtained by the reflected light and the measurement light. The OCT device 10 mainly includes, for example, an OCT optical system 100.

[0044] <OCT optical system> The OCT optical system 100 irradiates the test eye E with measurement light and detects an interference signal between the reflected light and the reference light. The OCT optical system 100 mainly includes, for example, a measurement light source 102, a coupler (optical splitter) 104, a measurement optical system 106, a reference optical system 110, a detector 120, etc. For the detailed configuration of the OCT optical system, refer to, for example, Japanese Patent Laid-Open No. 2015-131107.

[0045] The OCT optical system 100 is an optical system for so-called optical coherence tomography (OCT). The OCT optical system 100 splits light emitted from a measurement light source 102 into measurement light (sample light) and reference light using a coupler 104. The split measurement light is guided to a measurement optical system 106, and the split reference light is guided to a reference optical system 110. The measurement light is guided to the fundus Ef of the subject's eye E via the measurement optical system 106. Thereafter, interference light resulting from the combination of the measurement light reflected by the subject's eye E and the reference light is received by a detector 120.

[0046] The measurement optical system 106 includes, for example, a scanning unit (e.g., an optical scanner) 108. The scanning unit 108 may be provided to scan the measurement light in the X and Y directions (transverse directions) on the fundus. For example, the CPU 71 controls the operation of the scanning unit 108 based on set scanning position information and acquires an OCT signal based on a light reception signal detected by the detector 120. The reference optical system 110 generates reference light to be combined with reflected light acquired by reflection of the measurement light on the fundus Ef. The reference optical system 110 may be a Michelson type or a Mach-Zehnder type.

[0047] The detector 120 detects the interference state between the measurement light and the reference light. In the case of Fourier domain OCT, the detector 120 detects the spectral intensity of the interference light, and a depth profile (A-scan signal) in a predetermined range is acquired by Fourier transforming the spectral intensity data.

[0048] The OCT device 10 may be, for example, a spectral-domain OCT (SD-OCT), a swept-source OCT (SS-OCT), or a time-domain OCT (TD-OCT).

[0049] <Frontal shooting optical system> The front imaging optical system 200 captures the fundus Ef of the eye to be examined E from the front direction (for example, the optical axis direction of the measurement light), and obtains a front image of the fundus Ef. The front imaging optical system 200 may have, for example, the device configuration of a scanning laser ophthalmoscope (SLO) (for example, refer to Japanese Patent Application Laid-Open No. 2015-66242), or may have a so-called fundus camera type configuration (refer to Japanese Patent Application Laid-Open No. 2011-10944). Note that the OCT optical system 100 may be used in common as the front imaging optical system 200, and a front image may be obtained based on the detection signal from the detector 120.

[0050] <Fixation target projection unit> The fixation target projection unit 300 has an optical system for guiding the line-of-sight direction of the eye E. The projection unit 300 has a fixation target to be presented to the eye E and can guide the eye E. For example, the fixation target projection unit 300 has a visible light source that emits visible light, and changes the presentation position of the fixation target two-dimensionally. As a result, the line-of-sight direction is changed, and consequently, the acquisition site of the OCT data is changed.

[0051] <Acquisition of OCT data> The ophthalmic image processing apparatus 1 of the first embodiment may obtain three-dimensional OCT data of the eye to be examined through, for example, the OCT device 10. By two-dimensionally scanning the measurement light on the eye to be examined by the OCT optical system 100, three-dimensional OCT data of the fundus Ef can be obtained. For example, the CPU 71 controls the drive of the scanning unit 108 and scans the measurement light in the region A1 on the fundus Ef. In still Fig. 3(a), the direction of the z-axis is the direction of the optical axis of the measurement light. The direction of the x-axis is perpendicular to the z-axis and is the left-right direction of the subject. The direction of the y-axis is perpendicular to the z-axis and is the up-down direction of the subject.

[0052] For example, the CPU 7 controls the drive of the scanning unit 108 and scans the measurement light in the x direction along the scanning lines SL1, SL2, ···, SLn in the region A1. Scanning the measurement light in a direction (for example, the x direction) intersecting the optical axis direction of the measurement light is called a "B-scan". Three-dimensional OCT data is obtained by arranging a plurality of two-dimensional OCT data obtained by B-scans on different scanning lines.

[0053] <Acquisition of MC Data> Further, the ophthalmic image processing apparatus 1 of the first embodiment may, for example, process OCT data detected by the OCT device 10 to acquire MC (motion contrast) data. The motion contrast may be, for example, information capturing blood flow in the subject eye, changes in retinal tissue, etc. When acquiring MC data, the CPU 71 acquires at least two OCT data that are temporally different regarding the same position of the subject eye. For example, in each scanning line, the CPU 71 performs a plurality of B-scans at different times and acquires a plurality of OCT data at different times respectively.

[0054] For example, FIG. 3(b) shows OCT signals acquired when performing a plurality of B-scans at different times on scanning lines SL1, SL2, ···, SLn. For example, FIG. 3(b) shows a case where the scanning line SL1 is scanned at times T11, T12, ···, T1N, the scanning line SL2 is scanned at times T21, T22, ···, T2N, and the scanning line SLn is scanned at times Tn1, Tn2, ···, TnN. For example, the CPU 71 acquires a plurality of OCT data at different times in each scanning line and stores the OCT data in the storage unit 74.

[0055] As described above, when the CPU 71 acquires a plurality of OCT data that are temporally different regarding the same position, it processes the OCT data to acquire MC data (see FIG. 3(c)). Examples of the calculation method of OCT data for acquiring motion contrast include, for example, a method of calculating the intensity difference of complex OCT data, a method of calculating the phase difference of complex OCT data, a method of calculating the vector difference of complex OCT data, a method of multiplying the phase difference and vector difference of complex OCT signals, a method using signal correlation (correlation mapping), etc. Note that, as one of the calculation methods, for example, refer to Japanese Patent Laid-Open No. 2015-131107.

[0056] Furthermore, the CPU 71 arranges the MC data (two-dimensional MC data) on different scanning lines to acquire three-dimensional MC data of the subject's eye E. Note that the above-mentioned three-dimensional OCT data may be formed from OCT data that is the basis of the MC data.

[0057] <Segmentation processing> In this embodiment, segmentation processing is performed on each of the 3D OCT data and the 3D MC data. That is, the CPU 71 separates each of the 2D OCT data constituting the 3D OCT data and each of the 2D MC data constituting the 3D MC data into a plurality of depth regions through segmentation processing.

[0058] In the first embodiment, the CPU 71 may separate depth regions based on the boundaries of retinal layers detected by image processing of the intensity image. Here, the intensity image is, for example, an image in which brightness values ​​are determined according to the intensity of the OCT signal. For MC data, the CPU 71 may separate depth regions based on the boundaries of retinal layers detected by segmentation processing of the OCT data that is the basis of the MC data.

[0059] <Display Control of First Embodiment> 4, in the first embodiment, a front OCT image 501 based on three-dimensional OCT data and a front MC image 502 based on three-dimensional MC data are simultaneously displayed. For convenience, the screen shown in FIG. 4 (or FIGS. 6 to 9) will be referred to as a comparison screen.

[0060] The front OCT image 501 and the front MC image 502 may be acquired, for example, by extracting three-dimensional OCT data and three-dimensional MC data, respectively, for at least a portion of a region in the depth direction (see, for example, Japanese Patent Application Publication No. 2015-121574). For example, the front OCT image 501 and the front MC image 502 may be generated by integrating or maximizing the three-dimensional OCT data and the three-dimensional MC data in the depth direction. However, the method of projecting each piece of three-dimensional data onto the front image is not necessarily limited to this.

[0061] In the following description, the depth region corresponding to the front OCT image 501 is referred to as a first slab, and the depth region corresponding to the front MC image 502 is referred to as a second slab.

[0062] 4, a two-dimensional OCT image 511 and a two-dimensional MC image 512 acquired in one of the scan lines are displayed simultaneously with a front OCT image 501 and a front MC image 502. Lines indicating layer boundaries detected by segmentation processing are superimposed on each of the two-dimensional OCT image 511 and the two-dimensional MC image 512.

[0063] Furthermore, the boundary position of the first slab corresponding to the front OCT image 501 is indicated by markers 521a and 521b on the two-dimensional OCT image 511. Similarly, the boundary position of the second slab corresponding to the front MC image 502 is indicated by markers 522a and 522b on the two-dimensional MC image 512. Note that the markers 521a and 522a indicate the position of the starting layer, and the markers 521b and 522b indicate the position of the terminal layer, respectively, as the boundary positions of the slabs.

[0064] <Settings for each slab> In the first embodiment, when a front OCT image 501 and a front MC image 502 are simultaneously displayed, the slabs can be different from each other. In the first embodiment, operation inputs related to the positions of the slabs are accepted via several GUIs. As shown in FIG. 4 , in the first embodiment, the positions of the first slab and the second slab are set via a slab selection unit 530 and a detailed setting unit (offset setting unit) 540. As a result, even if the depth positions of a region where an abnormality in the layer structure appears due to a disease and a region where an abnormality in the vascular network appears are different, the first slab and the second slab can be appropriately set for each depth position. As a result, the examiner can simultaneously confirm the region where the abnormality in the layer structure appears and the region where the abnormality in the vascular network appears as front images corresponding to the respective regions, which is clinically useful.

[0065] <Slab selection section> The slab selector 530 selects one of the multiple depth regions (i.e., slabs) separated by the segmentation process. As described above, in the first embodiment, each slab is set based on the segmentation process of the intensity image (or the OCT data underlying the MC data). In the first embodiment, multiple icons 531 to 538 with slab names are displayed along with thumbnails of the front MC image. Note that in FIG. 4, for convenience, the slab names are written abstractly as "Slab 1" to "Slab 8." However, more specific names, such as names commonly used in clinical practice, may be used. It is desirable that the multiple depth regions separated by the segmentation process are completely included in the combined region of the multiple slabs selectable by the slab selector 530. The multiple slabs selectable by the slab selector 530 may include combinations in which layer regions partially overlap.

[0066] Each icon 531-538 is associated in advance with two layer boundaries corresponding to its own slab name. By selecting one of the icons 531-538, the two layer boundaries corresponding to that icon are set as the reference positions for the first slab and the second slab, respectively. Of the multiple layer boundaries detected by the segmentation process, the layer boundary corresponding to the slab name is used as the reference position.

[0067] For example, when icon 531 is selected in FIG. 4, the reference positions of the start layers of the first and second slabs are set to IPL / INL. Furthermore, the reference positions of the end layers of the first and second slabs are set to OPL / ONL. In the first embodiment, the set reference positions are displayed as text in the detailed setting section 540. Lines indicating layer boundaries superimposed on the two-dimensional OCT image 511 and the two-dimensional MC image 512 that correspond to the reference positions may be highlighted.

[0068] <Detailed settings section> In the detailed setting section 540, the start and end positions of the first and second slabs can be input and set as displacements (offset values) relative to a reference position. In the detailed setting section 540, the start and end positions can be input independently between the first and second slabs. In this embodiment, input of displacements relative to a reference position (input of offset values) is accepted in micrometers.

[0069] In the first embodiment, when an operation to change the slab settings (depth position settings) of the first and second slabs is input using the slab selection section 530 and the detailed setting section (offset setting section) 540, the front OCT image 501 and the front MC image 502 shown in Figure 4 are immediately displayed based on the changed slab settings.

[0070] For example, the examiner sequentially selects icons 531-538 in the slab selection section 530, and roughly checks for abnormalities in the layer structure or vascular network via the front OCT image 501 and the front MC image 502, which change with each selection. Once an abnormality in the layer structure or vascular network is confirmed, the examiner fine-tunes the boundary position between the first slab and the second slab via the detail setting section 540. In this way, while checking the front OCT image 501 and the front MC image 502, the examiner sets each slab so that the abnormality in the layer structure is included in the first slab and the abnormality in the vascular network is included in the second slab. Furthermore, the examiner can easily compare the front OCT image 501 and the front MC image 502, with each slab set at a desired depth position.

[0071] In the first embodiment, check boxes 551 and 552 are displayed as a GUI as a synchronization setting section. Depending on the selection operation for each check box 551 and 552, the check mark switches between entered and not entered. When neither check box is entered, as described above, the boundary positions (start and end positions) of each slab can be set to any value for each slab and for each boundary position.

[0072] For example, by checking the checkbox 551, the offset between the images is synchronized. That is, when either the start position or the end position of one of the first slab and the second slab is changed in the detailed setting section 540, the same change is applied to the other. That is, the boundary position of one of the first slab and the second slab is changed while maintaining the relative positional relationship between them.

[0073] Also, for example, by checking the checkbox 552, the change in offset between the start position and the end position is synchronized. For example, when one of the start position and the end position of the first slab is changed in the detailed setting section 540, the same change is applied to the other of the first slab (the other of the start position and the end position). In other words, the depth position of the slab is changed in response to the operation without changing the width of the slab.

[0074] If both check boxes 551 and 552 are checked, simply changing either the start or end position of the first slab changes the depth positions of both the first and second slabs without changing the width of the slabs. In other words, the depth positions of each slab are changed while maintaining the relative positional relationship between the first and second slabs.

[0075] <Second Example> Next, a second embodiment will be described with reference to FIGS.

[0076] In the first embodiment, in order to set the first slab and the second slab at different depth positions, an operation for manually changing the depth position of either the first slab or the second slab was required. In contrast, in the second embodiment, by using predetermined setting information, the first slab and the second slab can be set at different depth positions based on a simpler operation.

[0077] In the second embodiment, the setting information defines a combination of depth positions of a first slab and a second slab. For example, one piece of setting information defines one boundary position of the first slab (the position of the starting layer and the position of the ending layer) and one boundary position of the second slab (the position of the starting layer and the position of the ending layer). In this embodiment, a plurality of setting information is stored in advance in the storage unit 74. Each of the plurality of setting information differs from other setting information in either or both of the boundary position in the first slab and the boundary position in the second slab. At least one of the plurality of setting information includes a combination in which the depth position of the first slab and the depth position of the second slab are different from each other.

[0078] In the second embodiment, multiple pieces of setting information may be prepared for each disease type. For example, the boundary positions of the first slab and the second slab may be determined for each disease type so that an abnormal portion of the layer structure corresponding to the disease type is included in the first slab and an abnormal portion of the vascular network corresponding to the disease type is included in the second slab. The boundary positions may be determined by a combination of a layer boundary serving as a reference for the boundary position and an offset from the layer boundary. The layer boundary and offset are determined separately for each of the starting layer and the ending layer. The actual boundary position is a position separated by the offset from the layer boundary detected by the segmentation process. The multiple pieces of setting information may be stored in the storage unit 74 as a lookup table in which the boundary positions of the first slab and the boundary positions of the second slab are associated with each other for each disease type.

[0079] Here, a specific example of the setting information will be shown with reference to FIGS. 5(a) and 5(b).

[0080] For example, in age-related macular degeneration (AMD), as shown in FIG. 5(a), the retinal pigment epithelium (RPE) bulges in a dome shape, and neovascularization occurs around it. Therefore, in the setting information for age-related macular degeneration, the depth position of the first slab may be set as a range on the superficial side of the RPE. This allows the size of the bulging portion to be properly confirmed. Furthermore, in the setting information for age-related macular degeneration, the depth position of the second slab may be set in a peripheral region of the RPE, including the RPE. This allows the running state of neovascularization to be properly confirmed.

[0081] For example, in polypoidal choroidal vasculopathy (PCV), as shown in FIG. 5(b), polypoidal lesions occur superficial to the retinal pigment epithelium (RPE), in a shape very similar to the protuberances of age-related macular degeneration. Therefore, in the setting information for polypoidal choroidal vasculopathy, the depth position of the first slab may be determined in the same manner as in the case of age-related macular degeneration. The size of the polypoidal lesions can be appropriately determined through an en face OCT image based on such a slab. Furthermore, in the setting information for polypoidal choroidal vasculopathy, the depth position of the second slab may be determined as the position of the choriocapillaris (CC). The abnormal vascular network in the choriocapillaris can be appropriately confirmed through an en face MC image based on such a slab.

[0082] As shown in FIG. 6, in the second embodiment, similarly to the first embodiment, a front OCT image 501, a front MC image 502, a two-dimensional OCT image, a two-dimensional MC image 512, markers 521a, 521b, 522a, 522b, etc. are displayed.

[0083] Furthermore, in the second embodiment, a disease type selection section 560 is displayed as a GUI for selecting one of a plurality of pieces of setting information. In the disease type selection section 560, icons 561 to 568 with disease names attached are displayed. Each of the icons 561 to 568 is associated with setting information corresponding to the disease name (i.e., disease type). One of the plurality of pieces of setting information is selected based on a selection operation for the icons 561 to 568. Based on the depth positions of the first slab and the second slab defined by the selected setting information, a front OCT image 501 and a front MC image 502 are generated and displayed on the comparison screen.

[0084] According to the second embodiment, the examiner selects a disease type via the disease type selection unit 560, and a front OCT image 501 is displayed based on a first slab containing an abnormal portion of the layer structure corresponding to the disease type. Also, a front MC image 502 is displayed based on a second slab containing an abnormal portion of the vascular network corresponding to the disease type. Therefore, for example, the front OCT image 501 and the front MC image 502 in which slabs are appropriately set for a desired disease type can be quickly displayed.

[0085] In the second embodiment, a detailed setting section 540 similar to that in the first embodiment is arranged on the comparison screen. For example, after a disease type is selected via the disease type selection section 560, the detailed setting section 540 is operated. This allows the boundary positions of the first slab and the second slab to be adjusted independently based on the boundary position according to the disease type.

[0086] 6 illustrates a case where the reference layer boundary is common between the first slab and the second slab in one piece of setting information. However, this is not necessarily limited to this, and the reference layer boundary may be different between the first slab and the second slab in one piece of setting information.

[0087] In the second embodiment, at least one of the 3D OCT data that forms the basis of the front OCT image 501 and the 3D MC data that forms the basis of the front MC image 502 may be processed, and setting information corresponding to the processing result may be automatically selected. As an example, in the third embodiment, the processing result is output as a disease type determination result. The determination result and setting information are associated in advance, and setting information corresponding to the analysis processing result is automatically selected based on this correspondence. The disease type corresponding to the selected setting information is displayed via the disease type selection unit 560. For example, one of the icons 561 to 568 that corresponds to the selected disease type is highlighted. Such automatic selection may be performed simultaneously with the screen display, or may be triggered by a predetermined operational input.

[0088] The method for automatically selecting the setting information is not limited to the method based on the processing results of the 3D OCT data and the 3D MC data as described above. For example, if information identifying the subject's disease type as a result of a past examination is stored in the device in advance, the setting information may be selected based on that information.

[0089] <Third Example> 7, in the third embodiment, images and GUIs similar to those in the first embodiment are displayed. That is, a front OCT image 501, a front MC image 502, a two-dimensional OCT image 511, a two-dimensional MC image 512, markers 521a, 521b, 522a, and 522b, a slab selection section 530, and a detailed setting section 540 are displayed.

[0090] Additionally, in the third embodiment, a second selection section 570 is further arranged on the comparison screen. The second selection section 570 is a GUI in which the disease type selection section 560 in the second embodiment is implemented in the form of a pull-down menu. By expanding the pull-down menu, multiple disease names (disease types) are displayed, and one can be selected. As a result, the first slab and the second slab are set to different depth regions based on setting information previously associated with the disease type. Note that the disease type may be automatically selected based on the processing results of processing at least one of the 3D MC data that forms the basis of the front MC image 502.

[0091] Therefore, in the third embodiment, for example, after roughly detecting an abnormality by operating the slab selection unit 530, it is possible to set appropriate boundary positions for the first and second slabs for disease differentiation. Furthermore, if the disease is known in advance, it is possible to quickly set appropriate first and second slabs for the desired disease type via the disease type selection unit 560.

[0092] <Fourth Example> In the fourth embodiment, one of the multiple slabs separated for each vascular network is selected as the second slab. The first slab is set according to the type of feature of the vascular network included in the second slab of the three-dimensional MC data.

[0093] 8, for example, in the fourth embodiment, a second slab is selected via the slab selector 530. More specifically, any one of the multiple slabs separated for each vascular network can be selected via the slab selector 530. In the fourth embodiment, the boundary position of the second slab is set by adding an offset to the layer boundary detected based on the segmentation process of the 3D OCT data. The offset for each layer boundary may be determined in advance.

[0094] In a fourth embodiment, a feature of a vascular network may be detected from a second slab of three-dimensional MC data. Examples of the feature of a vascular network include ischemia, aneurysms, and neovascularization. Any of various known methods may be appropriately applied to the detection process for detecting the feature of a vascular network. Furthermore, the feature of a vascular network may be detected from the three-dimensional MC data within the section of the second slab, or may be detected from a frontal MC image corresponding to the second slab.

[0095] In the fourth embodiment, the boundary positions (positions of the start and end layers) of the first slab are set according to the type of feature included in the 3D MC data of the second slab. The position of at least one of the start and end layers of the first slab is set according to the type of vascular network in which the second slab is set and the type of feature in the vascular network.

[0096] The detailed setting unit 540 in the fourth embodiment is used to adjust the boundary position of the second slab. That is, the start and end positions of the second slab are input and set as displacements (offset values) relative to the reference position. This allows the second slab to be set so that the characteristics of the vascular network are appropriately included. As a result, the setting of the first slab according to the type of characteristics of the vascular network is also more appropriately performed.

[0097] In this way, in the fourth embodiment, when a characteristic tissue is present in a section corresponding to the front MC image, the front OCT image in the slab to be compared with the front MC image is automatically displayed, thereby preventing oversight of the disease.

[0098] <Fifth Example> In the fifth embodiment, a plurality of types of comparison screens are prepared in advance, and the initial settings of the slabs are different for each comparison screen.

[0099] As shown in Fig. 9, in the fifth embodiment, a report screen is displayed as a comparison screen. On the report screen, a report in a format predetermined for each diagnostic purpose is displayed, for example. The report is generated by extracting a portion of the test result data acquired by the ophthalmologic image-processing device 1 according to a report template and arranging the extracted data in a predetermined report format for easy viewing by the user. Each template defines the type of data to be extracted and the layout of the extracted data on the report.

[0100] In the fifth embodiment, three types of reports, a macular disease report, a glaucoma report, and an angio report, are selectively displayed. The report screen switches depending on the selection of a "Macula" tab 581, a "Glaucoma" tab 582, or an "Angio" tab 583. The macular disease report is used to diagnose macular diseases. The glaucoma report is used to diagnose glaucoma. The angio report displays the state of each vascular network at a glance. Of the three types of reports, at least the macular disease report and the glaucoma report are configured with initial settings for slabs according to the disease type. In the initial state, en face OCT images and en face MC images for the initial settings for the slabs are displayed. In this case, as in the second and third embodiments, the initial settings for the slabs in the macular disease report and the slabs in the glaucoma report are set based on setting information previously associated with each report and the corresponding disease type. For example, in the example shown in FIG. 9, for macular disease, at least ORCC (outer retina to choriocapillaris: a slab including the outer edge of the retinal pigment epithelium to the choriocapillaris (CC)) is set as the initial value of the second slab. Also, for glaucoma, at least DCP (deep capillary plexus: deep capillary network) is set as the initial value of the second slab. However, the initial settings for each disease and slab shown here are merely examples and can be changed as appropriate.

[0101] "Variations" <Display of analysis map reflecting slab settings> In each embodiment, the comparison screen has been described as simultaneously displaying a front OCT image based on the first slab and a front MC image based on the second slab. However, this is not necessarily limited to this, and a morphological analysis map based on the first slab may be displayed instead of or together with the front OCT image. Similarly, a vascular analysis map based on the second slab may be displayed instead of or together with the front MC image. Each analysis map may be displayed alongside or superimposed on the corresponding front image.

[0102] Each time each slab is set, the CPU 71 may analyze the three-dimensional OCT data or three-dimensional MC data in the section of each slab, generate an analysis map as a result of the analysis, and display it on the screen.

[0103] <Presetting setting information> Information defined by the examiner may be preset as the setting information. The preset-registered setting information may be selectable, for example, in the disease type selection unit 560. When the preset is registered, the selection of a layer boundary that serves as a reference for the boundary position and the input of an offset for the layer boundary are accepted for each of the first slab and the second slab. Also, a name may be registered for the setting information defined by the examiner. The registered name is displayed in the disease type selection unit 560 instead of the disease name. Note that the selection of the layer boundary and the input of the offset may be input separately for each of the starting layer and the ending layer.

[0104] <Follow-up tests use setting information from previous tests> In each embodiment, setting information indicating the final setting state of the first and second slabs may be stored in the storage unit 94 as past examination information in association with the subject's identification information. When a new examination is performed on the subject, such as during follow-up observation, and a comparison screen is displayed, the past examination information may be acquired based on the subject's identification information, and slab setting for the 3D OCT data and 3D MC data obtained in the new examination may be performed based on the past examination information. When a new examination is performed, the past examination information may be used as the initial value of the slab setting, or may be used in response to a selection operation by the examiner. <Example of tomographic images (2D OCT image, 2D MC image) displayed on the comparison screen> In each of the first to fourth embodiments, one tomographic image each is displayed to show the setting state of the first and second slabs, along with the front OCT image 501 and the front MC image 502. Specifically, a two-dimensional OCT image 511, a two-dimensional MC image 212, and markers 521a, 521b, 522a, and 522b are displayed.

[0105] However, this is not necessarily limited to this, and the setting state of the first and second slabs may be displayed in a layout such as that shown in FIG.

[0106] As shown in Fig. 10, the setting states of the first and second slabs may be displayed using a single tomographic image 600. Markers 611a and 611b indicating the first slab are displayed on one side of the tomographic image 600, and markers 612a and 612b indicating the second slab are displayed on the other side. Furthermore, as shown in Fig. 10, lines indicating layer boundaries identified by segmentation processing of the two-dimensional OCT image may be superimposed on the entire image. Through such a tomographic image 600, the examiner can more intuitively grasp the setting states of each slab.

[0107] The tomographic image 600 may be a 2D OCT image, a 2D MC image, or a collage image of both. The collage image may be, for example, a tomographic image for one scan line, in which the 2D OCT image and the 2D MC image are arranged opposite each other in the transverse direction.

[0108] In the above embodiment, for example, when segmentation processing is performed on MC data, the segmentation processing is performed on the OCT data that is the basis of the MC data, and as a result, the boundary positions of each slab in the MC data are set. However, this is not necessarily limited to this. For example, the segmentation processing may be performed on the MC data by image processing a two-dimensional MC image based on the MC data. [Explanation of symbols]

[0109] 1. Ophthalmological image processing device 501 Frontal OCT image 502 Front MC image

Claims

1. By being executed by a computer processor, an acquisition step of acquiring three-dimensional OCT data and three-dimensional motion contrast data of the subject's eye; a setting step of setting a first slab for the three-dimensional OCT data and a second slab for the three-dimensional motion contrast data, wherein depth positions of the first slab and the second slab are set independently; a calculation step of acquiring an en face OCT image or a morphological analysis map based on the first slab of the three-dimensional OCT data as first information, and acquiring an en face motion contrast image or a vascular analysis map based on the second slab of the three-dimensional motion contrast data as second information; a display control step of simultaneously displaying the first information and the second information, The setting step includes: a first setting step of setting the first slab or the second slab for either the three-dimensional OCT data or the three-dimensional motion contrast data; a second setting step of setting the first slab or the second slab for the other of the three-dimensional OCT data and the three-dimensional motion contrast data according to a feature included in the section of the slab set in the first setting step; Ophthalmic imaging programs, including:

2. When executed by a computer processor, an acquisition step of acquiring three-dimensional OCT data and three-dimensional motion contrast data of the subject's eye; a setting step of setting a first slab for the three-dimensional OCT data and a second slab for the three-dimensional motion contrast data, wherein depth positions of the first slab and the second slab are set independently; a calculation step of acquiring an en face OCT image or a morphological analysis map based on the first slab of the three-dimensional OCT data as first information, and acquiring an en face motion contrast image or a vascular analysis map based on the second slab of the three-dimensional motion contrast data as second information; a display control step of simultaneously displaying the first information and the second information, When the first slab and the second slab are set at different depth positions in the setting step, a change step is further executed in which the positions of the first slab and the second slab in the depth direction are changed in accordance with a common operation input while maintaining the relative positional relationship between the first slab and the second slab; An ophthalmologic image processing program, wherein the display control step simultaneously displays the first information based on the first slab and the second information based on the second slab after each has been modified by the modification step.

3. 3. An ophthalmologic image processing apparatus that executes the ophthalmologic image processing program according to claim 1.

Images