Image processing device and ophthalmic device equipped with the same

Abstract

To easily compare a plurality of images acquired from the same portion of a subject eye with each other and easily confirm a detail.SOLUTION: An image processing device comprises: a first image input unit which inputs a first photographed image obtained by imaging a specific portion of a subject eye; a second image input unit which inputs a second photographed image obtained by imaging the specific portion of the subject eye; and a display unit which displays a composite image obtained by combining the first photographed image and the second photographed image. The composite image is divided into at least a first region and a second region by a first boundary line. At least a portion being a part of the first photographed image and corresponding to the first region in the specific portion is displayed in the first region. At least a portion being a part of the second photographed image and corresponding to the second region in the specific portion is displayed in the second region.SELECTED DRAWING: Figure 4

Description

[Technical Field]

[0001] The technology disclosed in this specification relates to an image processing device that processes an image of an eye to be examined. [Background technology]

[0002] In an ophthalmologic apparatus, a specific region of the subject's eye (e.g., the crystalline lens, the retina, etc.) is photographed depending on the patient's symptoms. In this case, in order to grasp the condition of the subject's eye in detail, multiple images may be obtained by processing image data of the same region. For example, in the polarization-type OCT disclosed in Patent Document 1, multiple images (e.g., a tomographic image, a birefringence image, an entropy image) are obtained from image data of the same region. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] Japanese Patent Application Laid-Open No. 2016-57197 Summary of the Invention [Problem to be solved by the invention]

[0004] In conventional technology, multiple images acquired from the same body part are displayed one by one on a single screen, or multiple images are displayed simultaneously on a single screen. When multiple images are displayed one by one on a single screen, each image is displayed large, making it easy to check the details, but it is difficult to compare multiple images. On the other hand, when multiple images are displayed simultaneously on a single screen, it is easy to compare multiple images, but each image is displayed small, making it difficult to check the details of each image.

[0005] The present specification discloses a technique that allows multiple images acquired from the same region to be easily compared, and allows details of the multiple images to be easily confirmed. [Means for solving the problem]

[0006] The image processing device disclosed in this specification processes an image of a subject's eye. The image processing device includes a first image input unit that inputs a first captured image obtained by capturing an image of a specific region of the subject's eye, a second image input unit that inputs a second captured image obtained by capturing an image of the specific region of the subject's eye, and a display unit that displays a composite image obtained by combining the first and second captured images. The composite image is divided into at least a first region and a second region by a first boundary line. The first region displays at least a portion of the first captured image that corresponds to the first region of the specific region. The second region displays at least a portion of the second captured image that corresponds to the second region of the specific region. The image displayed in the first region is different from the image displayed in the second region.

[0007] In the image processing device described above, a composite image obtained by combining a first captured image and a second captured image obtained by capturing images of a specific region of the subject's eye is displayed on a display unit. The composite image is divided into a first region and a second region by a first boundary line, and a portion of the first captured image (a portion of the specific region corresponding to the first region) is displayed in the first region, and a portion of the second captured image (a portion of the specific region corresponding to the second region) is displayed in the second region. Because a portion of the first captured image and a portion of the second captured image are combined and displayed, it is possible to prevent the scale of the captured image from becoming smaller. This makes it easy to check the details of the captured image. Furthermore, because the first captured image and the second captured image are displayed simultaneously, these images can be easily compared.

[0008] In addition, the ophthalmic device disclosed in this specification includes a polarization-type OCT that photographs the test eye, an image generation unit that generates multiple images by photographing specific parts of the test eye with the polarization-type OCT, and an image processing device disclosed in this specification that processes the multiple images generated by the image generation unit.

[0009] In the above-described ophthalmologic apparatus, multiple images generated by capturing images of specific regions of the subject's eye using polarization-type OCT are displayed using the image processing device disclosed in this specification. Multiple images are displayed simultaneously, and the scale (size) of the multiple images is prevented from becoming smaller. This allows the details of the multiple images to be easily confirmed and the multiple images to be easily compared. [Brief explanation of the drawings]

[0010] [Figure 1] 1 is a block diagram showing a schematic configuration of an ophthalmologic apparatus according to an embodiment. [Figure 2] 10 is an example of an image displayed on a display device of the ophthalmologic apparatus according to the embodiment. [Figure 3] 10 is another example of an image displayed on the display device of the ophthalmologic apparatus according to the embodiment. [Figure 4] 10 is another example of an image displayed on the display device of the ophthalmologic apparatus according to the embodiment. [Figure 5] FIG. 5 is an enlarged view of a portion of the image shown in FIG. 4. [Figure 6] The image displayed when the position of the border line is changed in the image shown in Figure 5. [Figure 7] The image displayed when the position of the border line is changed in the image shown in Figure 6. [Figure 8] An example of the image displayed when checking image details while changing the border position. [Figure 9] Another example of what you see when you change the border position and examine the image details. [Figure 10] Enlarged view of the Enface image shown in Figure 4. [Figure 11] An example of another Anfas image (OCT-A image) displayed on the display device. [Figure 12] 10 is an example of another Enface image displayed on a display device. [Figure 13] Another example of an Enface image displayed on a display device. DETAILED DESCRIPTION OF THE INVENTION

[0011] The main features of the embodiments described below are listed below. Note that the technical elements described below are independent technical elements that exhibit technical utility alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing.

[0012] The image processing device disclosed in this specification may further include a first boundary line input unit that inputs the position of the first boundary line. The first region may be one of two regions obtained by dividing the composite image by the first boundary line, and the second region may be the other of the two regions obtained by dividing the composite image by the first boundary line. The first boundary line input unit may be operable by an operator, and the position of the first boundary line may be changeable. With this configuration, the first captured image and the second captured image can be compared while changing the position of the first boundary line.

[0013] The image processing device disclosed in this specification may further include a third image input unit that inputs a third captured image obtained by capturing an image of a specific region of the subject's eye. The display unit may display a composite image obtained by combining the first captured image, the second captured image, and the third captured image. The composite image may be divided into at least a first region, a second region, and a third region by a first boundary line and a second boundary line. The third region may display at least a portion of the third captured image that corresponds to the third region of the specific region. With this configuration, the first captured image, the second captured image, and the third captured image can be easily compared with each other.

[0014] The image processing device disclosed in this specification may further include a first boundary line input unit that inputs the position of the first boundary line and a second boundary line input unit that inputs the position of the second boundary line. The first boundary line input unit may be operable by an operator, and the position of the first boundary line may be changeable. The second boundary line input unit may be operable by an operator, and the position of the second boundary line may be changeable. With this configuration, the first captured image, the second captured image, and the third captured image can be compared while changing the positions of the two boundary lines.

[0015] In the image processing device disclosed in the present specification, a superimposed image obtained by superimposing at least two of the first, second, and third captured images may be displayed in at least one of the first, second, and third regions. When the superimposed image is displayed in the first region, an image obtained by superimposing a portion of the first captured image that corresponds to the first region of a specific region and a portion of at least one of the second and third captured images that corresponds to the first region of the specific region may be displayed in the first region. When the superimposed image is displayed in the second region, an image obtained by superimposing a portion of the second captured image that corresponds to the second region of the specific region and a portion of at least one of the first and third captured images that corresponds to the second region of the specific region may be displayed in the second region. When the superimposed image is displayed in the third area, an image in which a portion of the third photographed image that corresponds to the third area of ​​the specific region and a portion of at least one of the first photographed image and the second photographed image that corresponds to the third area of ​​the specific region are superimposed may be displayed in the third area. With this configuration, by displaying a superimposed image in which multiple photographed images are superimposed, it is possible to easily compare the multiple photographed images.

[0016] The image processing device disclosed in the present specification may further include a third image input unit that inputs a third captured image obtained by capturing an image of a specific portion of the subject's eye. The display unit may display a composite image obtained by combining the first captured image, the second captured image, and the third captured image. The composite image may be a rectangular image having a pair of first sides extending in the X-axis direction and a pair of second sides extending in the Y-axis direction. The composite image may be divided into a plurality of regions by a first boundary line and a second boundary line. Each of the first boundary line and the second boundary line may be a straight line extending parallel to the pair of first sides or the pair of second sides. In the composite image, a portion of the first captured image and a portion of the second captured image corresponding to the region may be superimposed and displayed. In the composite image, a portion of the second captured image and a portion of the third captured image corresponding to the region may be superimposed and displayed in an area sandwiched between the second boundary line and the other of the pair of first sides or the pair of second sides parallel to the first boundary line. When the first boundary line is located on one side of the pair of first sides or the pair of second sides and the second boundary line is located on the other side of the pair of first sides or the pair of second sides, a portion of the second captured image corresponding to the region may be displayed in an area sandwiched between the first boundary line and the second boundary line. When the first boundary line is located on the other side of the pair of first sides or the pair of second sides and the second boundary line is located on one side of the pair of first sides or the pair of second sides, a portion of the first captured image, a portion of the second captured image, and a portion of the third captured image corresponding to the region may be superimposed and displayed in an area sandwiched between the first boundary line and the second boundary line. This configuration also makes it possible to easily compare multiple captured images.

[0017] In the image processing device disclosed in this specification, the first captured image may be a birefringence image obtained by imaging the subject's eye with polarization-type OCT, the second captured image may be a light scattering intensity image obtained by imaging the subject's eye with polarization-type OCT, and the third captured image may be an entropy image obtained by imaging the subject's eye with polarization-type OCT. [Example]

[0018] An ophthalmic apparatus according to this embodiment will be described below. The ophthalmic apparatus according to this embodiment includes a polarization OCT 20, a calculation device 10 that generates multiple images from interference signals detected by the polarization OCT 20 and combines the multiple images, a display device 24 that displays the images generated and / or combined by the calculation device 10, and an input device 22 for inputting operator instructions to the calculation device 20. In this embodiment, the calculation device 10, the display device 24, and the input device 22 constitute an example of an "image processing device" disclosed in this specification.

[0019] The polarization-type OCT 20 is a Fourier-domain OCT (swept-source optical coherence tomography: SS-OCT) that uses a wavelength-swept light source and is a polarization-sensitive OCT (PS-OCT) that can capture the polarization characteristics of the test eye. The polarization-type OCT 20 generates interference light by combining measurement light (reflected light from the test eye) obtained by irradiating the test eye with light output from a light source and reference light generated from the light output from the light source, and detects the generated interference light. The interference light detected by the polarization-type OCT 20 is converted into an interference signal (i.e., image data) and input to the calculation device 10. In the polarization-type OCT 20 of this embodiment, light from the light source is split into a vertically polarized component and a horizontally polarized component to generate first and second irradiation lights, and light from the light source is split into a vertically polarized component and a horizontally polarized component to generate first and second reference lights. The polarization OCT 20 generates first interference light by combining the vertically polarized component of the first measurement light obtained by irradiating the eye with the first irradiation light with the first reference light, and generates second interference light by combining the horizontally polarized component of the first measurement light with the first reference light. Similarly, the polarization OCT 20 generates third interference light by combining the vertically polarized component of the second measurement light obtained by irradiating the eye with the second irradiation light with the second reference light, and generates fourth interference light by combining the horizontally polarized component of the second measurement light with the second reference light. Therefore, the polarization OCT 20 generates first to fourth interference light from the same site of the eye, and inputs first to fourth interference signals obtained from these first to fourth interference light to the arithmetic device 10. The polarization OCT 20 also includes a camera (not shown) that captures an anterior segment image of the eye and a camera (not shown) that captures fundus images, and the images captured by these cameras are also input to the arithmetic device 10. The polarization-type OCT 20 can have a known configuration (for example, the configuration disclosed in Japanese Patent Application Laid-Open No. 2016-57197), and therefore a detailed description thereof will be omitted here.

[0020] The arithmetic device 10 can be configured by a computer equipped with a CPU, ROM, and RAM, and by executing a program stored in the ROM, causes the polarization-type OCT 20 to perform an imaging process for imaging the subject's eye, and causes the display device 24 to display a tomographic image or the like obtained by imaging the subject's eye. In other words, the arithmetic device 10 functions as an image generation unit 12, an image synthesis unit 14, and an image storage unit 16.

[0021] The image generating unit 12 generates tomographic images having four polarization characteristics (HH, HV, VH, VV) from the same site of the subject's eye by performing arithmetic processing such as Fourier transform processing on the first to fourth interference signals input from the polarization-type OCT 20. Furthermore, by using tomographic images (VH, VV tomographic images) captured by irradiating the subject's eye with vertical waves and tomographic images (HH, HV tomographic images) captured by irradiating the subject's eye with horizontal waves, the image generating unit 12 can generate not only tomographic images showing the tissues in the subject's eye by the scattering intensity of light (so-called ordinary tomographic images (hereinafter referred to as light scattering intensity tomographic images)), but also tomographic images showing the entropy in the subject's eye (hereinafter referred to as entropy tomographic images), tomographic images showing the birefringence in the subject's eye (hereinafter referred to as birefringence tomographic images), tomographic images showing the running direction of fibers in the subject's eye, tomographic images showing the blood flow in the subject's eye, and the like. The process of generating various tomographic images from tomographic images having four polarization characteristics (HH, HV, VH, VV) can be performed using a known method, and therefore detailed description thereof will be omitted here.

[0022] The image synthesis unit 14 synthesizes (in this specification, "synthesis" includes "superimposition," which will be described in detail later) the various tomographic images generated by the image generation unit 12 to generate an image to be displayed on the display device 24. Specific examples of images displayed on the display device 24 will be described in detail later. The various image data generated by the image generation unit 12 and the image synthesis unit 14 are stored in the image storage unit 16 together with identification information (e.g., patient ID, etc.) for identifying the eye to be examined, the date of imaging, and other data.

[0023] The display device 24 displays the image output from the image generating unit 12 and / or the image combining unit 14. The operator can understand the condition of the subject's eye from the image displayed on the display device 24.

[0024] The input device 22 is composed of a pointing device such as a keyboard or a mouse. An operator can input instructions to the arithmetic unit 20 via the input device 22 to cause the polarization-type OCT 20 to perform a process of photographing the subject's eye, or to display a desired image on the display device 24. In this embodiment, the display device 24 and the input device 22 are separate devices, but, for example, a touch panel display or the like that serves as both a display device and an input device may also be used.

[0025] Next, various images displayed on the display device 24 will be described. As described above, the ophthalmologic apparatus of this embodiment captures an image of the same site (e.g., the retina) of the subject's eye, thereby generating multiple images (e.g., a light scattering intensity tomographic image, an entropy tomographic image, a birefringence tomographic image, etc.) from the same site. By comparing multiple images acquired from the same site of the subject's eye, the operator can grasp the condition of the subject's eye in detail.

[0026] FIG. 2 shows an example of an image displayed on the display device 24. In the image 30 shown in FIG. 2, a fundus image 32, a light scattering intensity tomographic image 34, an entropy tomographic image 36, and a birefringence tomographic image 38 of the subject's eye are displayed on the same screen. The fundus image 32 includes a rectangular area display 32a indicating the area captured by the polarization-type OCT 20 and a linear position display 32b indicating the positions of the various tomographic images 34, 36, and 38 being displayed. The display of the position display 32b within the fundus image 32 allows the operator to easily grasp the position of the tomographic image being displayed within the captured area of ​​the subject's eye (i.e., the area display 32a). The light scattering intensity tomographic image 34 shows the scattering intensity of light reflected from each tissue in the subject's eye, and a graph 35 showing the thickness of each tissue obtained by analyzing the light scattering intensity tomographic image 34 is also displayed. The entropy tomographic image 36 shows the entropy values ​​of each tissue in the subject's eye, and is accompanied by a graph 37 showing the entropy values ​​at a specific location in the entropy tomographic image. Specifically, graph 37 displays the entropy value (average value) of the retinal pigment epithelium. The birefringence tomographic image 38 shows the birefringence values ​​of each tissue in the subject's eye, and is accompanied by a graph 39 showing the birefringence values ​​at a specific location in the birefringence tomographic image. Specifically, graph 39 displays the birefringence value (average value) of the retina. As is clear from the figure, the light scattering intensity tomographic image 34, the entropy tomographic image 36, and the birefringence tomographic image 38 of the same cross-section of the subject's eye are simultaneously displayed in image 30, making it easy to compare these tomographic images. However, the size of each of the tomographic images 34, 36, and 38 is small, making it difficult to confirm the details of these images 34, 36, and 38.

[0027] Therefore, in the ophthalmologic apparatus of this embodiment, when the operator inputs a predetermined instruction from the input device 22, an image 30 shown in FIG. 3 is displayed on the display device 24. In the image 30 shown in FIG. 3, only the light scattering intensity tomographic image 34 is displayed in an enlarged form, and the graphs 25, 37, and 39 are displayed to the right of the light scattering intensity tomographic image 34. As is clear from FIG. 3, the light scattering intensity tomographic image 34 is displayed in an enlarged form, making it easy to check the details of the light scattering intensity tomographic image 34, but it is not possible to compare it with the entropy tomographic image 36 or the birefringence tomographic image 38. As shown in FIG. 3, the image 30 also displays a split button 40 for inputting an instruction to split the light scattering intensity tomographic image 34 and a tool button 42 for performing various settings. In addition, an entropy image 46 of the portion surrounded by the region display 32a is displayed below the fundus image 32. The entropy tomographic image 36 or the birefringence tomographic image 38 may be enlarged and displayed instead of the light scattering intensity tomographic image 34 generated for each scan line (i.e., multiple light scattering intensity tomographic images 34 generated for all scan lines in the area surrounded by the region display 32a). In the image 30 shown in Fig. 3, the light scattering intensity tomographic image 34 is enlarged and displayed, but the entropy tomographic image 36 or the birefringence tomographic image 38 may also be enlarged and displayed instead.

[0028] In the image 30 shown in Fig. 3, only the light scattering intensity tomographic image 34 is displayed, and therefore it is not possible to compare the light scattering intensity tomographic image 34 with the other tomographic images 36, 38. Therefore, in the ophthalmologic apparatus of this embodiment, the operator operates the input device 22 to move the pointer displayed on the screen onto the split button 40 and click it. The image shown in Fig. 4 is then displayed on the display device 24. Note that in Fig. 4, only the portions of the image 30 shown in Fig. 3 that correspond to the fundus image 32, the anterior vein image 46, and the light scattering intensity tomographic image 34 are displayed. That is, graphs 25, 37, and 39 are not shown in Fig. 4.

[0029] 4, the image 50 is divided into three regions 52, 54, and 56 by a first boundary line 44 and a second boundary line 46. The first boundary line 44 and the second boundary line 46 extend parallel to sides (i.e., longitudinal sides) extending in the vertical direction (Y-axis direction) of the rectangular image 50. Because the image 50 is divided by the two boundary lines 44 and 46 extending in the vertical direction (Y-axis direction), each of the divided regions 52, 54, and 56 is also rectangular, and these regions 52, 54, and 56 are arranged side by side in the horizontal direction (X-axis direction).

[0030] In region 52 (the region between the left vertical side of image 50 and the first boundary line 44), the light scattering intensity tomographic image 34 and the birefringence tomographic image 38 are displayed superimposed on each other. That is, in region 52, a portion of the light scattering intensity tomographic image 34 corresponding to region 52 and a portion of the birefringence tomographic image 38 corresponding to region 52 are displayed superimposed on each other. In region 54 (the region between the first boundary line 44 and the second boundary line 46), only the light scattering intensity tomographic image 34 is displayed. That is, in region 54, only the portion of the light scattering intensity tomographic image 34 corresponding to region 54 is displayed. In region 56 (the region between the right vertical side of image 50 and the second boundary line 46), the light scattering intensity tomographic image 34 and the entropy tomographic image 36 are displayed superimposed on each other. That is, in region 56, a portion of the light scattering intensity tomographic image 34 corresponding to region 56 and a portion of the entropy tomographic image 36 corresponding to region 56 are displayed superimposed on each other.

[0031] 4 and 10, the Anfas image 60, like the image 50 described above, is divided into three regions 62, 64, and 66 by a first boundary line 44 and a second boundary line 46. In region 62, an Anfas image generated in the light scattering intensity tomographic image 34 corresponding to region 62 and an Anfas image generated in the birefringence tomographic image 38 corresponding to region 62 are displayed in a superimposed manner. In region 64, an Anfas image generated in the light scattering intensity tomographic image 34 corresponding to region 64 are displayed. In region 66, an Anfas image generated in the light scattering intensity tomographic image 34 corresponding to region 66 and an Anfas image generated in the entropy tomographic image 36 corresponding to region 66 are displayed in a superimposed manner.

[0032] 4, in addition to the area display 32a and the position display 32b, the fundus image 32 also displays a straight line 44a indicating the first boundary line 44 and a straight line 46a indicating the second boundary line 46. This allows the operator to easily grasp the positions of the first boundary line 44 and the second boundary line 46.

[0033] In the ophthalmologic apparatus of this embodiment, the positions of the first boundary line 44 and the second boundary line 46 can be moved by an operator's operation. Specifically, the operator operates the input device 22 to move the pointer on the screen onto the first boundary line 44 or the second boundary line 46, and then drags (move while clicking) the first boundary line 44 or the second boundary line 46. In this way, the positions of the first boundary line 44 and the second boundary line 46 can be moved to desired positions.

[0034] Changes in image 50 when the positions of first boundary line 44 and second boundary line 44 are changed will be described with reference to Figures 5 to 7. As shown in Figure 5, image 50 is divided into three regions 52, 54, and 56 by first boundary line 44 and second boundary line 46, and first boundary line 44 is located to the left of second boundary line 46. As described above, in the state shown in Figure 5, region 52 displays the light scattering intensity tomographic image 34 and birefringence tomographic image 38 superimposed on each other, region 54 displays only the light scattering intensity tomographic image 34, and region 56 displays the light scattering intensity tomographic image 34 and entropy tomographic image 36 superimposed on each other.

[0035] 6, when the position of second boundary line 46 is moved toward first boundary line 44 from the state shown in Fig. 5, region 54 narrows while region 56 widens as second boundary line 46 moves. As a result, the area of ​​light scattering intensity tomographic image 34 displayed in region 54 narrows, and the area of ​​the superimposed image of light scattering intensity tomographic image 34 and entropy tomographic image 36 displayed in region 56 widens.

[0036] 7, the first boundary line 44 is moved to the right beyond the second boundary line 46. As the first boundary line 44 moves to the right until it exceeds the second boundary line 46, a region 52 in which the light scattering intensity tomographic image 34 and the birefringence tomographic image 38 are superimposed on each other expands, while a region 54 in which only the light scattering intensity tomographic image 34 is displayed narrows. When the first boundary line 44 moves further to the right beyond the second boundary line 46, the light scattering intensity tomographic image 34 and the birefringence tomographic image 38 are superimposed on each other in a region 52 to the left of the second boundary line 46 (the region between the second boundary line 46 and the left vertical side of the image 50). Meanwhile, in a region 54 sandwiched between the second boundary line 46 and the first boundary line 44, the light scattering intensity tomographic image 34, the entropy tomographic image 36, and the birefringence tomographic image 38 are superimposed on each other. Furthermore, in a region 56 to the right of the first boundary line 44 (the region between the first boundary line 44 and the right vertical side of the image 50), the light scattering intensity tomographic image 34 and the entropy tomographic image 36 are superimposed and displayed. That is, in this embodiment, the region in which the birefringence tomographic image 38 is displayed is controlled by the first boundary line 44, so that the birefringence tomographic image 38 is displayed to the left of the first boundary line 44 and is not displayed to the right of the first boundary line 44. Furthermore, the region in which the entropy tomographic image 36 is displayed is controlled by the second boundary line 46, so that the entropy tomographic image 36 is displayed to the right of the second boundary line 46 and is not displayed to the left of the second boundary line 46. The light scattering intensity tomographic image 34 is displayed in all of the regions 52, 54, and 56.

[0037] When multiple tomographic images 34, 36, and 38 are superimposed and displayed in each region 52, 54, and 56, they can be superimposed in a desired order by an operator's operation. Specifically, the operator operates the input device 22 to click the tool button 42 (shown in FIG. 3 ). This displays a setting screen on the display device 24, allowing the operator to set the order in which the multiple tomographic images 34, 36, and 38 will be superimposed. For example, the light scattering intensity tomographic image 34, the entropy tomographic image 36, and the birefringence tomographic image 38 can be superimposed from the bottom up in this order. Alternatively, the light scattering intensity tomographic image 34, the birefringence tomographic image 38, and the entropy tomographic image 36 can be superimposed from the bottom up in this order.

[0038] Furthermore, in this embodiment, the area in which the birefringence tomographic image 38 is displayed is controlled by the first boundary line 44, and the area in which the entropy tomographic image 36 is displayed is controlled by the second boundary line 46, but this is not limited to such an example. For example, the area in which the entropy tomographic image 36 is displayed may be controlled by the first boundary line 44, and the area in which the birefringence tomographic image 38 is displayed may be controlled by the second boundary line 46. Alternatively, the area in which the light scattering intensity tomographic image 34 is displayed may be controlled by the first boundary line 44 or the second boundary line 46.

[0039] The ophthalmologic apparatus of this embodiment can be switched between a state in which the light scattering intensity tomographic image 34, the entropy tomographic image 36, and the birefringence tomographic image 38 are all displayed on the same screen (the state shown in FIG. 2 ) and a state in which any of the light scattering intensity tomographic image 34, the birefringence tomographic image 38, and the entropy tomographic image 36 is enlarged and displayed (the states shown in FIGS. 3 and 4 ). Details of the light scattering intensity tomographic image 34, the birefringence tomographic image 38, and the entropy tomographic image 36 can be easily confirmed, and these tomographic images can be easily compared. In particular, since the operator can move the boundary lines 44 and 46 to any position, for example, as shown in FIGS. 8 and 9 , the operator can compare details of the images 34 and 36 by changing the position of the boundary (the position of the boundary line 46) between the light scattering intensity tomographic image 34 shown in region 54 and the image in which the light scattering intensity tomographic image 34 and the entropy tomographic image 36 are superimposed, shown in region 56. This makes it possible to easily grasp the state of the tissue of the subject's eye and the polarization state of the tomographic image of the subject's eye.

[0040] (Correspondence) The arithmetic device 10 is an example of a "first image input unit," a "second image input unit," and a "third image input unit." The display device 24 is an example of a "display unit." The regions 52, 54, and 56 are examples of a "first region," a "second region," and a "third region." The first boundary line 44 is an example of a "first boundary line," and the second boundary line 46 is an example of a "second boundary line." The input device 22 is an example of a "first boundary line input unit" and a "second boundary line input unit." The light scattering intensity tomographic image 34, the birefringence tomographic image 38, and the entropy tomographic image 36 are examples of a "first captured image," a "second captured image," and a "third captured image."

[0041] In the above-described embodiment, for example, as shown in FIGS. 4 and 10, the Anfas image 60 is divided into three regions 62, 64, and 66 by the first boundary line 44 and the second boundary line 46, and various Anfas images are superimposed and displayed in these three regions 62, 64, and 66. However, the technology disclosed in this specification is not limited to such an example. For example, as shown in FIG. 11, the Anfas image 70 may be divided by three boundary lines 44, 46, and 49. In the example shown in FIG. 11, the region 66 is divided by the third boundary line 49 into regions 66a and 66b. Then, in region 66b, an Anfas image generated from the light scattering intensity tomographic image 34, an Anfas image generated from the entropy tomographic image 36, and an Anfas image from which a blood vessel image has been extracted (a so-called OCT-A image) are superimposed and displayed. That is, the third boundary line 49 is a boundary line for controlling the area where an anterior image (so-called OCT-A image) from which a blood vessel image is extracted is displayed, and the area where an anterior image (so-called OCT-A image) from which a blood vessel image is extracted can be displayed can be adjusted by changing the position of the third boundary line 49. That is, the number of divisions into which the captured image is divided is not limited to the above-mentioned three or four divisions, and may be any number (for example, two divisions, five or more divisions).

[0042] In the above-described embodiment, the regions 52, 54, and 56 divided by the boundary lines 44 and 46 display images in which various tomographic images 34, 36, and 38 are superimposed. However, the technology disclosed in this specification is not limited to such an example. For example, only a first tomographic image may be displayed in region 52, only a second tomographic image different from the first tomographic image may be displayed in region 54, and only a third tomographic image different from the first and second tomographic images may be displayed in region 56. That is, in such a case, the first, second, and third tomographic images are simply combined without being superimposed. Even in such an example, the first, second, and third tomographic images can be easily compared.

[0043] Although the above-described embodiment illustrates an example in which multiple images captured at the same time are compared, the technology disclosed in this specification is not limited to such an example. For example, two images of the same part of the same subject's eye captured at different times (e.g., a tomographic image of the subject's eye before surgery and a tomographic image of the subject's eye after surgery) may be displayed for comparison. That is, one screen may be divided into two areas by a boundary line, and one image (e.g., a tomographic image of the subject's eye before surgery) may be displayed in one area, and the other image (e.g., a tomographic image of the subject's eye after surgery) may be displayed in the other area. In this example, by comparing two images (e.g., a tomographic image of the subject's eye before surgery and a tomographic image of the subject's eye after surgery) while changing the position of the boundary line, the effects of surgery on the subject's eye can be evaluated in detail.

[0044] Furthermore, although a polarization-sensitive OCT is used in the above-described embodiment, the present invention is not limited to such a configuration. The type of optical coherence tomography is not particularly limited, and for example, an optical tomographic imaging device that is not polarization-sensitive may also be used. Furthermore, the technology disclosed in this specification can also be applied to ophthalmic devices other than OCT (for example, a fundus camera, etc.).

[0045] In the above-described embodiment, a rectangular tomographic image is divided by boundaries and displayed. However, the technology disclosed in this specification is not limited to such an example. For example, as shown in FIG. 12, an image 70 (e.g., a fundus image) having a circular outer shape may be divided in the circumferential direction by boundaries (e.g., line segments extending radially from the center of the circle), and different images may be displayed in each of the divided fan-shaped regions 72, 74, and 76. In this case, the angular range of each fan-shaped region 72, 74, and 76 may be changed by moving the boundaries in the circumferential direction, and the displayed image may change depending on the change in the angular range. Alternatively, as shown in FIG. 13, an image 80 having a circular outer shape may be divided in the radial direction by boundaries (e.g., concentric circles), and different images may be displayed in each of the divided regions (circular region 86 or ring-shaped regions 84a-84d, 82a-82d). In this case, by moving the boundary line in the radial direction, the radial position range of each of the regions 86, 84a to 84d, and 82a to 82d may change, and the image displayed may change in accordance with the change in position range. Furthermore, in a chart divided into multiple regions, an image assigned to each region may be displayed for each region. In this case, by changing the position of the boundary line that defines the boundary between each region, the area of ​​each region may change, and the area of ​​the image displayed may change in accordance with the change in area.

[0046] Although specific examples of the technology disclosed in this specification have been described in detail above, these are merely examples and do not limit the scope of the claims. The technology described in the claims includes various modifications and variations of the specific examples exemplified above. Furthermore, the technical elements described in this specification or drawings exhibit technical utility alone or in various combinations, and are not limited to the combinations described in the claims at the time of filing. Furthermore, the technology exemplified in this specification or drawings simultaneously achieves multiple objectives, and achieving one of those objectives itself has technical utility. [Explanation of symbols]

[0047] 10: Arithmetic device 12: Image generation unit 14: Image synthesis unit 16: Image storage unit 20: Polarized OCT 22: Input device 24:Display device

Claims

1. an image processing device that processes an image of an eye to be examined, a first image input unit that inputs a first captured image obtained by capturing an image of a specific part of the subject's eye; a second image input unit that inputs a second captured image obtained by capturing an image of the specific portion of the subject's eye; a display unit that displays a composite image obtained by combining the first captured image and the second captured image, the composite image is divided into at least a first region and a second region by a first boundary line; In the first area, a part of the first photographed image is displayed, and at least a part of the specific part corresponding to the first area is displayed; In the second area, a part of the second photographed image is displayed, and at least a part of the specific part corresponding to the second area is displayed; the image displayed in the first area is different from the image displayed in the second area; a third image input unit that inputs a third captured image obtained by capturing an image of the specific portion of the subject's eye, the display unit displays a composite image obtained by combining the first captured image, the second captured image, and the third captured image; the composite image is divided into at least the first region, the second region, and a third region by the first boundary line and the second boundary line; In the third area, a part of the third photographed image is displayed, and at least a part of the specific part corresponding to the third area is displayed; a superimposed image in which at least two of the first captured image, the second captured image, and the third captured image are superimposed is displayed in at least one of the first area, the second area, and the third area; When the superimposed image is displayed in the first area, an image in which a portion of the first photographed image that corresponds to the first area of ​​the specific region and a portion of at least one of the second photographed image and the third photographed image that corresponds to the first area of ​​the specific region are superimposed is displayed in the first area, When the superimposed image is displayed in the second area, an image in which a portion of the second photographed image that corresponds to the second area of ​​the specific region and a portion of at least one of the first photographed image and the third photographed image that corresponds to the second area of ​​the specific region are superimposed is displayed in the second area, When the superimposed image is displayed in the third area, an image obtained by superimposing a portion of the third captured image that corresponds to the third area of ​​the specific region and a portion of at least one of the first captured image and the second captured image that corresponds to the third area of ​​the specific region is displayed in the third area.

2. An image processing device that processes an image of a subject's eye, a first image input unit that inputs a first captured image obtained by capturing an image of a specific part of the subject's eye; a second image input unit that inputs a second captured image obtained by capturing an image of the specific portion of the subject's eye; a display unit that displays a composite image obtained by combining the first captured image and the second captured image, the composite image is divided into at least a first region and a second region by a first boundary line; In the first area, a part of the first photographed image is displayed, and at least a part of the specific part corresponding to the first area is displayed; In the second area, a part of the second photographed image is displayed, and at least a part of the specific part corresponding to the second area is displayed; the image displayed in the first area is different from the image displayed in the second area; a third image input unit that inputs a third captured image obtained by capturing an image of the specific portion of the subject's eye, the display unit displays a composite image obtained by combining the first captured image, the second captured image, and the third captured image; the composite image is a rectangular image having a pair of first sides extending in an X-axis direction and a pair of second sides extending in a Y-axis direction; the composite image is divided into a plurality of regions by the first boundary line and the second boundary line; each of the first boundary line and the second boundary line is a straight line extending parallel to the pair of first sides or the pair of second sides; in a region of the composite image sandwiched between the first boundary line and one of the pair of first sides or the pair of second sides parallel to the first boundary line, a part of the first captured image and a part of the second captured image corresponding to the region are superimposed and displayed; a part of the second captured image and a part of the third captured image corresponding to a region of the composite image sandwiched between the second boundary line and the other of the pair of first sides or the other of the pair of second sides parallel to the first boundary line are superimposed and displayed; when the first boundary line is located on one side of the pair of first sides or the pair of second sides, and the second boundary line is located on the other side of the pair of first sides or the pair of second sides, a part of the second captured image corresponding to the area sandwiched between the first boundary line and the second boundary line is displayed; An image processing device wherein, when the first boundary line is located on the other side of the pair of first sides or the pair of second sides and the second boundary line is located on one side of the pair of first sides or the pair of second sides, a portion of the first captured image, a portion of the second captured image, and a portion of the third captured image corresponding to the area sandwiched between the first boundary line and the second boundary line are superimposed and displayed.

3. a first boundary line input unit for inputting the position of the first boundary line; a second boundary line input unit for inputting the position of the second boundary line, the first boundary line input unit is operable by an operator, and the position of the first boundary line is changeable; 3. The image processing device according to claim 1, wherein the second boundary line input unit is operable by an operator, and the position of the second boundary line is changeable.

4. the first captured image is a birefringence image obtained by capturing an image of the subject's eye using a polarization-type OCT; the second captured image is a light scattering intensity image obtained by capturing an image of the subject's eye using a polarization-type OCT; 4. The image processing device according to claim 1, wherein the third captured image is an entropy image obtained by capturing an image of the subject's eye using a polarization-type OCT.

5. a polarization-type OCT for photographing the subject's eye; an image generating unit that generates a plurality of images by capturing an image of a specific region of the subject's eye using the polarization-type OCT; an image processing device according to any one of claims 1 to 4, which processes a plurality of images generated by the image generation unit; An ophthalmic device comprising:

Images