Information processing device, image processing method, and program

The information processing device addresses the asymmetrical evaluation of retinal layer thickness in OCT images by transforming nasal regions in fundus images, ensuring accurate symmetry assessment in both nasal and temporal areas, enhancing diagnostic precision.

JP2024162916APending Publication Date: 2024-11-21CANON KK
View PDF 1 Cites 0 Cited by

Patent Information

Application Number
JP2023078905
Authority / Receiving Office
JP · JP
Patent Type
Applications
Current Assignee / Owner
Filing Date
2023-05-11
Publication Date
2024-11-21

AI Technical Summary

Technical Problem

Existing methods for evaluating retinal layer thickness symmetry in OCT images of the eye fail to appropriately assess symmetry in the temporal region due to asymmetrical straight lines used as standards, leading to inaccurate evaluations.

Method used

An information processing device that utilizes two straight lines in fundus images, one passing through the macula and papilla, with an angle adjustment to 180 degrees, to deform and transform the nasal regions, allowing for accurate symmetry evaluation of retinal layer thickness.

Benefits of technology

Enables precise evaluation of retinal layer thickness symmetry in both nasal and temporal regions, improving diagnostic accuracy in ophthalmological assessments.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure 2024162916000001_ABST
    Figure 2024162916000001_ABST
Patent Text Reader

Abstract

To provide a method for enabling proper evaluation of the symmetry of the layer thickness in a nose-side region and the symmetry of the layer thickness in an ear-side region.SOLUTION: An information processing device according to the present disclosure comprises deformation means for deforming a first region and a second region in an ocular fundus image, the second region being larger than the first region, the first and second regions being defined by first and second straight lines such that the angle between the first and second straight lines approach 180 degrees, where the first straight line passes through a first feature part relating to the macula in the ocular fundus image and is positioned on the ear side, and where the second straight line passes through the first feature part and a second feature part relating to the papilla in the ocular fundus image and is positioned on the nose side.SELECTED DRAWING: Figure 1
Need to check novelty before this filing date? Find Prior Art

Description

[Technical field]

[0001] The present disclosure relates to an information processing device, an image processing method, and a program. [Background technology]

[0002] Optical Coherence Tomography (OCT) devices that capture tomographic images of the fundus are widely used as ophthalmic devices. Doctors diagnose the presence or absence of ophthalmic diseases such as glaucoma by evaluating the thickness of the retina obtained from the tomographic images.

[0003] Here, Patent Document 1 discloses a method for evaluating the symmetry of layer thickness with respect to a line passing through the macula and the optic disc. [Prior art documents] [Patent documents]

[0004] [Patent Document 1] Patent Publication No. 2022-38751 Summary of the Invention [Problem to be solved by the invention]

[0005] Here, the thickness of the retina (layer thickness) is symmetrical with respect to the line passing through the macula and the optic nerve in the region from the macula to the nose, but may not be symmetrical with respect to the line passing through the macula and the optic nerve in the region from the macula to the ear. That is, since the line serving as the reference for symmetry is different, for example, the symmetry of the layer thickness can be appropriately evaluated in the nasal region, but the symmetry of the layer thickness cannot be appropriately evaluated in the ear region.

[0006] Therefore, an object of the present disclosure is to provide a method capable of appropriately evaluating the symmetry of layer thickness in the nose side region and the symmetry of layer thickness in the ear side region. [Means for solving the problem]

[0007] The information processing device of the present disclosure includes: The device is provided with a deformation means for deforming a first region and a second region in the fundus image, the first region and the second region being larger than the first region, so that an angle formed by a first straight line passing through a first characteristic portion related to the macula in the fundus image and located on the temporal side, and a second straight line passing through the first characteristic portion and a second characteristic portion related to the macula in the fundus image and located on the nasal side, approaches 180 degrees. Effect of the Invention

[0008] According to the present disclosure, the symmetry of the layer thickness in the nose side region and the symmetry of the layer thickness in the ear side region can be appropriately evaluated. [Brief description of the drawings]

[0009] [Figure 1] FIG. 1 is a block diagram of an information processing device 100. [Diagram 2] 4 is a flowchart showing the operation of a control unit 102. [Diagram 3] FIG. 2 is a diagram showing features of a fundus image. [Figure 4] FIG. 2 is a diagram showing features of a fundus image. [Diagram 5] 11A and 11B are diagrams illustrating a method of deforming a fundus image. [Figure 6] 11A and 11B are diagrams illustrating a method of deforming a fundus image. [Figure 7] 11A and 11B are diagrams illustrating a method of deforming a fundus image. [Figure 8] FIG. [Figure 9] 13A to 13C are diagrams illustrating a method for deforming a fundus image according to the second embodiment. [Figure 10] 13A to 13C are diagrams illustrating a method for deforming a fundus image according to the second embodiment. [Figure 11] 13A to 13C are diagrams illustrating a method for deforming a fundus image according to the second embodiment. [Figure 12] 11A and 11B are diagrams illustrating a method of deforming a fundus image. [Figure 13]FIG. 13 is a diagram showing a fundus image on which a grid is superimposed. [Figure 14] FIG. 13 is a diagram showing a fundus image on which a grid according to the third embodiment is superimposed. [Figure 15] 13A to 13C are diagrams showing features of a fundus image according to the fourth embodiment. [Figure 16] 13 is a flowchart showing an operation of a control unit 102 according to the third embodiment. [Figure 17] FIG. 17 shows a GUI displayed on a monitor 1700. [Figure 18] FIG. 17 shows a GUI displayed on a monitor 1700. [Figure 19] FIG. 19 shows a thickness map 1900. [Figure 20] 11A and 11B are diagrams illustrating a method of deforming a fundus image. [Figure 21] 11A and 11B are diagrams illustrating a method of deforming a fundus image. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, exemplary embodiments for carrying out the present disclosure will be described in detail with reference to the drawings. In the drawings, the same reference numerals are used between the drawings to indicate elements that are identical or functionally similar. In addition, in each drawing, some components, members, and processes that are not important for the description may be omitted.

[0011] In this specification, a fundus image is described as an image of the fundus acquired by various imaging techniques (modalities) such as an OCT device, a fundus camera, and a scanning laser ophthalmoscope (SLO). For example, the fundus image includes a tomographic image, a thickness map, an EnFace image, and a projection image. In this specification, the depth direction of the fundus is defined as the Z direction. A plane perpendicular to the Z direction is defined as the XY plane.

[0012] An embodiment of the present disclosure will be described.

[0013] 1 is a block diagram of an information processing device 100 in this embodiment. The information processing device 100 includes an input unit 101, a control unit 102, a display control unit 103, an operation unit 104, and a storage unit 105. The information processing device 100 is, for example, a computer or a tablet terminal (portable information terminal). The information processing device 100 does not need to be separate from an ophthalmic device such as an OCT device. For example, it may be incorporated into an information processing system that includes an ophthalmic device such as an OCT device.

[0014] The input unit 101 is, for example, a connector compatible with USB (Universal Serial Bus, registered trademark). Data is input to the input unit 101 from an ophthalmic device such as an OCT device. The input unit 101 and the ophthalmic device are connected, for example, by a cable. Here, the data input from the ophthalmic device includes a fundus image. The data input from the ophthalmic device may also include data on the subject (such as an identification number, axial length, age, eyesight, race, medical history, and whether or not the subject has severe myopia) and an image of a medical record. If an image of the medical record is included, data on the subject may be extracted from the image of the medical record using a text mining technique or the like. Here, data may be input to the input unit 101 from an external device such as a server in addition to the ophthalmic device. The input unit 101 and the external device may be directly connected by a cable or may be connected via a network. The input unit 101 and the external device may be connected not only by a wired connection but also by a wireless connection. As long as the input unit 101 and the external device can communicate with each other, the communication method is not important.

[0015] The data input from the ophthalmologic apparatus is output to the control unit 102 .

[0016] The control unit 102 is, for example, a CPU (Central Processing Unit). The control unit 102 performs image processing on the data input from the input unit 101. The image processing includes deformation processing of the fundus image. The control unit 102 is executed according to a program stored in the storage unit 105. Here, the control unit 102 may be a CPU, a MPU (Micro Processing Unit), a GPU (Graphical Processing Unit), or an FPGA (Field-Programmable Gate Array).

[0017] The display control unit 103 controls a display unit such as a display. The display control unit 103 is, for example, one of the functions provided in a CPU. The display control unit 103 controls the display unit to display data input from the control unit 102. The data displayed on the display unit is, for example, data on the subject, various images, and estimated results on ophthalmic diseases.

[0018] The operation unit 104 is, for example, a mouse or a keyboard. The operation unit 104 is operated by an examiner. Operation information by the examiner is input to the control unit 102.

[0019] The storage unit 105 is, for example, a non-volatile memory. The storage unit 105 stores a program for executing the control unit 102. The storage unit 105 also stores an operating system (OS), device drivers for peripheral devices, and programs for implementing various application software including programs for performing processes described below. The storage unit 105 also stores data necessary for various calculations.

[0020] [Characteristics of fundus images] First, the characteristics of a general fundus image will be described with reference to FIG. 3(a0) and FIG. 3(c0). FIG. 3(a0) shows a schematic diagram of a fundus image 300 of a right eye. The fundus image 300 includes a macula 301, a optic nerve 302, and a blood vessel 303. Here, in the case of the fundus image 300 of the right eye, the right side of the fundus image 300 is the nose side, and the left side of the fundus image 300 is the ear side. Also, the upper side of the fundus image 300 is the head side, and the lower side of the fundus image 300 is the leg side. FIG. 3(c0) shows a schematic diagram of a fundus image 300 of a left eye. The fundus image 300 includes a macula 301, a optic nerve 302, and a blood vessel 303, similar to the right eye. Here, in the case of the fundus image 300 of the left eye, unlike the right eye, the right side of the fundus image 300 is the ear side, and the left side of the fundus image 300 is the nose side. Similarly to the right eye, the upper side of the fundus image 300 is the head side, and the lower side of the fundus image 300 is the leg side. In this specification, the ear side is described as the left side in the fundus image of the right eye, and the right side in the fundus image of the left eye. The nose side is described as the right side in the fundus image of the right eye, and the left side in the fundus image of the left eye.

[0021] In photographing using an ophthalmologic device, the examiner sets the position of the fixation light so that the macular area 301 is located at the center of the fundus image. Then, the examiner photographs the image after confirming that the subject's eye is looking directly at the fixation light. In a fundus image photographed in this manner, in the case of a right eye, the macular area 301 is generally located approximately at the center of the fundus image 300, and the optic nerve 302 is generally located above the nasal side of the macular area 301, as shown in the fundus image 300 of FIG. 3(a0).

[0022] Next, the characteristics of general retinal layers will be described with reference to Figures 3 and 4. Here, the retinal layers refer to the retinal nerve fiber layer, the ganglion cell layer, the inner plexiform layer, and the like.

[0023] In the fundus image 300(a1) of FIG. 3(a1), a straight line 304 is drawn extending from the macular region 301 to the nasal side and the temporal side. The straight line 304 is drawn approximately horizontally with respect to the fundus image 300(a1). The straight line 304 is drawn as a solid line extending from the macular region 301 to the temporal side. The straight line 304 is drawn as a dashed line extending from the macular region 301 to the nasal side. In the fundus image 300(a2) of FIG. 4(a2), a straight line 401 is drawn passing through the macular region 301 and perpendicular to the straight line 304. Here, it is known that, among the four regions divided by the straight lines 304 and 401, the thickness (layer thickness) of the retinal layer in the upper temporal region 403 and the layer thickness in the lower temporal region 404 tend to be symmetrical with respect to the straight line 304.

[0024] In the fundus image 300(b1) of FIG. 3(b1), a straight line 305 is drawn connecting the macular region 301 and the optic papilla 302. The straight line 305 is drawn as a solid line extending from the macular region 301 toward the nasal side. The straight line 305 is drawn as a dashed line extending from the macular region 301 toward the temporal side. In addition, in the fundus image 300(b2) of FIG. 4(b2), a straight line 402 is drawn that passes through the macular region 301 and is perpendicular to the straight line 305. Here, it is known that, among the four regions divided by the straight lines 305 and 402, the thickness (layer thickness) of the retinal layer in the upper nasal region 405 and the layer thickness in the lower nasal region 406 tend to be symmetrical with respect to the straight line 305.

[0025] Conventionally, as a method for evaluating symmetry, a method is known in which a fundus image 300 is geometrically transformed (e.g., enlarged, reduced, rotated, translated, affine transformed) so that a straight line 305 connecting a macular region 301 and an optic nerve 302 becomes substantially horizontal, and the symmetry of the layer thickness is evaluated using the geometrically transformed fundus image. However, in the geometrically transformed fundus image, although the symmetry between the layer thickness of a nasal upper region 405 and the layer thickness of a nasal lower region 406 can be appropriately evaluated, there is a problem that the symmetry between the layer thickness of an ear upper region 403 and the layer thickness of an ear lower region 404 cannot be appropriately evaluated because the straight line 304 is not substantially horizontal.

[0026] In this embodiment, a modification method is described that enables appropriate evaluation of the symmetry between the layer thickness of the upper nose side region 405 and the layer thickness of the lower nose side region 406, and the symmetry between the layer thickness of the upper ear side region 403 and the layer thickness of the lower ear side region 404.

[0027] [First embodiment] In this embodiment, the description will be mainly given using a fundus image of the right eye, but the same applies to a fundus image of the left eye.

[0028] The flow chart of FIG. 2 shows the operation of the control unit 102 according to the first embodiment.

[0029] [Step S1: Image input] In step S1, a tomographic image of the fundus acquired by the OCT device is input from the input unit 101 to the control unit 102. Here, the tomographic image includes images captured at multiple B-scan positions. The operation of step S1 allows the control unit 102 to acquire three-dimensional data on the fundus of the subject's eye. Here, the A-scan refers to acquiring tomographic information from one point on the subject's eye. In addition, a B-scan refers to acquiring two-dimensional tomographic information in the transverse direction and depth direction of the subject's eye E by performing an A-scan multiple times in any transverse direction (main scanning direction). In this embodiment, tomographic images of both the right eye and the left eye of the same subject are input. If there is a difference in axial length between the right eye and the left eye, a process to correct this may be performed.

[0030] [Step S2: Image processing] In step S2, the control unit 102 performs image processing on the tomographic image input from the input unit 101. Step S2 is composed of the processes of step S21 (generation of a thickness map), step S22 (deformation of a thickness map), and step S23 (image analysis).

[0031] [Step S21: Thickness map generation] In step S21, the control unit 102 generates a thickness map using the tomographic image input in step S1. The thickness map is a map (map image) that represents the thickness (layer thickness) of an anatomically determined observation layer in the retina with luminance values ​​or the like for any coordinates (XY coordinates) in an XY plane perpendicular to the depth direction (Z direction) of the subject eye. An example of the observation layer is three layers, namely, the nerve fiber layer (NFL), the ganglion cell layer (GCL), and the inner plexiform layer (IPL), and the thickness map can be generated by accumulating these layer thicknesses. In addition, the thickness map may be generated from the layer thickness of only the nerve fiber layer (NFL), or an arbitrary layer may be selected and the thickness map may be generated based on the layer thickness of the selected layer. As a method of selecting an arbitrary layer, the boundary of each layer may be specified by manually drawing a line on the tomographic image, or the layer may be selected from the boundary of each layer obtained by segmentation processing. The segmentation processing is a process of dividing each layer of a tomographic image. Specifically, a layer structure is extracted from a tomographic image of the subject's eye, each layer is divided, and the thickness of each layer is calculated. Note that any known method may be used as the segmentation processing method and the thickness calculation method.

[0032] In the thickness map, the layer thickness at any coordinate (XY coordinate) may be displayed in pseudo-color. Alternatively, in the thickness map, the layer thickness at any coordinate (XY coordinate) may be displayed in grayscale brightness value. Alternatively, a thickness map displayed in pseudo-color and a thickness map displayed in grayscale brightness value may be displayed side by side. Alternatively, a thickness map displayed in pseudo-color and a thickness map displayed in grayscale brightness value may be displayed so that they can be switched. FIG. 19 is an example of a thickness map 1900 corresponding to the fundus image 300 of FIG. 3. In the thickness map 1900, the layer thickness is displayed in grayscale brightness value. In FIG. 19, the lighter the color (the higher the brightness value), the thinner the layer thickness.

[0033] Here, the control unit 102 may perform a reduction process or a trimming process on the input tomographic image before generating the thickness map. This method is expected to have the effect of reducing the processing load.

[0034] Next, the control unit 102 performs a correction process on the generated thickness map. An example of the correction process will be described below. One example of the correction process is a process (error correction process) for correcting the brightness value of a region that cannot be used for diagnosis in the thickness map. For example, if an error occurs in the layer segmentation process, the thickness at that position becomes a specific value, and is displayed as whiteout or blackout in the thickness map. The control unit 102 judges the region having the specific value as a region that cannot be used for diagnosis. Then, a process is performed to replace the brightness value of the region that cannot be used for diagnosis with an average value of the surroundings. Alternatively, the control unit 102 may remove the region that cannot be used for diagnosis from the thickness map. The control unit 102 may also replace or remove the brightness value of a region that is considered unnecessary for diagnosis, such as inside the nipple.

[0035] Furthermore, when it is determined that the image data input from the input unit 101 has low image quality and cannot be used for diagnosis, the control unit 102 can cause the display control unit 103 to display a message prompting re-imaging. This determination may be made visually by the examiner. Alternatively, it may be made based on a rule base based on the brightness of the image, the success rate of segmentation, etc. Alternatively, it may be made by a method using machine learning.

[0036] In addition, when generating the thickness map, the layer thickness value can be corrected based on the axial length data of the subject's eye. Here, the axial length data of the subject's eye may be acquired in step S1 or may be input by the examiner. When the axial length of the subject's eye is longer than that of the normal eye database, the retina is stretched, which has the effect of thinning the entire layer thickness. Therefore, the control unit 102 can correct the thickness map so as to reduce the effect of the layer thickness according to the axial length. The correction of the layer thickness according to the axial length may be performed using any known method. By such correction, it is possible to distinguish between a case where the layer thickness is thinned due to a lesion and a case where the layer thickness is thinned from a healthy state. In addition, since the imaging range of the fundus with respect to the scan angle changes when the axial length differs, the control unit 102 may perform a process of correcting the scale of the thickness map. In addition, when the subject has strong myopia, the axial length tends to be long. Therefore, when the subject has strong myopia, the control unit 102 may perform a similar correction on the thickness map. The axial length of the subject's eye and whether or not the subject has severe myopia may be determined based on input data relating to the subject.

[0037] In this embodiment, the explanation is mainly given using a thickness map, but it is not limited to the thickness map. Alternatively, a difference map using the difference when comparing the layer thickness with a normal eye database, or a blood vessel density map generated using an OCTAngiography image may be used.

[0038] [Step S22: Thickness map transformation] In step S22, the control unit 102 deforms the thickness map generated in step S21. In this embodiment, an example will be described in which an EnFace image is generated from a tomographic image input from the input unit 101, and the generated EnFace image is deformed to deform the thickness map. Here, an EnFace image is an image generated by projecting a tomographic image in the depth direction (Z direction). In general, when an EnFace image and a thickness map are generated from the same tomographic image, the thickness map is similarly deformed by deforming the EnFace image. Note that the control unit 102 that deforms the thickness map is an example of a deformation means.

[0039] A specific modification method will be described with reference to FIG.

[0040] First, the fundus image is segmented.

[0041] The fundus image 300(a3) in FIG. 5 is an EnFace image generated from a tomographic image input from the input unit 101. In addition to the straight lines 304 and 401 shown in the fundus image 300(a2) in FIG. 4, the straight line 305 connecting the macular region 301 and the optic nerve 302 is added to the fundus image 300(a3). The upper region on the nose side among the regions divided by the straight lines 401 and 305 is set as the region 501. The angle between the straight lines 401 and 305 in the region 501 is set as α1. The lower region on the nose side among the regions divided by the straight lines 401 and 305 is set as the region 502. The angle between the straight lines 401 and 305 in the region 502 is set as β1. Here, the positions of the macular region 301 and the optic nerve 302 may be set by an instruction from an operator, or may be set automatically by analyzing the fundus image. Here, straight lines 401 and 305 do not necessarily pass through macular region 301 itself, but may pass through the periphery of macular region 301. Also, straight line 305 does not necessarily pass through optic disc 302 itself, but may pass through the periphery of optic disc 302. Note that macular region 301 or the periphery of macular region 301 is an example of a first characteristic portion related to the macula. Also, optic disc 302 or the periphery of optic disc 302 is an example of a second characteristic portion related to the optic disc. Also, the solid line portion of straight line 304 is an example of a first straight line. Also, straight line 305 is an example of a second straight line.

[0042] Any straight line may be set manually instead of the straight line 401 and the straight line 305, or the values ​​of the angles α1 and β1 may be manually specified. The method of specifying each of them is not important, and they may be specified directly on the fundus image, or they may be specified by inputting coordinates or numerical values ​​using a user interface (not shown), or they may be specified by selecting from preset numerical values.

[0043] Next, the fundus image is deformed.

[0044] In this embodiment, an example will be described in which ear-side regions 403 and 404 (dotted regions in FIG. 5) are not deformed, and nose-side regions 501 and 502 are deformed. Fundus image 300(a4) is an image obtained after the control unit 102 deforms fundus image 300(a3). Regions 501b and 502b in fundus image 300(a4) are regions obtained after the control unit 102 deforms regions 501 and 502. In this embodiment, the control unit 102 enlarges region 501 and reduces region 502 so that the angle (=90 degrees+α1) between line 304 and line 305 approaches 180 degrees. In other words, the control unit 102 performs deformation by rotating line 305 around macular region 301 as a fulcrum so that line 305 approaches the dashed line portion of line 304. The straight line 305 that has been transformed is a straight line 305b in the fundus image 300(a4). In the fundus image 300(a4), an example is shown in which the angle between the straight lines 304 and 305b becomes 90 degrees+α2 as a result of the transformation. Note that the angle (90 degrees+α2) between the straight lines 304 and 305b does not necessarily have to be transformed to 180 degrees. If the angle (90 degrees+α2) between the straight lines 304 and 305b is closer to 180 degrees than the angle (=90 degrees+α1) between the straight lines 304 and 305, the effect of the present disclosure can be achieved.

[0045] Due to this deformation, the nose-side upper region 501 is deformed so as to be stretched in the circumferential direction, becoming region 501b. That is, the nose-side upper region 501 is enlarged. Also, the angle α1 is deformed to angle α2 (>α1). On the other hand, the nose-side lower region 502 is deformed in a direction in which it is compressed in the circumferential direction, becoming region 502b. That is, the nose-side lower region 502 is reduced. Also, the angle β1 is deformed to angle β2 (<β1). Note that the region consisting of the region 403 and the region 501 is an example of a first region. The first region is a region defined by the straight lines 304 and 305 in the fundus image. Also, the region consisting of the region 404 and the region 502 is an example of a second region. The second region is also a region defined by the straight lines 304 and 305 in the fundus image.

[0046] A more specific deformation method will be described with reference to Fig. 6. In a coordinate system with macular region 301 as the origin, line 304 as the x-axis, and line 401 as the y-axis, the angle θ (β1-β2) between line 305 and the x-axis is calculated, and an arbitrary point P1 on line 305 is transformed into point P2 on the x-axis corresponding to the angle θ. There is no particular method for calculating the coordinates of point P2, but the coordinates of point P2 can also be easily calculated by using a formula for a rotating coordinate system with the rotation angle of point P1 set to θ.

[0047] Similarly, a method of transforming the nasal upper region 501 into region 501b and the nasal lower region 502 into region 502b will be described with reference to Fig. 7. If the angle between the y-axis and a straight line (not shown) connecting an arbitrary point Q1 on the region 501 and the macula 301 is θ1, the rotation angle θ2 of the point Q2 corresponding to the point Q1 is θ2=θ1(α2 / α1)-θ1=θ1((α2 / α1)-1) In addition, if the angle between a line (not shown) connecting an arbitrary point R1 on the region 502 and the macula 301 and the line 305 is θ3, the rotation angle θ4 of the point R2 corresponding to the point R1 is θ4=θ3(β2 / β1)+(β1-β2-θ3)=θ3((β2 / β1)-1)+(β1-β2) It can be found by:

[0048] As described above, by applying the same transformation process to each coordinate of the region 501 and the region 502, the region 501b and the region 502b can be transformed. In the transformed region 501b and the region 502b, if there is no point S (not shown) of the original transformation corresponding to an arbitrary point S' (not shown) of the Cartesian coordinate system (a value is not assigned), the data of the adjacent coordinates may be used as is, or may be interpolated from nearby data. In addition, if there is no original transformation point such as an image end and it is not possible to interpolate from the vicinity, it may be displayed so that it is clear that there is no data, such as by blackening or shading. Conversely, if the coordinate after transformation is outside the image at the image end, the image size may be increased to prevent information loss. In addition, if there are multiple original transformation points (points S1 and S2) corresponding to a certain point S', the data of either point S1 or S2 may be used for point S', or the data of S1 and S2 may be averaged and used.

[0049] In addition, in this example, points P2, Q2, and R2 are transformed using a rotating coordinate system centered on the macular region 301, but a similar transformation process may be applied centered on a point other than the macular region 301, and each straight line used in the explanation may be replaced with a straight line that does not pass through the macular region 301.

[0050] In addition, the coordinates may be transformed using another transformation method without using the rotation angles α1 and β1. For example, the transformation may be performed using only the y coordinate component in a Cartesian coordinate system. For example, a straight line 1201 perpendicular to the dashed line portion of the straight line 304 is extended from an arbitrary point P1 on the straight line 305 of the fundus image 300 in FIG. 12, and transformation is performed on the straight line 1201 so that the intersection point of the straight line 1201 and the straight line 304 becomes P2. Similarly, an arbitrary point Q1 on the region 501 and an arbitrary point R1 on the region 502 may be transformed to a point Q2 and a point P2 on the straight line 1201, thereby transforming the region 501 and the region 502. Also. In this example, the straight line 1201 perpendicular to the straight line 304 is used for the description, but a straight line having an arbitrary inclination with respect to the straight line 304 may be used as the straight line 1201.

[0051] In addition, weighting may be performed using characteristics such as axial length and retinal distortion during coordinate transformation. In this example, the upper ear side region 403 and the lower ear side region 404 are assumed to be symmetrical with respect to a straight line 304 extending substantially horizontally from the macular region 301. However, the entire fundus image may rotate depending on the shooting conditions, and the regions 403 and 404 may not necessarily be symmetrical with respect to the straight line 304. In this case, a straight line 304' (not shown) may be used that is angled so that the difference between the regions 403 and 404 is small. In this case, it is preferable to rotate the entire fundus image 300 so that the straight line 304' is substantially horizontal before performing the transformation process.

[0052] Also, the fundus image 300 may be divided into a plurality of fundus images. For example, FIG. 20 shows partial images 2000(a) and 2000(b) obtained by cutting out the dotted parts of the fundus images 300(a2) and 300(b2) shown in FIG. 4. At this time, a part of the original fundus image 300 may be included in both partial images in an overlapping manner, or may not be included in any of the partial images. For example, FIG. 21 shows a diagram in which the partial images 2000(a) and 2000(b) are superimposed. At this time, the dark gray area 2101 is included in both partial areas in an overlapping manner, and the white area 2102 is not included in any of the partial areas. Here, an arbitrary transformation process may be applied to each of the partial images 2000(a) and 2000(b), and the subsequent step S23 (image analysis) may be performed. In addition, partial images 2000(a) and 2000(b) do not necessarily need to be transformed, and subsequent steps may be performed without transformation processing. In addition, when subsequent step S23 (image analysis) is performed on each partial image to obtain multiple analysis results, the multiple analysis results may be displayed individually, or a single result that combines the multiple analysis results may be obtained.

[0053] In addition, in this example, an example is described in which the EnFace image or the Projection image is deformed to deform the corresponding thickness map as well, but only the thickness map may be deformed without deforming the EnFace image or the Projection image. Also, instead of the EnFace image, a fundus image acquired by another device such as a fundus photograph or an SLO may be used. In this case, it is preferable to align the fundus photograph or SLO before deformation with the thickness map in advance, and apply a similar deformation process to the thickness map in accordance with the deformation of the fundus photograph or SLO.

[0054] Moreover, the object to be deformed is not limited to a two-dimensional image, and OCT three-dimensional data may be deformed. The two-dimensional images (for example, EnFace images, Projection images, and thickness maps) described in this embodiment are images generated by projecting information in an A-scan of OCT in the Z direction. Therefore, if the coordinate transformation of each XY in a two-dimensional image can be calculated, the coordinate transformation of the A-scan in the three-dimensional OCT is also possible. By changing the XY coordinates of the A-scan, deformed OCT three-dimensional data is generated. Then, any deformed two-dimensional image (EnFace images, Projection images, and thickness maps) can be generated using the deformed OCT three-dimensional data.

[0055] [Step S23: Image analysis] In step S23, the control unit 102 analyzes the fundus image using the fundus image and thickness map deformed in step S22. Specifically, the control unit 102 superimposes a grid that defines a plurality of evaluation regions in the fundus image and an evaluation index on the fundus image 300 (a4) obtained by deformation. As an example of the grid, FIG. 8 shows a square grid 801 and a concentric grid 802 for the right eye. The average value or the median value of the thickness map in the evaluation region is assigned as an evaluation index to a plurality of evaluation regions (A1, B1, etc.) included in each grid. Here, the evaluation regions are assigned symbols for convenience. For example, in a square grid 801 with 4 rows and 5 columns, rows A, B, C, and D are assigned from the top, columns 1 to 5 are assigned from the ear side, and symbols A1 to E5 are assigned to each evaluation region. In addition, in the concentric grid 802, which is divided into four on the inside and outside, the inside grid is I, the outside grid is E, the upper ear side is 1, the upper nose side is 2, the lower ear side is 3, and the lower nose side is 4, and the codes I1 to I4 and E1 to E4 are assigned to each evaluation region. On the other hand, the codes of the square grid 803 for the left eye and the concentric grid 804 for the left eye are in a left-right reverse relationship with the codes of the grid for the right eye. The average value and the median value of the thickness map in the evaluation region are examples of evaluation indices generated using the thickness information of the fundus. The control unit 102 is also an example of an image generating means that generates a fundus image on which the grid and the evaluation indices are superimposed. The evaluation index may be the standard deviation or variance of the thickness map.

[0056] FIG. 13 shows a fundus image 1301 and a fundus image 1302 in which a square grid 801 and a concentric grid 802 are respectively superimposed on the fundus image 300 (a4) of FIG. 5. Note that the fundus image 1301 and the fundus image 1302 are examples of the second fundus image. Here, consider the symmetry of each evaluation region. In the case of the square grid 801 of the fundus image 1301, there is a tendency towards symmetry in the evaluation regions in the same columns of rows A and D (for example, there is a tendency towards symmetry between A1 and D1). Also, there is a tendency towards symmetry in the evaluation regions in the same columns of rows B and C (for example, there is a tendency towards symmetry between B1 and C1). In the case of the concentric grid 802 of the fundus image 1302, there is a tendency towards symmetry between I1 and I3. Also, there is a tendency towards symmetry between I2 and I4. Also, there is a tendency towards symmetry between E1 and E3. Also, there is a tendency towards symmetry between E2 and E4. Therefore, the examiner evaluates the symmetry of the fundus image by comparing grids with a corresponding relationship of symmetry. Various methods can be considered for the method of evaluating symmetry. For example, the values of each evaluation region are normalized by the average value, and in the evaluation regions with a symmetric relationship, the value (thickness) of the evaluation region located above (for example, A1) is subtracted from the value (thickness) of the evaluation region located below (for example, D1) to calculate the difference information between the thickness of the evaluation region located above and the thickness of the evaluation region located below. Let the calculated difference information be R and the reference value be N. If R < -N (group 1), it can be evaluated that the upper part is thin. If -N ≤ R ≤ N (group 2), there is no upper-lower difference (symmetric). If N < R (group 3), it can be evaluated that the lower part is thin. Furthermore, when there are many evaluation regions in group 1 or group 3, it can be evaluated that the symmetry is broken. Here, the method of evaluating symmetry is not limited to this, and the sum of the squares of the differences may be used, or weights may be assigned to each grid. Also, the reference value N may be set manually or automatically set from the average value of each evaluation region. Also, the information of groups 1 to 3 classified using the calculated difference information R or the reference value N may be further superimposed on the fundus image 1301 or the fundus image 1302. Note that the fundus image 1301 or the fundus image 1302 on which these are superimposed is an example of the third fundus image.

[0057] In addition, although the present example describes an example in which symmetry is determined using a grid and a thickness map, symmetry may be analyzed by assigning other analysis values ​​to the map, such as a difference map obtained by comparison with a normal eye database or a blood vessel density map obtained from an OCTAngiography image. When comparing the deformed fundus image with another fundus image or a normal eye database, it is advisable to apply a deformation process similar to that in step S22 to the fundus image or normal eye database to be compared before comparison. Of course, a difference map or the like may be generated before deforming the fundus image in step S22, and then the difference map may be deformed in step S22.

[0058] [Step S3: Display] In step S3, the control unit 102 outputs the fundus image generated in step S23 to the display control unit 103. Here, the image to be output may be an image generated by arbitrarily combining the fundus image, thickness map, grid, analysis result, etc. obtained by deformation, in addition to the fundus image generated in step S23. When the fundus image is displayed on the monitor, the fundus image and thickness map before deformation and the fundus image and thickness map after deformation may be displayed side by side. Alternatively, the fundus image and thickness map before deformation and the fundus image and thickness map after deformation may be displayed by switching between them. In addition, when displaying the fundus images of the left and right eyes or the same eyes side by side or by switching between them for comparison or follow-up observation, it is preferable to apply the same deformation process to all the fundus images and display them. In addition, the fundus image may be output to a printer or the like in addition to the monitor. Alternatively, it may be output to the storage unit 105 or an external storage medium (not shown).

[0059] For example, FIG. 17 shows an example of a GUI that displays fundus images of the left and right eyes on a monitor 1700. First, the coordinates of the macular area 301(a) and the optic ... For example, the macular region 301(b) and the optic ...

[0060] Moreover, square maps 801 and 803 are superimposed on the deformed fundus images 1701(c) and 1701(d), respectively. In each of the square grids 801 and 803, the symmetry may be evaluated by comparing the corresponding A and D rows, and the corresponding B and C rows, vertically, and the result may be displayed. In addition, in the square grids 801 and 803, the symmetry of the fundus images of the left and right eyes may be evaluated by comparing grids with the same symbol, and the result may be displayed. The method of evaluating the symmetry of the fundus images of the left and right eyes may be the same as the evaluation method used for one eye, or may be a different evaluation method. In addition, concentric grids 802 and 804 may be used instead of the square grids 801 and 803.

[0061] FIG. 18 shows an example of a GUI that displays an analysis result on the monitor 1700 by deforming fundus images of a subject's eye photographed at different times for follow-up observation. The fundus images of a subject's eye photographed at different times refer to, for example, a fundus image photographed today, a fundus image photographed one year ago, and a fundus image photographed two years ago. The monitor 1700 generates and displays fundus images 1801(a)-(d) and corresponding deformed fundus images 1801(e)-(h). Each fundus image may be displayed one by one, or may be displayed by switching between them. When a value for deforming any of the fundus images 1801(a)-(d) (such as the position of the macula 301 and the position of the optic optic optic disc 302) is changed, the same value may be applied to the other fundus images to deform all the fundus images at once. For example, when the position of the macular region 301 and the position of the optic nerve optic ...

[0062] [Second embodiment] In the first embodiment, a case has been described in which, as shown in Fig. 5(a3), among the regions divided by the straight lines 304, 305, and 401, the temporal regions 403 and 404 are not deformed, and the nasal regions 501 and 502 are deformed. In the first embodiment, the straight line 401 is set as a line perpendicular to the straight line 304, on the assumption that the temporal side of the macular region 301 is symmetric. However, in an actual fundus image, the temporal side of the straight line 401 is not necessarily symmetric due to the influence of individual differences and the like.

[0063] Therefore, in this embodiment, the problem is solved by partially modifying the first embodiment. Since the information processing device according to this embodiment has the same configuration as in FIG. 1, the same reference symbols are used and the description is omitted. In addition, since the information processing device according to this embodiment performs the same process of the flowchart as in FIG. 2, the same reference symbols are used and the description is omitted. Below, the control unit 102 according to this embodiment will be described, focusing on the differences from the first embodiment.

[0064] [Step S22: Thickness map transformation] In step S22, the input fundus image is deformed. A specific method will be described with reference to FIG. 9. A straight line 304 is approximately horizontal to the macular region 301 of the fundus image 300 in FIG. 9(a), and a straight line 305 connects the macular region 301 and the optic disc 302. Straight lines 901 and 902 having arbitrary angles γ1 and γ2 with respect to the straight line 304 are extended from the macular region 301. In the region divided by the straight lines 304, 305, 901, and 902, the upper ear side is region 403, the lower ear side region 404, the upper nasal side region 501, and the lower nasal side region 502 are region 403. Here, the angle of the corner of the macular region 301 in region 501 is α1, the angle of the corner of the macular region 301 in region 502 is β1, and the angle of the corner of the macular region 301 in the combined region of regions 403 and 404 is γ=γ1+γ2. At this time, similarly to the first embodiment, the regions 403 and 404 of the fundus image 300 are not deformed, but the straight line 305 is deformed so as to coincide with the dashed line portion of the straight line 304, thereby deforming the regions 501 and 502. The result after deformation is shown in Fig. 9(b). The straight line 901 is an example of a third straight line, and the straight line 902 is an example of a fourth straight line.

[0065] The arbitrary angles γ1 and γ2 may be set manually, or the arbitrary angles γ1 and γ2 may be set automatically so that the index of symmetry with respect to the straight line 304 is the highest. The index of symmetry may be calculated, for example, from the difference between thickness maps at the same distance in the perpendicular direction to a reference straight line. Also, as shown in FIG. 10, the arbitrary angles γ1 and γ2 may be 0. Also, as shown in FIG. 11, a straight line 1101 having an arbitrary inclination from the macular region 301 may be used instead of the straight line 304. The straight line 1101 may be set manually, or the straight line 1101 may be set automatically so that the index of symmetry with respect to the straight line 1101 is the highest. Also, the temporal side of the straight line 1101 from the macular region 301 is shown by a solid line, and the nasal side is shown by a dashed line, but the region 501 and the region 502 can be deformed by deforming the straight line 305 so that it coincides with the dashed line portion of the straight line 1101. Alternatively, the entire fundus image 300 may be rotated in advance so that the straight line 1101 becomes substantially horizontal (coincides with the straight line 304), and then the deformation may be performed.

[0066] Furthermore, when the values ​​of γ1 and γ2 are different, the ear-side regions 403 and 404 may be deformed by rotating the straight line 1101 so that γ1 = γ2 = γ / 2, or the regions 403, 404, 501, and 502 may be deformed by rotating the straight lines 901 and 902. When rotating the straight lines 901 and 902, the nose-side regions 501 and 502 may not be deformed except in the vicinity of the straight lines 901 and 902, or the ear-side regions 403 and 404 may not be deformed but the nose-side regions 501 and 502 may be deformed by compressing (reducing) or stretching (expanding) in the direction of rotation. Also, the ear-side regions 403 and 404 and some or all of the nose-side regions 501 and 502 may be deformed by compressing (reducing) or stretching (expanding) in the direction of rotation. Moreover, it is not necessary that γ1=γ2. Even if γ1=γ2 before transformation, transformation processing may be applied, and γ1≠γ2 after transformation may also be acceptable.

[0067] 11 do not necessarily pass through the macular region 301 and the optic disc 302, and any position may be specified on the fundus image or by coordinates, etc. Also, the angles of the angles formed by the lines may be freely set.

[0068] In addition, when this processing is applied to fundus images of the left and right eyes, the arbitrary angles γ1, γ2 and the straight line 1101 may be set to individual values ​​for each fundus image, or may be linked between the left and right eyes. In addition, when displaying fundus images taken with different devices or multiple fundus images in follow-up observation, when the arbitrary angles α1, β1, γ1, γ2 and the straight lines 305, 901, 902, 1101, etc. are changed for one fundus image, the other fundus images may also be changed in conjunction. In addition, when the examiner changes the type of map to be displayed, such as switching the layer targeted by the thickness map, the arbitrary angles and straight lines may hold the same values ​​as before the map change, or may hold different values ​​for each type of map. In addition, a value applied to an arbitrary fundus image may be transformed by applying a common value to another fundus image. In addition, these images may be arbitrarily combined, arranged, switched, or superimposed for display.

[0069] [Third embodiment] In the first and second embodiments, a method for superimposing a square grid 801 or a concentric grid 802 on a deformed fundus image or thickness map has been described. In the present embodiment, a method for superimposing a grid on a pre-deformed fundus image or thickness map by partially modifying the first and second embodiments will be described.

[0070] The information processing device according to this embodiment has the same configuration as in Fig. 1, and therefore the same reference symbols are used and the description is omitted. Also, the information processing device according to this embodiment performs the same process as in Fig. 2, and therefore the same reference symbols are used. Below, the control unit 102 according to this embodiment will be described, focusing on the differences from the first embodiment.

[0071] In FIG. 16, step S24 (thickness map inverse deformation) is added after step S23 in FIG.

[0072] [Step S24: Thickness map inverse transformation] In step S24, the thickness map obtained by deformation in step S22 is inversely deformed so as to return to the state before deformation. At this time, the results of the analysis in step S23 are also inversely deformed. Specifically, the fundus images 1301 and 1302 with the grids superimposed thereon shown in Fig. 13 are deformed by inverse transformation into fundus images 1401 and 1402 shown in Fig. 14, and the superimposed grids 801 and 802 are deformed into grids 801b and 802b.

[0073] In this embodiment, for the sake of convenience, a method has been described in which a fundus image that has been deformed is returned to the original fundus image by inverse deformation. However, the fundus image may not be deformed, and the deformed grids 801b and 802b may be directly superimposed on the fundus image before deformation.

[0074] [Fourth embodiment] In the first and second embodiments, a method of deforming the image by setting the straight lines 304 and 305 as straight lines and dividing the image into ear-side and nose-side regions as shown in Fig. 3 has been described. However, as shown in Fig. 15(a), a fundus image may have symmetry with respect to a curve 1501 rather than a straight line. In that case, division into ear-side and nose-side regions alone may not be sufficient.

[0075] Therefore, in this embodiment, the problem is solved by partially modifying the first and second embodiments. Since the information processing device according to this embodiment has the same configuration as in FIG. 1, the same reference symbols are used and the description is omitted. In addition, since the information processing device according to this embodiment performs the same process as in the flowchart in FIG. 2, the same reference symbols are used and the description is omitted. Below, the control unit 102 according to this embodiment will be described, focusing on the differences from the first embodiment.

[0076] [Step S22: Thickness map transformation] In step S22, the input fundus image is deformed. A specific method will be described with reference to Fig. 15. Fig. 15 shows an example in which a fundus image 300b is generated by deforming a curve 1501 in the fundus image 300 so that the curve 1501 becomes a straight line 1501b.

[0077] 15(a) shows an auxiliary straight line 1502 that intersects with the curve 1501 at a given point on the curve 1501. When the curve 1501 is transformed into a straight line 1501b, the auxiliary straight line 1502 is transformed into an auxiliary straight line 1502b that intersects with the straight line 1501b at a given point. Similarly, by transforming an arbitrary point on the auxiliary straight line 1502 onto the straight line 1502b, the blood vessel 303 is transformed into the blood vessel 303b.

[0078] Here, the arbitrary curve 1501 may be set manually. Alternatively, the curve 1501 may be set automatically so that the index of symmetry with respect to the transformed straight line 1501b is maximized. In addition, in the present embodiment, the method of transforming the fundus image by setting the auxiliary straight line 1502 has been described, but a method of dividing the fundus image into a plurality of regions as shown in FIG. 15(a) and transforming each region may also be used.

[0079] Although the preferred embodiments of the present disclosure have been described above, it goes without saying that the present disclosure is not limited to these embodiments, and various modifications and changes are possible within the scope of the gist of the present disclosure.

[0080] (Other embodiments) The disclosed technology can also be realized by executing the following process. That is, the disclosed technology can also be realized by supplying software (programs) that realize one or more functions of the various embodiments described above to a system or device via a network or a storage medium, and having a computer (or a CPU, MPU, etc.) of the system or device read and execute the programs. The computer has one or more processors or circuits, and may include multiple separate computers or a network of multiple separate processors or circuits to read and execute computer-executable instructions. In this case, the processor or circuit may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), or a field programmable gateway (FPGA). The processor or circuit may also include a digital signal processor (DSP), a data flow processor (DFP), or a neural processing unit (NPU).

[0081] The disclosure of this embodiment includes the following configuration, method, and program.

[0082] (Configuration 1) An information processing device comprising: a deformation means for deforming a first region and a second region in a fundus image, the first region and the second region being larger than the first region, so that an angle formed by a first straight line passing through a first characteristic portion related to the macula in the fundus image and located on the ear side, and a second straight line passing through the first characteristic portion and a second characteristic portion related to the optic disc in the fundus image and located on the nasal side, approaches 180 degrees.

[0083] (Configuration 2) The information processing device according to configuration 1, wherein the transformation means transforms the first area and the second area by rotating the second straight line around the first feature portion as a fulcrum so that an angle between the first straight line and the second straight line approaches 180 degrees.

[0084] (Configuration 3) The information processing device according to configuration 1 or 2, wherein the deformation means deforms the first area and the second area by enlarging the first area and shrinking the second area so that the angle between the first line and the second line approaches 180 degrees.

[0085] (Configuration 4) The deformation means is An information processing device according to any one of configurations 1 to 3, in which, in the first region, a region on the ear side of a third straight line located in the first region and passing through the first feature portion is deformed, but a region on the nose side of the third straight line is deformed, and in the second region, a region on the ear side of a fourth straight line located in the second region and passing through the first feature portion is deformed, but a region on the nose side of the fourth straight line is deformed.

[0086] (Configuration 5) The deformation means is An information processing device according to any one of configurations 1 to 4, wherein in the first region, a region on the ear side of a third straight line that passes through the first feature and is located in the first region is deformed without deforming a region on the nose side of the third straight line, and in the second region, a region on the ear side of a fourth straight line that passes through the first feature and is located in the second region is deformed without deforming a region on the nose side of the fourth straight line.

[0087] (Configuration 6) An information processing device according to any one of configurations 1 to 5, further comprising an image generation means for generating a second fundus image in which a grid defining a plurality of evaluation areas and an evaluation index in the evaluation areas are superimposed on the fundus image obtained by deformation by the deformation means.

[0088] (Configuration 7) An information processing device according to any one of configurations 1 to 6, wherein the deformation means inversely deforms the second fundus image so that the angle between the first straight line and the second straight line in the second fundus image approaches the angle between the first straight line and the second straight line in the fundus image.

[0089] (Configuration 8) 7. The information processing device according to configuration 6, wherein the evaluation index is at least one of the mean, median, standard deviation, and variance of the thickness information of the fundus included in the evaluation region.

[0090] (Configuration 9) The image generating means includes: Difference information of the evaluation indexes of evaluation areas that are symmetrical with respect to the first straight line; The information processing device according to configuration 6, further generating a third fundus image on which difference information of the evaluation indexes of evaluation regions that are in a symmetrical relationship with respect to the second straight line is further superimposed.

[0091] (Configuration 10) 10. The information processing device according to any one of configurations 1 to 9, wherein the fundus image is a thickness map.

[0092] (Configuration 11) An information processing device according to any one of configurations 1 to 10, wherein at least one of the first feature portion and the second feature portion is specified by an instruction from an operator or is specified based on an analysis result of the fundus image.

[0093] (Configuration 12) An information processing device described in any of configurations 1 to 11, wherein when at least one of the first feature portion and the second feature portion is specified by instruction from an operator in a fundus image of one of the right eye or left eye of a subject, the specified information is used to specify at least one of the first feature portion and the second feature portion in the other fundus image of the subject.

[0094] (Configuration 13) 13. The information processing device according to any one of configurations 1 to 12, further comprising a display control unit that controls a display unit to display at least one of the fundus image and a fundus image obtained by deformation by the deformation means.

[0095] (Configuration 14) 14. The information processing device according to claim 13, wherein the display control unit controls the display unit to display a fundus image of the right eye obtained by deformation by the deformation means and a fundus image of the left eye obtained by deformation by the deformation means side by side.

[0096] (Configuration 15) An information processing device according to configuration 13, wherein the display control unit controls the display unit to display side by side multiple fundus images obtained by photographing the test eye at different times and multiple fundus images obtained by deforming the multiple fundus images by the deformation means.

[0097] (Configuration 16) The information processing device of configuration 14 or 15, wherein when at least one of the first feature portion and the second feature portion is specified by an instruction from an operator in any one of the fundus images displayed on the display unit, the deformation means uses the specified information to specify at least one of the first feature portion and the second feature portion in other fundus images.

[0098] (Configuration 17) an imaging device for capturing the fundus image; The information processing device according to any one of configurations 1 to 16, which is communicably connected to the photographing device; An information processing system comprising:

[0099] (Method 1) A deformation method for deforming a first region and a second region in a fundus image, the first region and the second region being larger than the first region, the first region and the second region being defined by the first straight line and the second straight line, so that an angle formed by a first straight line passing through a first characteristic feature related to the macula in the fundus image and located on the temporal side, and a second straight line passing through the first characteristic feature and a second characteristic feature related to the macula in the fundus image and located on the nasal side, approaches 180 degrees.

[0100] (Program 1) A program for causing a computer to execute the transformation method according to Method 1. [Explanation of symbols]

[0101] 101 Input section 102 Control section 103 Display control unit 104 Operation section 105 Storage section

Claims

1. An information processing device comprising: a deformation means for deforming a first region and a second region in a fundus image, the first region and the second region being larger than the first region, so that an angle formed between a first straight line passing through a first characteristic portion related to the macula in the fundus image and located on the ear side, and a second straight line passing through the first characteristic portion and a second characteristic portion related to the optic disc in the fundus image and located on the nasal side, approaches 180 degrees.

2. 2. The information processing device according to claim 1, wherein the deformation means deforms the first region and the second region by rotating the second straight line around the first characteristic portion as a fulcrum so that an angle between the first straight line and the second straight line approaches 180 degrees.

3. 2. The information processing device according to claim 1, wherein the deformation means deforms the first area and the second area by enlarging the first area and shrinking the second area so that the angle between the first line and the second line approaches 180 degrees.

4. The deformation means is 2. The information processing device according to claim 1, wherein, in the first region, a region on the ear side of a third straight line that passes through the first feature and is located in the first region is deformed, but a region on the nose side of the third straight line is deformed without deforming a region on the ear side of the third straight line, and in the second region, a region on the nose side of a fourth straight line that passes through the first feature and is located in the second region is deformed without deforming a region on the ear side of the fourth straight line.

5. The deformation means is 2. The information processing device according to claim 1, wherein, in the first region, a region on the nasal side of a third straight line that passes through the first feature and is located in the first region is deformed, but a region on the ear side of the third straight line is deformed without deforming a region on the nasal side of the third straight line that passes through the first feature and is located in the second region, and, in the second region, a region on the ear side of the fourth straight line is deformed without deforming a region on the nasal side of a fourth straight line that passes through the first feature and is located in the second region.

6. The information processing device according to claim 1 , further comprising an image generating means for generating a second fundus image in which a grid defining a plurality of evaluation areas and an evaluation index in the evaluation areas are superimposed on the fundus image obtained by deformation by the deformation means.

7. 7. The information processing device according to claim 6, wherein the deformation means inversely deforms the second fundus image so that the angle between the first straight line and the second straight line in the second fundus image approaches the angle between the first straight line and the second straight line in the fundus image.

8. The information processing apparatus according to claim 6 , wherein the evaluation index is at least one of a mean value, a median value, a standard deviation, and a variance of the thickness information of the fundus included in the evaluation region.

9. The image generating means includes: Difference information of the evaluation indexes of evaluation areas that are symmetrical with respect to the first straight line; The information processing apparatus according to claim 6 , further comprising: generating a third fundus image on which difference information of the evaluation indexes of evaluation regions that are in a symmetrical relationship with respect to the second straight line is further superimposed.

10. The information processing apparatus according to claim 1 , wherein the fundus image is a thickness map.

11. The information processing apparatus according to claim 1 , wherein at least one of the first feature portion and the second feature portion is specified by an instruction from an operator, or is specified based on an analysis result of the fundus image.

12. 2. An information processing device as described in claim 1, wherein when at least one of the first feature portion and the second feature portion is specified by instruction from an operator in a fundus image of one of the right eye or left eye of a subject, at least one of the first feature portion and the second feature portion is specified in the other fundus image of the subject using the specified information.

13. The information processing apparatus according to claim 1 , further comprising a display control unit that controls a display unit to display at least one of the fundus image and the fundus image obtained by deformation by the deformation means.

14. The information processing apparatus according to claim 13 , wherein the display control unit controls the display unit to display a fundus image of the right eye obtained by the deformation by the deformation means and a fundus image of the left eye obtained by the deformation by the deformation means side by side.

15. The information processing device according to claim 13 , wherein the display control unit controls the display unit to display, side by side, a plurality of fundus images obtained by photographing the subject's eye at different times and a plurality of fundus images obtained by deforming the plurality of fundus images by the deformation means.

16. The information processing device according to claim 14 or 15, wherein when at least one of the first feature portion and the second feature portion is specified by an instruction from an operator in any one of the fundus images displayed on the display unit, the deformation means uses the specified information to specify at least one of the first feature portion and the second feature portion in another fundus image.

17. A deformation method for deforming a first region and a second region in a fundus image, the first region and the second region being larger than the first region, the first region and the second region being defined by the first straight line and the second straight line, so that an angle formed by a first straight line passing through a first characteristic portion related to the macula in the fundus image and located on the ear side, and a second straight line passing through the first characteristic portion and a second characteristic portion related to the macula in the fundus image and located on the nasal side, approaches 180 degrees.

18. A program for causing a computer to execute the transformation method according to claim 17.

19. an imaging device for capturing the fundus image; An information processing device according to claim 1 , which is communicatively connected to the photographing device; An information processing system comprising:

Citation Information

Patent Citations

  • Image processing apparatus, image processing method and program

    JP2022038751A