Image processing device and image processing method

Abstract

To execute image data enlargement processing suitable for a type of image data, a diagnosis purpose, etc. on an eye to be examined.SOLUTION: An image processing device includes display control means for causing a tomographic image of an eye to be examined acquired using an OCT optical system to be displayed on a touch panel including a detection surface that can detect a touch panel operation. In response to the touch panel operation to the tomographic image displayed on the touch panel, the display control means can display the tomographic image by subjecting the tomographic image to enlargement processing in a short direction without subjecting it to enlargement processing a longitudinal direction.SELECTED DRAWING: Figure 4

Description

[Technical field]

[0001] The disclosed technology relates to an image processing device and an image processing method. [Background technology]

[0002] Patent document 1 discloses an image processing device that displays image data of a test eye acquired by an ophthalmic examination device on a report and enlarges the image data by touch panel operations (e.g., pinch-out operations, tap operations) on the image data. [Prior art documents] [Patent documents]

[0003] [Patent Document 1] JP 2018-246 A Summary of the Invention [Problem to be solved by the invention]

[0004] Here, depending on the type of image data of the subject's eye, the purpose of diagnosis, and the like, simply enlarging or reducing the image data may cause problems in diagnosis.

[0005] One of the objects of the disclosed technology is to perform enlargement processing of image data suitable for the type of image data of a subject's eye, diagnostic purpose, etc.

[0006] In addition to the above-mentioned objective, another objective of the present invention is to achieve effects that are derived from the various components shown in the description of the embodiments of the invention described below, and that cannot be obtained by conventional techniques. [Means for solving the problem]

[0007] One of the disclosed image processing devices is An image processing device including a display control means for displaying a tomographic image of a subject's eye obtained by using an OCT optical system on a touch panel including a detection surface capable of detecting a touch panel operation, The display control means Before operating the touch panel, The tomographic image displayed on the touch panel When two fingers are in contact with the screen in the short direction In addition, the tomographic image can be displayed by enlarging it in the short side direction without enlarging it in the long side direction. Effect of the Invention

[0008] According to one of the disclosed techniques, it is possible to perform enlargement processing of image data suited to the type of image data of a subject's eye, diagnostic purpose, and the like. [Brief description of the drawings]

[0009] [Figure 1] 1 is a diagram illustrating a schematic functional configuration of an image processing apparatus according to a first embodiment. [Diagram 2] FIG. 11 is a flowchart showing a report display according to the first embodiment. [Diagram 3] FIG. 13 is a diagram illustrating an example of a report according to the first embodiment. [Figure 4] FIG. 11 is a diagram showing a display magnification setting of an SLO image according to the first embodiment. [Diagram 5] FIG. 11 is a diagram showing a display magnification setting of an SLO image according to the first embodiment. [Figure 6] FIG. 11 is a diagram showing an example of a report according to the second embodiment. [Figure 7] FIG. 4 is a diagram showing the setting of the display magnification of a tomographic image according to the first embodiment. [Figure 8] FIG. 11 is a diagram showing rotation of a report display element according to the first embodiment. [Figure 9] FIG. 11 is a diagram illustrating translation of a report display element according to the first embodiment. [Figure 10] FIG. 13 is a diagram showing brightness and contrast adjustment of a report display element in Example 1. [Figure 11] FIG. 11 is a diagram illustrating synchronization of enlargement and reduction of report display elements according to the second embodiment. [Figure 12]FIG. 11 is a diagram illustrating synchronization of enlargement and reduction of report display elements according to the second embodiment. [Figure 13] FIG. 11 is a diagram showing settings of enlargement / reduction positions of report display elements according to the second embodiment. [Figure 14] FIG. 13 is a diagram showing a full-screen tomographic image according to the third embodiment. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

[0010] Hereinafter, the embodiments will be described with reference to the drawings. The same or equivalent components, members, and processes shown in each drawing will be given the same reference numerals, and duplicated descriptions will be omitted as appropriate. In addition, some components, members, and processes that are not important for the explanation may be omitted in each drawing.

[0011] Example 1 An example of the image processing device of this embodiment includes a display control means for displaying a tomographic image of the subject's eye obtained using the OCT optical system or a report related to the tomographic image on a touch panel including a detection surface capable of detecting touch panel operation. The example of the image processing device of this embodiment can enlarge and display the tomographic image in the short direction without enlarging it in the longitudinal direction in response to a touch panel operation (e.g., a pinch-out operation in the short direction) on the tomographic image displayed on the touch panel. Note that, when the touch panel operation is a pinch-out operation in the diagonal direction of the tomographic image, the example of the image processing device of this embodiment may be configured to enlarge and display the tomographic image in both the longitudinal and short directions. The example of the image processing device of this embodiment may also be configured to enlarge a part of the tomographic image and display it in the report in response to a touch panel operation on the tomographic image in the report displayed on the touch panel. In addition, the image processing device of this embodiment may be configured to display a report generated from one test result on a touch panel, and control changes to the display of the test results, such as various images (e.g., different enlargement processes are performed) depending on the type of input (e.g., differences in the designated positions) made by an operator using two fingers on the touch panel to a display element on the report.

[0012] In this embodiment, the examination results of an OCT (Optical Coherence Tomography) imaging device are used as an example of an ophthalmic imaging device. The OCT imaging device of this embodiment is capable of acquiring one or more SLO (Scanning Laser Ophthalmoscopy) images during an examination. The OCT imaging device of this embodiment includes an OCT optical system. The image processing device of this embodiment may be configured to be able to communicate with the ophthalmic imaging device via wired or wireless communication, or may be built into the ophthalmic imaging device.

[0013] First, referring to FIG. 1, a schematic functional configuration according to this embodiment will be described. As shown in FIG. 1, the acquisition unit 100 acquires the examination result from an ophthalmic imaging device. The examination result includes information such as the photographed image, analysis result, and diagnosis result in addition to the subject information such as the date of birth and sex. In this embodiment, an image photographed by an ophthalmic imaging device and an image reconstructed from OCT data are described as an examination image. The examination result may be acquired from a storage device (not shown). The generation unit 101 generates a report based on the examination image and analysis result from the examination result acquired by the acquisition unit 100. The report includes display elements such as the examination image and analysis result. The display unit 102 is a touch panel capable of simultaneous multi-point input, and the report created by the creation unit 101 is displayed by a display control means. The touch panel includes, for example, a detection surface capable of detecting a touch panel operation. At this time, the detection surface is capable of detecting at least one of a change in relative distance when at least two designated positions designated on the touch panel are moved relatively to each other and a rotation amount. The image processing device of this embodiment may be configured to include an acquisition unit 100 and a generation unit 101. The display unit 102 may be provided in the image processing device or the ophthalmic imaging device of this embodiment, or may be separate from them and configured to be able to communicate with them via wired or wireless communication.

[0014] A flow chart of report display according to this embodiment will be described with reference to FIG. 2. First, in step S200, a patient is selected from a patient screen (not shown) in response to an instruction from the operator. In step S201, one examination result is selected in response to an instruction from the operator. Here, the operator selects an examination result related to the macular region photographed by scanning the fundus of the subject's eye with an OCT imaging device. In step S202, a report is generated using the examination result selected in step S201. In step S203, the report generated in step S202 is displayed on the display unit 102.

[0015] FIG. 3 shows an example of the report generated in step S202. The front image display area 300 displays an SLO image 304. The image displayed in the front image display area 300 may be a front two-dimensional image other than the SLO image. For example, it may be a fundus image or a fluorescent fundus image captured by a separate fundus camera. The tomographic image display area 301 displays a tomographic image 306 of the examination result. The tomographic image displayed in the tomographic image display area 301 may be a pseudo tomographic image generated from a three-dimensional image along an arbitrary line on the XY surface. The pseudo front image display area 302 displays a pseudo front image 305 reconstructed based on the tomographic image of the examination. The three-dimensional image display area 303 displays a three-dimensional image based on the tomographic image of the examination. The analysis results may be superimposed on each image. For example, a layer boundary may be detected from a tomographic image, a layer thickness between desired layers may be calculated, and the layer thickness may be superimposed on the SLO image 304 as a thickness map. This makes it easier for the operator to visually recognize the distribution of layer thickness. A known method can be used to detect the layer boundary.

[0016] Also, referring to FIG. 4, a description will be given of a change in the display method of the report display element according to this embodiment, taking as an example the setting of enlarging and reducing (hereinafter, enlarging and reducing) the display of a tomographic image. FIG. 4(a) shows an example in which an operator performs a pinch-out operation in the vertical direction (the short side direction of the tomographic image) on the tomographic image display area 301 of the tomographic image 306 displayed on the touch panel. At this time, the image processing device of this embodiment can enlarge the tomographic image 306 in the vertical direction (the depth direction in the tomographic image) and display it on the touch panel, as shown in FIG. 4(b). Note that the tomographic image 306 may be configured not to be enlarged in the horizontal direction (the long direction of the tomographic image). Also, the pinch-out operation can be performed, for example, by moving two fingers in contact with the touch panel so that the distance between them becomes longer. Also, the enlargement magnification changes, for example, according to the amount of movement of the fingers in the pinch-out operation. Thereby, as shown in FIG. 4(c), a report in which the tomographic image 306 is enlarged in the tomographic image display area 301 can be displayed. Note that the image to be enlarged and displayed may be made high resolution. Furthermore, the operator can confirm the image displayed in a reduced size as shown in Fig. 4(a) by performing a pinch-in operation on the display image in the state of Fig. 4(b). Note that the pinch-in operation can be performed, for example, by moving two fingers in contact with the touch panel so that the distance between them becomes shorter. The reduction ratio changes according to the amount of movement of the fingers in the pinch-in operation.

[0017] Here, when a tomographic image is displayed, the length per pixel in the horizontal direction (photographing range) and the vertical direction (depth direction) may not be in a 1:1 ratio. This is because the horizontal photographing range is several mm to several tens of mm, whereas the thickness of the retina is several hundred μm, which is different in range. To observe the state of the retina in detail in the tomographic image, it is important to enlarge the depth direction. During a pinch-in / pinch-out operation (hereinafter, pinch operation) on the tomographic image 306, both or either one of a guide indicating the midpoint of the two fingers in the pinch operation (for example, a rectangular frame indicated by a dotted line in the figure) and a guide indicating the magnification rate according to the amount of movement of the two fingers (for example, a rectangular frame indicated by a solid line in the figure) may be displayed. That is, the display control means of this embodiment may display a guide regarding the magnification process of the tomographic image on the tomographic image when it is detected on the detection surface that the operator's fingers are in contact with the tomographic image displayed on the touch panel. In addition, the display indicating the magnification rate may be displayed not only during the pinch operation but also while the image is being enlarged or reduced. For example, the shape of the guide may change depending on the position where the two fingers are placed, and when the two fingers are placed vertically or horizontally, the shape is a rectangle, and when the two fingers are placed diagonally, the shape is a square. That is, the display control means of this embodiment may display the guide on the tomographic image so that it is possible to distinguish that different enlargement processes are executed depending on the positional relationship of the two fingers touching the tomographic image displayed on the touch panel. This allows the operator to understand whether the currently displayed image is enlarged or reduced at the same ratio in both length and width, or whether the ratio of length and width is different.

[0018] It should be noted that the enlargement / reduction by the pinch operation is not limited to the vertical direction. The image may be enlarged / reduction in the horizontal direction by pinching in the horizontal direction. The direction of the enlargement / reduction may be determined by the movement direction of the two fingers. Specifically, for example, when the operator pinches in a direction of 60 degrees from the horizontal direction, the image is enlarged / reduction in the horizontal and vertical directions at a ratio of 1:√3 and displayed. The direction of the enlargement / reduction may be approximately the same as the movement direction of the finger, but does not have to be strictly the same. For example, the detection of the movement direction of the finger may be set in 15 degree increments. This allows the operator to enlarge / reduce only in the vertical or horizontal direction when the operator pinches in a generally vertical or horizontal direction, and to enlarge / reduce while maintaining the aspect ratio when the operator pinches in a generally diagonal direction. The operator can perform the desired enlargement / reduction operation without performing a strict operation. Alternatively, the enlargement / reduction process may be unique regardless of the movement direction of the fingers of the operator's pinch operation. For example, the enlargement / reduction process may be performed in all directions even when the operator pinches in the vertical direction, or may be performed only in the vertical direction when the operator pinches in the diagonal direction.

[0019] Note that the reduction operation is performed so that the vertical or horizontal length of the tomographic image 306 does not become shorter than the tomographic image display area 301. Specifically, if the length of any side of the reduced tomographic image 306 is longer in both the vertical and horizontal directions than the length of the corresponding side of the tomographic image display area 301, the reduction process is performed according to the operation of the operator. On the other hand, if the length of any side of the reduced tomographic image 306 is shorter than the corresponding length of the tomographic image display area 301, the reduction process is performed so that the magnification is such that the length of the relevant side matches the length of the corresponding side of the tomographic image display area 301. This makes it possible to prevent the tomographic image 306 from being displayed smaller than the operator intends.

[0020] When the analysis results are superimposed on the tomographic image 306, the superimposed analysis results are enlarged or reduced in synchronization with the enlargement or reduction process of the tomographic image 306. For example, when the boundary lines of layers are superimposed on the tomographic image, the image processing device of this embodiment can display the tomographic image 306 while maintaining the correspondence between the boundary lines of the superimposed layers. This allows, for example, the operator to observe each layer of the tomographic image in more detail, thereby improving the efficiency of diagnosis.

[0021] Also, for example, when a wide range of the retina is photographed, the retina is curved, so unless the tomographic image is photographed widely not only in the horizontal direction but also in the vertical direction (depth direction of the retina), the entire retina may not be photographed. Here, consider a case where a tomographic image photographed at a wide angle and a large depth range is displayed in the same display area as a tomographic image photographed at a normal shooting range (a tomographic image photographed at a narrow angle and a small depth range). In this case, the tomographic image photographed at a wide angle and a large depth range is displayed in a reduced size overall compared to the tomographic image photographed at a normal shooting range. At this time, by making it possible to enlarge and display the tomographic image in the vertical direction while keeping a wide range displayed in the horizontal direction, it is possible to observe each layer in detail while observing the entire retina in a wide range. This allows the operator to easily realize the enlarged and reduced display.

[0022] In this embodiment, the tomographic image is expanded or contracted, but the present invention is not limited to this. For example, the SLO image may be expanded or contracted by a similar operation. As shown in FIG. 7(a), the SLO image may be expanded as shown in FIG. 7(b) by performing a pinch operation on the SLO image. This operation causes a report in which the SLO image 304 is expanded in the front image display area 300, as shown in FIG. 7(c). When the SLO image 304 is expanded or contracted, each display element displaying the same area as the SLO image 304 may be expanded or contracted synchronously. For example, when the periphery of the macular area of ​​the SLO image 304 is expanded, the periphery of the macular area of ​​the pseudo front image 305 may be expanded to the same display magnification as the SLO image 304. When a thickness map or the like is superimposed on the SLO image 304, the thickness map expanded or contracted synchronously with the SLO image 304 and each display area displaying the same area may be expanded or contracted. When the display magnifications of the SLO image 304 and the pseudo front image 305 are different, the display magnification may be expanded or contracted to the same magnification. For example, when the display magnification of the SLO image 304 is 100% and the display magnification of the pseudo front image 305 is 150%, in the case of enlarging the image by 1.5 times by the enlargement process, the display magnification of the SLO image 304 may be set to 150% and the display magnification of the pseudo front image 305 to 225%. This allows the operator to easily observe a desired portion of a plurality of display elements included in the report. In addition, the enlargement / reduction process by the pinch operation shown in this embodiment can be performed on display elements such as analysis results and subject information displayed in the report. For example, the display elements may be a motion contrast image or an OCTA image generated from a tomographic image, an En-Face image projected onto a plane based on any two reference planes in the depth direction from a three-dimensional image, or a fundus image captured by a fundus camera. In addition, the display elements may be test results obtained from a measuring instrument such as a perimeter, a comparison map with a normal database, a thickness map, a thickness profile, and a graph or table displaying analysis results. In addition, the display elements may be test information such as a reception number and a test date, and subject information such as the subject's name, date of birth, and sex. This allows the operator to enlarge or reduce any display element, thereby improving the efficiency of diagnosis.

[0023] In addition, in this embodiment, the configuration in which the display element is enlarged or reduced by a pinch operation with two fingers has been shown, but the present invention is not limited to this. For example, a configuration in which three or more fingers are used may be used. As shown in FIG. 5(a), on the front image display area 300 displaying the SLO image 304, the operator designates a position 500 with one finger on the touch panel and performs a pinch operation with two fingers. At this time, the image processing device of this embodiment executes a process of enlarging or reducing the SLO image 304 with the position 500 as the center. Also, a configuration in which the display element is enlarged or reduced by a double tap with two fingers may be used. At this time, the operator executes the enlargement or reduction by double tapping the SLO image 304 on the front image display area 300. At this time, the enlargement or reduction magnification may be constant, or may be set in advance in the image processing device of this embodiment. Alternatively, a configuration in which the display element is enlarged or reduced by a double tap with multiple fingers may be used. At this time, the SLO image 304 can be enlarged or reduced to the maximum or minimum magnification by double tapping with multiple fingers. With this configuration, the operator can easily realize an operation of switching the display to the maximum enlargement magnification or the minimum reduction magnification. Such various operations using a finger on a touch panel are examples of touch panel operations.

[0024] In this embodiment, the display method change of the report display element is described as an example of enlargement and reduction, but is not limited to enlargement and reduction. For example, the display element may be rotated, moved in parallel, or adjusted in brightness and contrast. First, the rotation process of the SLO image will be described as an example of the rotation process of the report display element. For example, as shown in FIG. 8(a), the SLO image 304 on the front image display area 300 may be rotated clockwise as shown in FIG. 8(c) by performing a sliding operation to draw a circle clockwise while touching the SLO image 304 on the touch panel with a finger. Note that the sliding operation and the rotation rate of the SLO image 304 do not necessarily need to be synchronized. For example, by configuring the SLO image 304 to rotate by 15 degrees each time the finger makes one circle on the SLO image 304, the operator can rotate the SLO image 304 while making fine adjustments.

[0025] Also, as shown in FIG. 8(b), a configuration using two fingers, a thumb and an index finger, may be used. In this case, the thumb is set as the rotation center of the SLO image 304, and the SLO image 304 is rotated according to the movement of the index finger, so that the operator can rotate the SLO image 304 around any position of the SLO image 304. This allows the operator to adjust the display angle so that the optic nerve and the macula are horizontal by rotating an image in which, for example, the optic nerve and the macula are simultaneously displayed around the optic nerve. In this case, when a grid having a plurality of analysis regions and an analysis result 800 in the analysis region are superimposed on the SLO image 304, the analysis result 800 superimposed and displayed may be rotated in synchronization with the rotation of the SLO image 304. Note that, when the analysis result superimposed and displayed includes characters, the characters displayed in the analysis result 800 may be displayed without being rotated, as shown in FIG. 8(c). Note that the rotation process may be applied to any of the report display elements, as in the case of the enlargement / reduction process. Alternatively, a configuration may be adopted in which only the analysis region is rotated. For example, in order to observe the progression of glaucoma, the symmetry of the layer structure and layer thickness of the nerve fiber layer and the like with respect to the line connecting the macula and the optic disc may be evaluated. In this case, in order to arrange the grid parallel to the line connecting the macula and the optic disc, it is sufficient to rotate only the grid on the SLO image 304. This makes it possible to rotate and set the analysis region in a desired direction.

[0026] Next, the configuration of the parallel movement processing of the report display element is described. The parallel movement processing of the SLO image is described as an example. For example, as shown in FIG. 9(a), the SLO image 304 on the front image display area 300 may be moved in parallel and displayed by performing a sliding operation (hereinafter, a drag operation) while pressing and holding the image 304, as shown in FIG. 9(b). When the analysis result is superimposed on the SLO image 304, the superimposed analysis result may be moved in parallel in synchronization with the translation of the SLO image 304. The parallel movement processing may be applied to any report display element, similar to the enlargement / reduction processing.

[0027] Furthermore, the configuration of brightness / contrast adjustment (hereinafter, B / C adjustment) processing is shown. B / C adjustment of a tomographic image is described as an example. For example, as shown in FIG. 10(a), the brightness or contrast can be adjusted by dragging the tomographic image 306 on the tomographic image display area 301 up and down or left and right. Also, as shown in FIG. 10(b), a configuration may be adopted in which the brightness and contrast can be adjusted simultaneously by dragging diagonally. Note that the B / C adjustment processing may be applied to any report display element, similar to the enlargement / reduction processing.

[0028] With the above configuration, the operator can view all the display elements necessary for diagnosis on the report, and can zoom in and out to observe areas of interest, such as diseased areas, on SLO images or tomographic images, thereby improving the efficiency of diagnosis.

[0029] Example 2 In the first embodiment, the display magnification setting of display elements in a report generated from one test result is described. In the second embodiment, the display magnification setting of display elements in a report generated from two test results is described. The image processing device of this embodiment can perform enlargement / reduction operations on images of multiple tests simultaneously. Note that the general functional configuration of this embodiment is similar to that of the first embodiment, and therefore description thereof will be omitted.

[0030] First, a flow chart of report display according to this embodiment will be described with reference to FIG. 2. First, in step S200, a patient is selected from a patient screen (not shown) in response to an instruction from the operator. In step S201, one each of the left eye examination result and the right eye examination result for the same patient is selected in response to an instruction from the operator. Here, the examination result for the macula photographed by scanning the fundus of the subject eye by the OCT device is selected. The selection of the examination result may be performed automatically. For example, when the operator selects the examination result for the left eye or the right eye, the examination result for the opposite eye of the same patient on the same date and the same photographed site may be automatically selected. This allows the operator to view the report for both eyes without selecting multiple examination results. In step S202, a report is generated using the examination result selected in step S201. Then, in step S203, the report generated in step S202 is displayed on the display unit 102.

[0031] FIG. 6 shows an example of a report generated in step S202 for simultaneously displaying a plurality of examination results. The right eye image display area 600 displays an SLO image 601 of a right eye examination. The left eye image display area 602 displays an SLO image 603 of a left eye examination. The images displayed in the right eye image display area 600 and the left eye image display area 602 may be front two-dimensional images other than the SLO images. The tomographic images, projected images, and three-dimensional images described in the first embodiment are also displayed for the right eye examination and the left eye examination, respectively, in the same manner as the SLO images. The analysis results may be superimposed on each image. The display method change of the report display element according to this embodiment is the same as that of the first embodiment, and therefore will not be described.

[0032] Also, the synchronization of the display method change of the report display element according to this embodiment will be described. When the operator performs a zoom process on the SLO image 601 by pinching, the image processing device of this embodiment performs a process of zooming in and out of the same area on the SLO image 603. Specifically, for example, when the operator zooms in on the periphery of the macular area of ​​the SLO image 601, the image processing device of this embodiment automatically zooms in and displays the periphery of the macular area of ​​the SLO image 603 in synchronization. For example, as an example of the synchronization of the zooming in of the front two-dimensional image, the synchronization of the zooming in of the SLO image will be described. FIG. 11(a) is an SLO image displayed in the right eye image display area 600. Also, FIG. 11(b) is an SLO image displayed in the left eye image display area 602. At this time, when, for example, the first rectangular area 1100 is zoomed in response to the touch panel operation on the SLO image, the second rectangular area 1101 is synchronously zoomed in. Here, the position of the first rectangular region 1100 in the SLO image of the right eye and the position of the second rectangular region 1101 in the SLO image of the left eye have a positional relationship that is symmetrical (with respect to the center of the face).

[0033] An example of a tomographic image obtained by scanning the fundus in the horizontal direction (left-right direction) will be described. FIG. 11(c) is a horizontal tomographic image of the right eye, with the left side of the image being the ear side of the fundus and the right side being the nasal side of the fundus. FIG. 11(d) is a horizontal tomographic image of the left eye, with the positional relationship reversed from FIG. 11(c). At this time, when, for example, the third rectangular area 1102 in FIG. 11(c) is enlarged in response to a touch panel operation on the horizontal tomographic image, the fourth rectangular area 1103 in FIG. 11(d) is enlarged synchronously. Here, the position of the third rectangular area 1102 in the horizontal tomographic image of the right eye and the position of the fourth rectangular area 1103 in the horizontal tomographic image of the left eye are in a positional relationship that is symmetrical (based on the center of the face).

[0034] An example of a tomographic image scanned in a vertical direction (longitudinal direction) relative to the fundus will be described. FIG. 11(e) is a vertical tomographic image of the right eye, with the left side of the image being the upper part of the fundus and the right side being the lower part of the fundus. FIG. 11(f) is a vertical tomographic image of the left eye, with the same positional relationship as FIG. 11(e). At this time, when, for example, the fifth rectangular area 1104 in FIG. 11(e) is enlarged in response to a touch panel operation on the vertical tomographic image, the sixth rectangular area 1105 in FIG. 11(f) is enlarged synchronously. Here, the sixth rectangular area 1105 is at a position corresponding to the position of the fifth rectangular area 1104 in the vertical tomographic image (for example, the same position relative to the common origin of both images).

[0035] In addition, when the angle of view of the image enlarged by the operation of the operator and the image enlarged synchronously are different, the position corrected for the difference due to the angle of view may be enlarged. This makes it easier for the operator to observe the desired part in multiple examinations. In addition, this synchronization process is also performed on the display areas that are paired with the left eye examination and the right eye examination displayed in the report. In addition, although the same part in multiple display elements is configured to be enlarged and reduced synchronously, this is not limited. A part in which the relative position of the operation position of the operator in the area of ​​the display element is equal may be configured to be enlarged and reduced synchronously. For example, as an example of synchronization of enlargement of a front two-dimensional image, synchronization of enlargement of an SLO image will be described. FIG. 12(a) is an SLO image of the left eye. Also, FIG. 12(b) is an SLO image obtained by photographing the left eye of the same patient at different times. At this time, when the first rectangular area 1200 in FIG. 12(a) is enlarged in response to the touch panel operation on the SLO image, for example, the second rectangular area 1201 in FIG. 12(b) is enlarged synchronously. Here, the second rectangular region 1201 is at a position corresponding to the position of the first rectangular region 1200 in the SLO image (eg, at the same position relative to a common origin of both images).

[0036] An example of a tomographic image obtained by scanning the fundus in the horizontal direction (left-right direction) will be described. FIG. 12(c) is a horizontal tomographic image of the left eye, with the left side of the image being the nasal side of the fundus and the right side being the temporal side of the fundus. FIG. 12(d) is a horizontal tomographic image obtained by photographing the left eye of the same patient at different times. At this time, when the third rectangular area 1202 in FIG. 12(c) is enlarged in response to a touch panel operation on the horizontal tomographic image, for example, the fourth rectangular area 1203 in FIG. 12(d) is enlarged in synchronization. Here, the fourth rectangular area 1203 is at a position corresponding to the position of the third rectangular area 1202 in the horizontal tomographic image (for example, the same position with respect to the common origin of both images).

[0037] An example of a tomographic image scanned in a vertical direction (longitudinal direction) relative to the fundus will be described. FIG. 12(e) is a vertical tomographic image of the right eye, with the left side of the image being the upper part of the fundus and the right side being the lower part of the fundus. FIG. 12(f) is a vertical tomographic image obtained by photographing the right eye of the same patient at different times. At this time, for example, when the fifth rectangular area 1204 in FIG. 12(e) is enlarged in response to a touch panel operation on the vertical tomographic image, the sixth rectangular area 1205 in FIG. 12(f) is enlarged synchronously. Here, the sixth rectangular area 1205 is at a position corresponding to the position of the fifth rectangular area 1204 in the vertical tomographic image (for example, the same position relative to the common origin of both images). Note that when the angle of view of the image enlarged by the operator's operation and the image enlarged synchronously are different, the position may be enlarged by correcting the difference due to the angle of view. This makes it possible to realize a simple configuration for enlarging and reducing display elements even in a report (hereinafter, a follow-up observation report) that displays multiple test results for the same side of the same patient obtained on multiple dates and times.

[0038] In this embodiment, when an image of one of the examinations is enlarged or reduced while a plurality of examinations are displayed, the corresponding images in the other examinations are enlarged or reduced in synchronization, but it is not essential to enlarge or reduce in synchronization. For example, the operator may select whether or not to synchronize. As in the first embodiment, the enlargement and reduction of each display element in the same examination may be synchronized. In this embodiment, the report display element is enlarged or reduced according to the operation position of the operator, and the same position relative to the report display element is automatically enlarged or reduced in synchronization, but this is not limited to this. The enlargement and reduction center of the operation image and the enlargement and reduction center of the synchronized image may be arbitrarily set. For example, an example of an operation in which the operator specifies the enlargement and reduction center by tapping is shown. FIG. 13(a) shows a tomographic image operated by the operator and a tomographic image enlarged and reduced in synchronization. FIG. 13(b) shows a tomographic image enlarged from FIG. 13(a) and a tomographic image enlarged and reduced in synchronization. The operator specifies the zoom center 1300 and the zoom center 1301 in Fig. 13(a) and performs a zoom operation, thereby zooming in around the zoom center as shown in Fig. 13(b). Note that the operator does not have to specify the zoom center. The macula or optic disc identified by the analysis of the test image may be used as the zoom center. This allows the operator to easily compare parts displayed at different relative positions between the images.

[0039] In this embodiment, the report configuration based on two examinations is shown, but is not limited thereto. For example, a follow-up observation report displaying three or more examinations may be used. In this case, the operator may perform a pinch operation on a display element of one of the examinations, and the display elements of the other examinations may be enlarged or reduced in synchronization. Note that in this embodiment, the configuration in which the enlargement and reduction of the display elements are synchronized is described, but is not limited thereto. For example, the rotation, translation, brightness and contrast adjustment, etc. of the display elements described in the first embodiment may be synchronized.

[0040] With the above configuration, the operator can view all the display elements necessary for diagnosis on a report showing multiple examinations, and can zoom in and out to observe areas of interest, such as diseased areas, on SLO images or tomographic images, improving the efficiency of diagnosis.

[0041] Example 3 In the third embodiment, the display can be switched between a report displaying one test result and a screen displaying an enlarged version of the report display elements (hereinafter, full-screen screen).

[0042] The schematic functional configuration, the flowchart of report display, the generated report, and the change in the display method of report display elements according to this embodiment are similar to those in the first embodiment, and therefore the description will be omitted.

[0043] The switching between display of the report and the full-screen screen (hereinafter, screen transition) according to this embodiment will be described with an example of screen transition of the full-screen screen of the tomographic image. By double-tapping the tomographic image 306 on the tomographic image display area 301 of FIG. 3, the tomographic image full-screen screen shown in FIG. 13 is displayed. At this time, the tomographic image displayed on the full-screen screen is displayed by taking over the display method of the tomographic image 306 before transition to the full-screen screen. For example, when the tomographic image 306 is in a state in which the macular portion is enlarged, the macular portion is also displayed in a state in which it is enlarged on the full-screen screen. In addition, when the full-screen screen is closed and the report of FIG. 3 is displayed again, the tomographic image 306 is displayed by taking over the display method of the tomographic image before closing the full-screen screen. The display method includes the enlargement, rotation, translation, and brightness / contrast adjustment of the display elements. Note that the method of transitioning to the full-screen screen is not limited to the double-tap operation by the operator. It may be a long tap operation. In this embodiment, a configuration in which the tomographic image is displayed on the full-screen screen is shown, but is not limited thereto. For example, a full-screen SLO image may be displayed by double-tapping the SLO image 304 on the front image display area 300 in Fig. 3. Alternatively, the display element may be a comparison map with a normal database, a thickness map, a thickness profile, or the like. This allows the operator to display a full-screen image of any display element without having to reset the display method from scratch in order to observe the display element in more detail, thereby improving the efficiency of diagnosis.

[0044] (Variation 1) In this embodiment, the touch panel operation using fingers has been described, but the input method is not limited to this. Operation may be performed using multiple stylus pens instead of fingers. Furthermore, the input device does not need to be pen-shaped, and may be any input device that the touch panel responds to. For example, in the case of a capacitive touch panel, the input device is not limited to any particular shape as long as the contact surface with the touch panel is made of a conductive material.

[0045] (Variation 2) In this embodiment, the zooming of an image is described by pinching in and pinching out, but this is not limited to this. For example, it is possible to assign any operation by switching the operation mode. For example, in the first embodiment, an example of adjusting the brightness or contrast of a tomographic image by dragging is described, but by switching between the brightness contrast mode and the zooming mode in the tomographic image, it is possible to perform different operations with the same movement. That is, when the zooming mode is selected in the tomographic image, the zooming may be performed by dragging up and down, and the image may be moved by dragging left and right. This allows operation with one finger or one pen.

[0046] (Other Examples) The present invention can also be realized by executing the following process. That is, the present invention can also be realized by supplying software (programs) that realize one or more functions of the various embodiments and modifications described above to a system or device via a network or a storage medium, and having a computer (or a CPU, MPU, etc.) of the system or device read and execute the programs. The computer has one or more processors or circuits, and may include multiple separate computers or a network of multiple separate processors or circuits to read and execute computer-executable instructions.

[0047] In this case, the processor or circuitry may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), or a field programmable gateway (FPGA). The processor or circuitry may also include a digital signal processor (DSP), a data flow processor (DFP), or a neural processing unit (NPU).

Claims

1. An image processing device including a display control means for displaying a tomographic image of a subject's eye obtained by using an OCT optical system on a touch panel including a detection surface capable of detecting a touch panel operation, The display control means is an image processing device that is capable of enlarging and displaying the tomographic image in the short direction without enlarging it in the long direction when two fingers are placed side by side in contact with the short direction of the tomographic image displayed on the touch panel before the touch panel operation.

2. 2. The image processing device according to claim 1, wherein the display control means, when the touch panel operation is a pinch-out operation in the short side direction, enlarges and displays the tomographic image in the short side direction without enlarging it in the long side direction, and when the touch panel operation is a pinch-out operation in the diagonal direction of the tomographic image, enlarges and displays the tomographic image in both the long side direction and the short side direction.

3. 3. The image processing device according to claim 1, wherein the display control means, when it is detected on the detection surface that an operator's finger is in contact with the tomographic image displayed on the touch panel, displays a guide regarding enlargement processing of the tomographic image on the tomographic image.

4. 4. The image processing device according to claim 3, wherein the display control means displays the guide on the tomographic image in such a manner that it is identifiable that different enlargement processes are executed depending on the positional relationship of two fingers touching the tomographic image displayed on the touch panel.

5. An image processing device having a display control means for displaying a medical image of a test eye obtained using an OCT optical system on a touch panel including a detection surface capable of detecting a touch panel operation, The display control means is an image processing device that, when the touch panel operation is a rotation operation and an image in which the analysis results of the medical image are superimposed on the medical image is displayed on the touch panel, is capable of rotating and displaying the analysis area of ​​the analysis result without rotating and displaying the characters contained in the analysis result.

6. The image processing device according to any one of claims 1 to 5, wherein the display control means changes the display of one of a plurality of images obtained by photographing the test eye at different times by operating a touch panel, and synchronously changes the display of the corresponding images photographed at the different times.

7. The image processing device according to claim 6, wherein the display control means synchronously changes the display of a plurality of images obtained by photographing the test eye at different times, or a plurality of images including an image of the left eye and an image of the right eye, at symmetrical positions corresponding to the type of image operated on the touch panel.

8. The image processing device according to claim 1 , wherein the display control means performs different enlargement processes depending on the type of image in response to a touch panel operation on the image displayed on the touch panel.

9. The image processing device according to claim 1 , wherein the detection surface is capable of detecting at least one of a change in a relative distance and an amount of rotation when at least two designated positions designated on the touch panel are moved relatively to each other.

10. A step of displaying a tomographic image of the subject's eye obtained by using the OCT optical system on a touch panel including a detection surface capable of detecting a touch panel operation; a step of enlarging and displaying the tomographic image in the short-side direction without enlarging the tomographic image in the long-side direction when two fingers are in contact with the tomographic image displayed on the touch panel side by side before the touch panel operation; An image processing method comprising:

11. A step of displaying a medical image of a test eye obtained using an OCT optical system on a touch panel including a detection surface capable of detecting a touch panel operation; When the touch panel operation is a rotation operation and an image in which an analysis result of the medical image is superimposed on the medical image is displayed on the touch panel, a step of rotating an analysis area of ​​the analysis result without rotating characters included in the analysis result for display; An image processing method comprising:

12. A program for causing a computer to execute the image processing method according to claim 10 or 11.

Images