Information processing device and ophthalmic examination device
The information processing device addresses the challenge of displaying tomographic images with narrow angles and large depth ranges by adjusting scales based on imaging device type, ensuring clear visibility of regions of interest without complex optical adjustments.
Patent Information
- Application Number
- JP2021133354
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-08-18
- Publication Date
- 2025-12-23
- Estimated Expiration
- 2041-08-18
AI Technical Summary
Conventional tomographic imaging techniques face challenges in displaying tomographic images with a narrow angle of view and large depth range, leading to regions of interest, such as the retina, being crushed or not displayed due to differences in depth direction, making it difficult to visualize these areas effectively.
An information processing device that controls the display of tomographic images by adjusting the scale based on the depth direction length and the type of imaging device used, ensuring that regions of interest are displayed clearly without requiring complex optical system adjustments.
Improves the visibility of regions of interest in tomographic images by appropriately scaling and positioning them within the display area, regardless of the imaging device used, thus enhancing the clarity and usability of the images.
Smart Images

Figure 0007790891000003 
Figure 0007790891000004 
Figure 0007790891000005
Abstract
Description
[Technical Field]
[0001] The technology disclosed in this specification relates to an information processing device and an ophthalmic examination device. [Background technology]
[0002] Optical coherence tomography (OCT) and other tomographic imaging devices allow for three-dimensional observation of the internal structure of the eye. OCT is widely used in ophthalmology because it is useful for more accurate diagnosis of diseases.
[0003] One type of OCT is TD-OCT (Time Domain OCT), which combines a broadband light source with a Michelson interferometer. TD-OCT moves the reference mirror at a constant speed and measures the interference light obtained by combining the reference light with the backscattered light acquired by the signal arm, thereby obtaining the reflected light intensity distribution in the depth direction of the subject's eye.
[0004] However, since TD-OCT requires mechanical movement of the reference mirror, it is difficult to acquire images at high speed. Therefore, a type of OCT called SD-OCT (Spectral Domain OCT) was developed that acquires images at higher speeds by using a broadband light source to acquire interference light via a spectroscope.
[0005] Furthermore, swept source optical coherence tomography (SS-OCT) has been developed, which can detect high-frequency interference light by temporally dispersing it using a wavelength-swept light source that sweeps the wavelength at high speed. SS-OCT makes it possible to obtain tomographic images with a wide field of view and a deep depth range that include tissues such as the choroid and sclera of the subject's eye.
[0006] Patent Document 1 discloses a technique for making it easier to visually recognize layer boundaries by enlarging a tomographic image at the same magnification when the tomographic image is acquired with a wide angle of view and a large depth range. [Prior art documents] [Patent documents]
[0007] [Patent Document 1] Patent Publication No. 2021-37170 Summary of the Invention [Problem to be solved by the invention]
[0008] Here, it is conceivable to acquire not only a tomographic image with a wide angle of view and a large depth range as disclosed in Patent Document 1, but also a tomographic image with a narrower angle of view and a large depth range than the disclosed angle of view. In this case, even though the tomographic image acquired with a narrow angle of view has a large depth range, if it is displayed in the same display area as the tomographic image acquired with a wide angle of view, for example, the area of interest, such as the tissue of the subject's eye or the layer boundary of the retina, may be crushed in the depth direction, making it difficult to view.
[0009] When displaying a tomographic image acquired with a narrow angle of view and a wide depth range in the display area, if the tomographic image is simply enlarged to the same size as disclosed in Patent Document 1, some areas of the tomographic image in a direction intersecting the depth direction of the subject's eye will not be displayed.
[0010] One of the disclosed techniques aims to improve the visibility of a region of interest in a subject's eye.
[0011] In addition to the above-mentioned objective, the present invention can also be positioned as another objective of the present invention by achieving effects that cannot be obtained by conventional technologies, which are derived from the various configurations shown in the detailed description of the invention described below. [Means for solving the problem]
[0012] The technology disclosed in this specification is 1. An information processing device that acquires a tomographic image of a subject's eye using interference light obtained by combining return light from the subject's eye irradiated with measurement light and reference light, a control means for controlling a scanning means for scanning the measurement light at the subject's eye at a selected angle of view when any of a plurality of angles of view including a first angle of view and a second angle of view narrower than the first angle of view is selected as an angle of view for acquiring a tomographic image of the subject's eye; a display control means for displaying a first tomographic image acquired at the first angle of view in a display area when the first angle of view is selected, and for displaying a partial image included in a second tomographic image acquired at the second angle of view, the partial image having a length in a depth direction of the subject's eye shorter than that of the second tomographic image, in a manner that fits the display area when the second angle of view is selected; Equipped with The length of the partial image in the depth direction is based on the length of the tomographic image in the depth direction acquired by an ophthalmic examination apparatus different from the ophthalmic examination apparatus that acquired the tomographic image. the law of nature, the ophthalmic examination apparatus that acquired the tomographic image is an SS-OCT that acquires the tomographic image of the test eye using interference light obtained by combining return light from the test eye that has been irradiated with measurement light by a wavelength swept light source and reference light, The ophthalmic examination apparatus different from the ophthalmic examination apparatus that acquired the tomographic image is an SD-OCT that uses interference light acquired through a spectroscope. [Effects of the Invention]
[0013] According to the technology disclosed in this specification, it is possible to improve the visibility of a region of interest in a subject's eye. [Brief explanation of the drawings]
[0014] [Figure 1] FIG. 1 is a diagram illustrating an ophthalmologic system according to first to fourth embodiments. [Figure 2] 1 is a diagram illustrating a measurement optical system included in the ophthalmic examination apparatus according to Examples 1 to 4. FIG. [Figure 3] FIG. 1 is a diagram illustrating an example of display of a tomographic image according to Examples 1 to 4. [Figure 4] FIG. 1 is a diagram illustrating a schematic configuration of an information processing device according to first to fourth embodiments. [Figure 5] FIG. 2 is a diagram illustrating an example of a display screen according to the first embodiment. [Figure 6(a)] FIG. 2 is a diagram illustrating an example of a display screen according to the first embodiment. [Figure 6(b)] FIG. 2 is a diagram illustrating an example of a display screen according to the first embodiment. [Figure 7] FIG. 2 is a diagram illustrating an example of an operation flow of the information processing device according to the first embodiment. [Figure 8] FIG. 10 is a diagram showing an example of a display screen according to the second embodiment. [Figure 9] FIG. 10 is a diagram illustrating an example of an operation flow of the information processing device according to the second embodiment. [Figure 10] FIG. 11 is a diagram showing an example of a photographing screen according to the third embodiment. [Figure 11] FIG. 11 is a diagram illustrating an example of an operation flow of the information processing device according to the third embodiment. [Figure 12] FIG. 10 is a diagram illustrating an example of a display of a tomographic image according to the fourth embodiment. [Figure 13] FIG. 10 is a diagram illustrating an example of an operation flow of the information processing device according to the fourth embodiment. DETAILED DESCRIPTION OF THE INVENTION
[0015] Illustrative examples for implementing the technology disclosed herein will be described below with reference to the drawings. Note that the dimensions, materials, shapes, relative positions of components, and the like described in the following examples are arbitrary and can be changed depending on the configuration of the device to which the technology disclosed herein is applied or various conditions.
[0016] For example, the dimension in the depth direction of the tomographic image acquired by the SD-OCT described in the examples is described as 2 mm, but is not limited to 2 mm. Also, although the length in the depth direction of the tomographic image in the subject's eye (imaging depth) handled in the examples is described as being fixed for each type of ophthalmic examination device, a single ophthalmic examination device may be configured to acquire tomographic images at multiple imaging depths.
[0017] In addition, the same reference numerals are used in the drawings to indicate elements that are identical or functionally similar, and some components, parts, and processes that are not important for the description may be omitted in each drawing.
[0018] Example 1 An ophthalmologic system 10 of this embodiment will be described with reference to Figures 1 to 7. The ophthalmologic system 10 can display a tomographic image by applying different scales depending on either the depth direction length of the acquired tomographic image in the subject's eye or the type of tomographic imaging device that acquired the tomographic image.
[0019] Here, when a tomographic image with a long depth or a tomographic image acquired by SS-OCT is selected, only a portion of the depth of the tomographic image, i.e., a partial image, is displayed at a scale that fits the display area. By displaying a partial image with a shorter depth than the tomographic image as acquired, the tomographic image is not crushed in the depth direction, making it easier to visualize the area of interest.
[0020] The depth direction length (imaging depth) of a tomographic image acquired by an OCT tomographic imaging device depends on the properties of the measurement light irradiated onto the subject's eye and the properties of the sensor that receives the interference light. Changing the depth direction length of the acquired tomographic image requires complex changes and adjustments to the optical system configuration, such as changing the light source or sampling rate, so the depth direction length may not be changeable. In this embodiment, by post-processing the acquired tomographic image, the region of interest can be displayed in an easily visible manner without complex changes and adjustments to the optical system configuration.
[0021] (System configuration) An example of the configuration of an ophthalmologic system 10 will be described with reference to Fig. 1. Fig. 1 is a diagram showing the configuration of the ophthalmologic system 10 according to this embodiment. As shown in Fig. 1, the ophthalmologic system 10 is a system in which an ophthalmologic control device 110, which is an example of an information processing device, is communicably connected to a tomographic imaging device 100 (also called OCT), a storage unit 120, an input unit 130, and a display unit 140 via interfaces.
[0022] The tomographic imaging apparatus 100 is an apparatus for capturing a tomographic image of a subject's eye, and includes a measurement optical system 101, a stage unit 102, and a base unit 103. As the tomographic imaging apparatus 100, an SS-OCT, which is an ophthalmic examination apparatus that acquires a tomographic image using interference light obtained by combining reference light with return light from a subject's eye irradiated with measurement light using a wavelength swept light source, will be described.
[0023] As will be described later, the ophthalmologic control device 110 may be configured to be connectable to an SD-OCT, which is another example of an ophthalmologic examination device. The SD-OCT detects interference light via a spectroscope.
[0024] The measurement optical system 101 is an optical system for acquiring an anterior eye observation image, an SLO fundus image of the subject's eye, and a tomographic image. The stage unit 102 enables the measurement optical system 101 to move back and forth and left and right.
[0025] The ophthalmologic control device 110 is a computer that controls the stage unit 102, controls alignment operations, reconstructs tomographic images, displays images, etc. The storage unit 120 stores a program for tomographic imaging (e.g., imaging patterns), patient information, imaging data and image data from past examinations, measurement data, etc.
[0026] The input unit 130 issues instructions to the computer and specifically comprises a keyboard and a mouse. The display unit 140 comprises, for example, a monitor. When a touch panel is used, part or all of the input unit 130 is built into the display unit 140.
[0027] (Configuration of tomographic imaging device) The configuration of the measurement optical system in the tomographic imaging apparatus 100 of this embodiment will be described with reference to Fig. 2. Here, the configuration of the SS-OCT will be described as an example.
[0028] First, the inside of the measurement optical system 101 will be described. The tomography apparatus 100 has a wavelength swept light source 211 that sweeps the frequency of emitted light, an OCT interference unit 220 that generates interference light, a detection unit 230 that detects the interference light, and an ophthalmologic control device 110 that acquires information about the fundus of the subject 200 based on the interference light. Furthermore, the tomography apparatus 100 has a measurement arm 250 and a reference arm 260.
[0029] The tomographic imaging apparatus 100 may be configured to include a light source 212 for a scanning laser ophthalmoscope (hereinafter referred to as SLO), an SLO optical system 280 for obtaining reflected light from the fundus, and an anterior eye imaging unit 290. The tomographic imaging apparatus 100 may also have the function of a fundus camera that illuminates the fundus with visible light and obtains a frontal image of the fundus.
[0030] In this embodiment, an example will be described in which the subject 200 is a human eye, but the subject is not limited to this.
[0031] The OCT interference unit 220 has couplers 221 and 222. First, the coupler 221 branches the light emitted from the wavelength swept light source 211 into measurement light and reference light that are used to irradiate the fundus. In this embodiment, the branching ratio is about 2:8, that is, measurement light:reference light=2:8.
[0032] The measurement light is irradiated onto the fundus of the subject 200 via a measurement arm 250. More specifically, the irradiation light incident on the measurement arm 250 has its polarization state adjusted by a polarization controller 251, and is then emitted as spatial light from a collimator 252. The irradiation light then irradiates the fundus of the subject 200 via an X-scan scanner 253, lenses 254 and 255, a Y-scan scanner 256, a dichroic mirror 273, a lens 257, a focus lens 258 fixed to a focus stage 259, and an objective lens 276.
[0033] The X-scanner 253 and the Y-scanner 256 are scanning means having the function of scanning the fundus with irradiation light. The scanning means changes the irradiation position of the measurement light on the fundus. The dichroic mirror 103 has the property of reflecting light with wavelengths of 1000 nm to 1100 nm and transmitting light other than that.
[0034] Then, the backscattered light (reflected light) from the fundus travels along the optical path described above again and is emitted from the measurement arm 250. Then, it passes through the coupler 221 and enters the coupler 222. In accordance with the branching ratio described above, 80% of the returned light from the fundus is guided to the coupler 222.
[0035] On the other hand, the reference light passes through reference arm 260 and enters coupler 222. More specifically, the reference light that has entered reference arm 260 has its polarization state adjusted by polarization controller 261, and is then emitted as spatial light from collimator 262. Thereafter, the reference light passes through dispersion compensation glass 263, optical path length adjustment optical system 264, and dispersion adjustment prism pair 265, and is input to an optical fiber via collimator lens 266. Then, it is output from reference arm 260 and enters coupler 222.
[0036] The light reflected from the object 200 via the measurement arm 250 and the light that has passed through the reference arm 260 are multiplexed and interfered with by the coupler 222. Then, this interference light is detected by the detection unit 230. The detection unit 230 has a differential detector 231 and an A / D converter 232. First, in the detection unit 230, the differential detector 231 detects the demultiplexed interference light immediately after the interference light is generated by the coupler 222.
[0037] The OCT interference signal converted into an electrical signal by the differential detector 231 is then converted into a digital signal by the A / D converter 232. In the tomographic imaging apparatus 100 of Fig. 2, the interference light is sampled at equal optical frequency (equal wavenumber) intervals based on k-clock signals transmitted by a k-clock generating unit incorporated in the wavelength swept light source 211. The digital signal output by the A / D converter 232 is sent to the ophthalmologic control apparatus 110.
[0038] The above is the process of acquiring information about a cross section at a certain point in the subject 200, and acquiring information about a cross section in the depth direction of the subject in this manner is called an A-scan. The scanning direction for acquiring information about the cross section of the subject in a direction perpendicular to the A-scan, i.e., a two-dimensional image, is called a B-scan, and scanning in a direction perpendicular to both the A-scan and B-scan scanning directions is called a C-scan.
[0039] Furthermore, when performing two-dimensional raster scanning on the fundus surface to obtain a three-dimensional tomographic image, the high-speed scanning direction is called a B-scan, and the slower scanning direction in which the B-scans are aligned in a direction perpendicular to the B-scan is called a C-scan. A two-dimensional tomographic image can be obtained by performing an A-scan and a B-scan, and a three-dimensional tomographic image can be obtained by performing an A-scan, a B-scan, and a C-scan. The B-scan and C-scan are performed by the X-scan scanner 253 and the Y-scan scanner 256 described above.
[0040] The X-scan scanner 253 and the Y-scan scanner 256 are composed of deflection mirrors arranged so that their rotation axes are perpendicular to each other. The X-scan scanner 253 performs scanning in the X-axis direction, and the Y-scan scanner 256 performs scanning in the Y-axis direction. The X-axis and Y-axis directions are perpendicular to the ocular axis direction of the eyeball and are mutually perpendicular. Furthermore, the line scanning direction of the B-scan and C-scan does not have to coincide with the X-axis or Y-axis direction. Therefore, the line scanning direction of the B-scan and C-scan can be appropriately determined depending on the 2D or 3D tomographic image to be acquired.
[0041] Light emitted from the SLO light source 212 is irradiated onto the fundus via the SLO optical system 280. More specifically, the light incident on the SLO optical system 280 is emitted into space as parallel light from a collimator 281. The light then passes through the perforated portion of the perforated mirror 271, passes via a lens 282, an X-scan scanner 283, lenses 284 and 285, and a Y-scan scanner 286, and reaches the dichroic mirror 272.
[0042] The X-scan scanner 283 and the Y-scan scanner 286 are an example of scanning means for SLO, and the X-scan scanner 253 and the Y-scan scanner 256 for OCT may be configured as a common XY-scan scanner. The dichroic mirror 272 has the property of reflecting light of 760 nm to 800 nm and transmitting other light. The light reflected by the dichroic mirror 272 travels along the same optical path as that of OCT and reaches the fundus of the subject 200.
[0043] The measurement light irradiated onto the fundus is reflected and scattered by the fundus, travels along the above-mentioned optical path, and reaches the perforated mirror 271. The light reflected by the perforated mirror 271 passes through a lens 287 and is received by an avalanche photodiode (hereinafter referred to as APD) 288, converted into an electrical signal, and sent to the computer 110.
[0044] Here, the position of the perforated mirror 271 is conjugate with the pupil position of the subject's eye, and the light that passes through the peripheral area of the pupil among the reflected and scattered light of the measurement light irradiated onto the fundus is reflected by the perforated mirror 271.
[0045] The anterior eye imaging unit 290 illuminates the anterior eye with an illumination light source 295 consisting of an LED that emits illumination light with a wavelength of 860 nm. The light reflected by the anterior eye reaches a dichroic mirror 275 via an objective lens 276. The dichroic mirror 275 has the property of reflecting light of 820 nm to 920 nm and transmitting all other light. The light reflected by the dichroic mirror 275 passes through lenses 291, 292, and 293 and is received by an anterior eye camera 294. The light received by the anterior eye camera 294 is converted into an electrical signal and received by the ophthalmologic control device 110.
[0046] The internal fixation light 225 is composed of an internal fixation light display unit 226 and a lens 227. The internal fixation light display unit 226 uses a plurality of light-emitting diodes (LDs) arranged in a matrix. The lighting position of the light-emitting diodes is changed according to the area to be photographed. Light from the internal fixation light display unit 226 is guided to the subject's eye via the lens 227. The light emitted from the internal fixation light display unit 226 is 520 nm, and displays the desired set pattern.
[0047] The ophthalmological control device 110 acquires a tomographic image by processing the interference signal converted into a digital signal. Furthermore, an angiographic image may be acquired by analyzing the motion contrast data. Similarly, the ophthalmological control device 110 processes the SLO fundus signal converted into a digital signal sent from the APD 288 to calculate an SLO image. Furthermore, the ophthalmological control device 110 processes the signal sent from the anterior eye camera 294 to construct an anterior eye image.
[0048] Subsequently, the information on the fundus and the anterior segment obtained as a result of the signal processing is displayed on the display unit 140.
[0049] Here, the optical system of the tomographic imaging apparatus 100 has been described using SS-OCT as an example, but it is also possible to use tomographic imaging apparatuses with other configurations, such as SD-OCT.
[0050] (Display of tomographic image) Next, we will explain the difference in appearance on display when arranging tomographic images with different depth lengths in a display area of the same size, with reference to Figure 3. Figure 3 shows examples of displaying tomographic images obtained from different types of tomographic imaging devices, SD-OCT and SS-OCT, and images when the entire tomographic images are displayed in a display area of the same size.
[0051] 3(a) is a tomographic image 300 of the fundus of the subject's eye 200 captured by SD-OCT, and shows a retinal layer 301. In a normal eye, a tomographic image acquired by SD-OCT generally shows an intermediate portion 302 of the choroid due to attenuation of the returning light from the choroid below the retinal pigment epithelium.
[0052] 3(c) is a tomographic image 320 obtained by photographing the fundus of the subject's eye 200 using SS-OCT. By photographing using SS-OCT, which can acquire tomographic images over a wide depth range, it is possible to display a region 321 including the retina and choroid in the tomographic image 320.
[0053] When the tomographic image 300 or 320 is displayed on the display unit, the size of the image is changed based on the selected scale. For example, the aspect ratio of the image may be changed according to the type of scale selected, such as a scale where the length of one pixel in the depth direction and the width direction is the same (Real scale), or a scale where the image is enlarged or reduced in the depth direction and the width direction to fit the display area (Fit scale).
[0054] When the tomographic images 300 and 320 are displayed in the same size display area using the Fit scale, the retina appears differently due to the difference in aspect ratio of the original images. Figure 3(b) shows a tomographic image 310 that displays a tomographic image acquired by SD-OCT. On the other hand, as shown in Figure 3(d), a tomographic image 330 that displays a tomographic image acquired by SS-OCT is compressed in the depth direction, reducing the visibility of the retina, which is one of the regions of interest.
[0055] (Configuration of ophthalmic control device) Next, the configuration of an ophthalmologic control device 110, which is an example of an information processing device, will be described with reference to Fig. 4. Fig. 4 shows a schematic configuration of the ophthalmologic control device 110. The ophthalmologic control device 110 is connected to the tomographic imaging device 100, an input unit 130, and a display unit 140, and is provided with an imaging control unit 410, an image acquisition unit 420, a storage unit 120, and a display control unit 430.
[0056] The ophthalmic control device 110, which is an example of an information processing device, may be, for example, a personal computer, a tablet terminal, or a mobile terminal. Furthermore, an ophthalmic examination device may be configured to realize the functions of the information processing device disclosed in this specification. The functions of the disclosed information processing device may be realized by an ophthalmic system in which multiple devices, including an information processing device and an ophthalmic examination device, are communicatively connected. Note that the information processing device is not limited to an information processing device dedicated to ophthalmic examination devices, and may be connectable to non-ophthalmic examination devices, such as CT and MRI.
[0057] The imaging control unit 410 controls the tomographic imaging apparatus 100 to adjust imaging alignment, perform imaging, and acquire signal data of the captured anterior eye observation image, SLO fundus image, and tomographic image, etc. The imaging control unit 410 also stores the imaging pattern, imaging alignment parameters, SLO fundus image, etc. of the captured tomographic image in the storage unit 120.
[0058] Furthermore, the imaging control unit 410 generates a tomographic image by signal processing from the signal data of the tomographic image captured by the tomographic imaging apparatus 100 via the image acquisition unit 420, and stores the generated tomographic image in the storage unit 120. Note that the signal data acquired during imaging alignment is not stored in the storage unit 120, but is sent to the display control unit 410 as a preview image.
[0059] Furthermore, if the captured data is an OCTA imaging pattern, the image acquisition unit 420 generates a motion contrast image from a tomographic image obtained by scanning the same position, and stores the generated tomographic image together with the storage unit 120. The image acquisition unit 420 also analyzes the layer boundaries of the acquired tomographic image, and stores the analysis results in the storage unit 120 together with the tomographic image.
[0060] The display control unit 430 causes the display unit 140 to display preview displays of anterior eye observation images, SLO fundus images, and tomographic images for performing photographic alignment, which are acquired from the photographing image device 100 via the photographing control unit 410, as well as the acquired tomographic images and SLO fundus images. Here, the display unit 140 may be, for example, a display or a projector. Note that the display unit 140 does not need to be directly connected to the ophthalmologic control device 110, and may be configured to be connectable to any information processing device included in the ophthalmologic system via a wired or wireless communication connection, for example.
[0061] Furthermore, the display control unit 430 changes the display on the display unit 140 and gives instructions to the imaging control unit 410 based on the content input by the user via the input unit 130. The input unit 130 is, for example, at least one of a mouse, a keyboard, a touch pen, etc. Alternatively, a configuration may be adopted in which a touch panel display having the functions of both the input unit 130 and the display unit 140 is used.
[0062] Furthermore, in response to an instruction by the user to select one of the tomographic images and the SLO fundus image stored in the storage unit 120 via the input unit 130, the display control unit 430 displays the selected image on the display unit 140.
[0063] The storage unit 120 stores patient information (patient name, age, sex, etc.) and device information (model name, OCT type, etc.) of the tomographic image capturing device 110 that captured the image. Furthermore, the storage unit 120 stores captured tomographic images, motion contrast images, SLO images, imaging pattern information (left and right eyes, imaging size, imaging format, number of scans in the X-axis direction, number of scans in the Y-axis direction, number of repeated scans at the same position, etc.), imaging alignment parameter information (fixation light position, imaging position, SLO and OCT focus values, C-Gate position, etc.), and parameters set by the user (brightness contrast adjustment value, imaging failure determination, etc.).
[0064] Furthermore, the images acquired by the image acquisition unit 420, which is an example of an acquisition means, include not only images acquired by the imaging control unit 410 but also images acquired by importing data stored outside the system. In this case, not only the images but also information on the subject's eye, device information, imaging pattern information, imaging alignment parameter information, information on all parameters set by the user, and analysis results are acquired together and stored in the storage unit 120. Note that if the imported data is outdated or the analysis results are corrupted, the old information is updated or the imported analysis contents of the ophthalmologic system 10 are reanalyzed and stored in the storage unit 120.
[0065] (Display screen and enlarged display screen according to this embodiment) 5 and 6, a description will be given of a display when the display control unit 430 of this embodiment causes the display unit 140 to display a tomographic image as a report. Fig. 5 shows a display screen 500, which is an example of a report, and displays the tomographic image stored in the storage unit 120 and information associated with the tomographic image.
[0066] Here, at least one of the following information may be displayed as information accompanying the tomographic image: a scan mode for scanning the measurement light, the left or right eye, the examination date and time, and patient information. Even when there is a lot of information to be displayed on the display unit and the display area for displaying the tomographic image is limited, the region of interest can be made more visible by changing the scale according to the length of the tomographic image in the depth direction.
[0067] Furthermore, the display screen 500 may display a tomographic image of the subject's eye of a selected patient in response to an instruction to select a patient on a patient screen (not shown).
[0068] 6 shows an enlarged display screen 600, which displays an enlarged version of one of the tomographic images. The enlarged display screen 600 is displayed by transitioning from one of the tomographic images displayed on the display screen 500 to the enlarged display screen 600.
[0069] The display screen 500 has an examination selection list display area 510 and a selected examination content display area 520. In the examination selection list display area 510, the examination data stored in the memory unit 120 is arranged in a list, with one photograph representing one examination. The examinations are grouped by examination date and time, camera model, and left or right eye, and the examinations within each group are arranged in order of the photographing time within the examination date and time. At this time, the photographing date within the examination date and time is arranged in descending order and the photographing time is arranged in ascending order.
[0070] The examination selection list display area 510 can also be switched to a display that groups examinations by imaging pattern. When the user selects one of the examinations displayed in the examination selection list display area 510 as a selected examination 511, examination information such as the tomographic image and imaging pattern information of the selected examination 511 is read from the storage unit 120 and displayed in the selected examination content display area 520.
[0071] In the selected examination content display area 520, an examination display layout for each purpose can be specified, such as displaying one examination, displaying both eyes, or comparing past examinations, and images and examination information are displayed according to the selected examination display layout. The selected examination content display area 520 has an SLO fundus image display area 521 and a tomographic image display area 522 as areas for displaying images.
[0072] The SLO fundus image display area 521 displays the SLO image of the selected examination 511, and the position and direction of the tomographic image displayed in the tomographic image display area 522 are indicated on the SLO image. The tomographic image display area 522 can display at least one of the tomographic images of the selected examination 511, and displays a tomographic image corresponding to the position and direction indicated in the SLO fundus image display area 521. In addition, a scale indicating the actual size of the tomographic image in the depth direction and the X-axis direction is displayed on the tomographic image display area 522.
[0073] In an examination that uses multiple tomographic images, such as 3D imaging that is performed by scanning a specific area on the fundus at equal intervals, the total number of tomographic images and a number indicating which tomographic image is being displayed are displayed in the tomographic image display area 522. In this case, the tomographic image to be displayed can be changed by scrolling or clicking the mouse on the SLO fundus image display area 521 or the tomographic image display area 522. In response to an instruction to change the tomographic image to be displayed, the position of the tomographic image displayed in the SLO fundus image display area 521 and the number indicating which tomographic image is being displayed in the tomographic image display area 522 are changed.
[0074] The enlarged display screen 600 is displayed by an enlarged screen display operation such as double-clicking in the tomographic image display area 522, using a right-click menu (not shown), or using an enlargement button (not shown). The enlarged display screen 600 has an enlarged tomographic image display area 610 and a tomographic image operation area 620.
[0075] The enlarged tomographic image display area 610 has a larger area than the tomographic image display area 522, and displays the tomographic image that was displayed in the tomographic image display area 522. The tomographic image operation area 620 has a tomographic image scale selection area 621, and it is possible to change the scale of the tomographic image in the enlarged tomographic image display area 610. The scale when the enlarged display screen 600 is displayed is the same aspect ratio (default scale) as when the enlarged screen display operation was performed in the tomographic image display area 522, and the tomographic image displayed in the enlarged tomographic image display area 610 is changed according to the scale selected in the tomographic image scale selection area 621.
[0076] (Display flow of tomographic images captured by SS-OCT according to this embodiment) Next, a flow for displaying a tomographic image captured by SS-OCT according to this embodiment will be described with reference to Fig. 7. Fig. 7 shows a flowchart of the operation for displaying a tomographic image according to this embodiment.
[0077] When a tomographic image captured by SS-OCT with a long depth is displayed in the same display area, the retina portion appears fainter than a tomographic image captured by SD-OCT with a short depth. Therefore, the display control unit 430 changes the scale depending on either the type of tomographic imaging device 100 that captured the tomographic image or the depth of the tomographic image, so that a highly visible tomographic image can be displayed in the tomographic image display area 522 even when tomographic images with different depth lengths are acquired.
[0078] Specifically, in step S701, the user selects an examination to be displayed on the display screen 500, and the display control unit 430 reads the tomographic images acquired in the selected examination from the storage unit 120. At this time, the display control unit 430 also acquires from the storage unit 120 device information and imaging pattern information of the tomographic imaging device 100 that captured the tomographic images.
[0079] In step S702, the display control unit 430 checks the type of the tomographic imaging apparatus 100 that captured the tomographic image, such as SD-OCT or SS-OCT, from the apparatus information simultaneously acquired in step S701.
[0080] In step S703, the display control unit 430 determines the scale for displaying the tomographic image based on the type of tomographic imaging apparatus 100 confirmed in step S702. Here, if the type of tomographic imaging apparatus 100 is SD-OCT, a fit scale is selected, which displays the entire tomographic image so that it fits in the tomographic image display area 522. If the type of tomographic imaging apparatus 100 is SS-OCT, a 2 mm depth scale is selected, which displays a partial image of the same length as 2 mm, which is the depth length at the fit scale for SD-OCT, so that it fits in the tomographic image display area 522, rather than displaying the entire tomographic image.
[0081] Note that the depth length of the acquired tomographic image may be confirmed in step S702, and the scale for displaying the tomographic image may be determined in step S703 according to the depth length of the tomographic image. At this time, if the depth length of the tomographic image is a predetermined length, for example, 2 mm or less, the entire tomographic image is displayed so as to fit within the tomographic image display area 522. If the depth length of the tomographic image is a predetermined length, for example, greater than 2 mm, a partial image having a shorter depth length than the original tomographic image is displayed so as to fit within the tomographic image display area 522.
[0082] Here, the reference depth length for switching the scale for displaying a tomographic image has been described as 2 mm, which is the length of the depth range of a tomographic image captured by a general SD-OCT, but is not limited to this. Furthermore, the scale may be set as a default and then changed later by a user operation, or the scale may be set in advance by the user.
[0083] In step S704, the display control unit 430 acquires the actual length in each of the horizontal and depth directions of the tomographic image read in step S702. The actual horizontal length is acquired from the imaging size in the imaging pattern information, and the actual depth direction may be acquired from the device information if it is saved together with the device information, or may be assigned as a fixed value based on the type of tomographic imaging device 100 confirmed in step S702. Alternatively, the actual length indicated by one pixel in the original size of the tomographic image and the number of pixels of the tomographic image may be acquired and calculated as image information.
[0084] In step S705, the display control unit 430 checks the size of the tomographic image display area 522.
[0085] In step S706, the display control unit 430 calculates the magnifications for the horizontal and depth directions of the tomographic image from the scale confirmed in steps S703 to S705, the actual length of the tomographic image, and the size of the display area. In the case of Fit scale, the respective magnifications Rx and Rz are calculated using Equation 1.
[0086]
number
[0087] Here, Tx and Tz indicate the number of pixels in the horizontal and depth directions of the original tomographic image stored in the storage unit 120. Also, Ax and Az indicate the number of pixels in the vertical and horizontal directions of the tomographic image display area 522. In the case of a 2 mm depth scale, the magnifications Rx and Rz are calculated as in Equation 2 so that the number of pixels for 2 mm in the depth direction becomes the number of pixels in the display area.
[0088]
number
[0089] Here, Tx, Tz and Ax, Az represent the number of pixels in the horizontal and depth directions of the original tomographic image and the number of pixels in the horizontal and depth directions of the tomographic image display area 522, as in Equation 1. Stz represents the actual length in the depth direction of the tomographic image calculated in step S704. Saz represents the actual length displayed in the tomographic image display area 522, which is 2 mm in this case.
[0090] Here, if Rz is 1 or greater, the tomographic image is expanded in the depth direction. When the tomographic image is expanded in the depth direction, a portion of the tomographic image will not fit within the display area. For this reason, a scroll bar is provided to move the position of the tomographic image corresponding to the partial image and to accept instructions to update the display to the partial image to which it has been moved. When a scroll bar is displayed within the tomographic image display area 522, Ax is calculated using a value excluding the number of pixels for the scroll bar. Note that a configuration may be adopted in which the scroll bar is not provided and the portion of the tomographic image that does not fit within the display area is trimmed.
[0091] In step S707, the display control unit 430 generates a tomographic image enlarged or reduced at the magnification calculated in S706. The enlarged or reduced tomographic image is generated by performing interpolation using a nearest neighbor method, a bilinear method, a bicubic method, super-resolution using machine learning, or the like.
[0092] In step S708, if the magnification calculated in S706 is equal to or greater than 1, the position of the partial image in the subject's eye to be displayed in the display area is determined. It is desirable to specify a position where the center of the tomographic image is displayed as the partial image as the default position. Furthermore, if the layer boundary is determined by analyzing the tomographic image, a position may be specified so that the retina is displayed in the center of the partial image.
[0093] In the case of tomographic images captured by 3D imaging, the position of the retina differs for each tomographic image, so the position where the retina is central may be specified for the central tomographic image or the tomographic image passing through the center of the macula or the center of the optic disc. The position where the retina is to be located at the center may also be specified for each tomographic image. Furthermore, since the height of the retina differs even within a tomographic image, the entire retina in the tomographic image can be displayed within the tomographic image display area 522 by specifying the lowest part of the retina to be located slightly above the bottom of the tomographic image display area 522 rather than at the center.
[0094] In step S709, the display control unit 430 displays the tomographic image generated in step S707 at the position specified in step S708 within the tomographic image display area 522. At this time, a scroll bar may be displayed so that the position of the tomographic image displayed in the tomographic image display area 522 in the depth direction of the subject's eye can be changed in accordance with a user instruction. That is, by operating the scroll bar, the position of the subject's eye displayed as a partial image can be changed from the default position, and the display of the partial image can be updated to display a different partial image.
[0095] According to the present embodiment described above, it is easy to visually recognize the region of interest even when a tomographic image long in the depth direction, captured by SS-OCT, is displayed in the display area. Furthermore, it is no longer necessary for the user to change the scale of the tomographic image or display the enlarged display screen 600 in order to enlarge the retina, thereby improving usability.
[0096] Note that a tomographic image captured by SD-OCT may be displayed enlarged by displaying it in fit scale on the enlarged tomographic image display area 610 of the enlarged display screen 600. Even when a similar display is performed with a tomographic image captured by SS-OCT, by selecting the 2 mm depth scale in the tomographic image scale selection area 621, the image can be displayed in the same appearance as the fit scale display of SD-OCT, as shown in FIG. 6(b).
[0097] In addition, in steps S702 and S703, the display scale is set based on the type of tomography imaging apparatus 100, but it is also possible to associate a specified initial display scale with each examination in advance and determine the scale using that information. For example, when creating an imaging pattern, the initial display scale can be set as examination information, allowing the association.
[0098] The 2 mm depth scale may be set only when the tomographic imaging apparatus 100 is of a type that captures wide-angle, deep-penetration tomographic images such as SS-OCT. Also, by setting 2 mm depth as the initial state when using a narrow-angle imaging pattern, it is possible to set the inspection conditions, including the display, for each of narrow-angle and wide-angle imaging before imaging.
[0099] When displaying a tomographic image with a narrow field of view rather than for each examination, a 2 mm depth scale may be automatically set. In this case, images with a field of view equal to or smaller than the preset value can be switched to narrow-field tomographic images.
[0100] Furthermore, regardless of the type of tomographic imaging apparatus 100, the display control unit 430 may be configured to set the scale according to the depth of the acquired tomographic image. For example, if the depth of the tomographic image is longer than a certain length, only a partial region of the tomographic image may be displayed, and if the depth of the tomographic image is equal to or shorter than the certain length, the entire tomographic image may be displayed. Specifically, if the depth of the tomographic image exceeds 2 mm, only a region with a depth of 2 mm may be displayed, and if the depth of the tomographic image is equal to or shorter than 2 mm, the entire tomographic image may be displayed. The boundary for switching the display scale may be set as appropriate.
[0101] Additionally, in this embodiment, the length in the depth direction is acquired in step S704, and the magnification is calculated using that length in step S706, but this is not limiting as long as the method is such that the actual size per pixel on the display is the same. For example, even if the imaging depth of each tomographic imaging device is not available, if the ratio between the sizes of one pixel can be found, the magnification can be calculated by substituting the ratio into Sta / Stz in Equation 2.
[0102] This time, we have described a method of displaying images at a 2mm depth scale when viewing examinations taken with a narrow angle of view, but it would also be acceptable to display images at a 2mm depth scale when taking wide-angle images. In this case, the display can be enlarged not only in the depth direction but also in the X-axis direction to a scale that matches the SD-OCT angle of view. Diagnostic efficiency can be improved by switching between displaying a wide-angle bird's-eye view tomographic image and a narrow-angle tomographic image similar to that of conventional SD-OCT.
[0103] Furthermore, in the examples, the type of tomographic imaging device with a long imaging depth is described as SS-OCT, and the type of tomographic imaging device with a short imaging depth is described as SD-OCT, but both SD-OCT with a long imaging depth and SD-OCT with a short imaging depth may also be used.
[0104] <Example 2> In this embodiment, an example will be described in which, in a configuration capable of simultaneously displaying multiple examinations, a scale is determined according to the examination to be compared when the type of tomography apparatus 100 that captured the examination to be compared is different. The multiple examinations displayed include the selected examination 511 selected in the examination selection list display area 510, as well as an examination that can be selected to be compared with the selected examination 511. In this case, it is desirable that the appearance of the tomography images be the same even if the examinations to be compared were performed by different types of tomography apparatuses 100.
[0105] In this embodiment, when displaying multiple tomographic images taken with different types of tomographic imaging devices, the tomographic structures are said to look the same if they are displayed with similar aspect ratios, but they do not have to look exactly the same as long as the tomographic structures are easy to compare visually.
[0106] (Tomographic image comparison display screen according to this embodiment) An example of a screen displaying a plurality of different examinations displayed side by side by the display control unit 430 of this embodiment will be described with reference to Fig. 8. Fig. 8 shows a tomographic image comparison display screen 800 displaying two examinations, each including a tomographic image stored in the storage unit 120, side by side.
[0107] The tomographic image display screen 800 has an examination selection list display area 810 and a selected examination content display area 820, similar to the display screen 500, and a selected examination 811 is selected from the examination selection list display area 810 and displayed in the selected examination content display area 820. Note that if the examinations stored in the storage unit 120 include examinations captured using multiple types of tomographic imaging apparatuses 100, the type or model name of the tomographic imaging apparatus 100, or an icon or symbol indicating the type or model name, may be displayed.
[0108] In the selected examination content display area 820 displayed in the examination selection list display area 810, multiple examinations can be displayed by specifying a comparison report such as a comparison between left and right eyes or a comparison between past examinations. The comparison report can display a selected examination display area 823 and a comparison examination display area 822, each of which can display examination information such as the date and time of imaging, left and right eyes, and type of tomographic imaging device 100, as well as an SLO fundus image and a tomographic image.
[0109] The selected examination display area 823 displays examination information and images of the selected examination 811 selected from the examination selection list display area 810. The comparison examination display area 822 displays examinations with the same shooting pattern taken in the past. The examination to be compared can be specified by the user, and by selecting the comparison examination selection button 821, one or more past examinations can be specified from a comparison examination selection screen (not shown), and displayed side by side in the comparison examination display area 822. Note that the past examination with the same shooting pattern that is closest to the selected examination 811 may be automatically displayed as the initial display.
[0110] (Display flow of comparison images captured by different tomographic imaging apparatuses according to this embodiment) A display flow of tomographic images in the present embodiment in which a comparison target image is an SS-OCT tomographic image and a comparison source image is an SD-OCT tomographic image and the tomographic images are displayed side by side will be described with reference to Fig. 9. Fig. 9 shows a flowchart of the operation for displaying a comparison target tomographic image in this embodiment.
[0111] When tomographic images captured by different types of tomographic imaging devices 100 are displayed side by side, even if the images are captured using the same imaging pattern, the vertical resolution in the depth direction and the actual length of the captured tomographic images are different, so the tomographic images are displayed with different thicknesses in the depth direction. Therefore, the display control unit 430 sets the scale of the tomographic image of the comparison target to match the types of the comparison source and comparison target tomographic imaging devices 100 and the scale of the comparison source, so that the tomographic images are displayed side by side with the same appearance even if the types of tomographic imaging devices 100 are different.
[0112] Specifically, in step S901, the display control unit 430 acquires the tomographic images and examination information of the examination selected by the user or the examination selected as the comparison target examination for initial display from the storage unit 120. In step S902, the display control unit 430 confirms the type of the selected examination 811 to be used as the comparison source and the type of the tomographic imaging apparatus 100 of the comparison target examination selected in step S901.
[0113] In step S903, the display control unit 430 determines the scale of the tomographic image of the comparison target examination based on the type confirmed in S902 and the scale displayed in the comparison source tomographic image. If the comparison source examination and the comparison target examination are of the same type of tomographic imaging device 100, the same scale is selected. If the comparison source examination and the comparison target examination are of different types of tomographic imaging device 100, the scale is determined according to the scale of the comparison source examination so that the actual length of one pixel in the tomographic images of the comparison target examination and the comparison source examination is the same in both the vertical and horizontal directions.
[0114] For example, if the comparison source examination was taken with an SD-OCT and the tomographic images are displayed on a fit scale, and the comparison target examination was taken with an SS-OCT, the 2mm depth scale will be selected, so that the tomographic image display area will be the same length as the SD-OCT depth.Also, if the comparison source examination was taken with an SS-OCT and the tomographic images are displayed on a 2mm depth scale, and the comparison target examination is an SD-OCT, the fit scale will be selected, and if the SS-OCT tomographic images of the comparison source examination are displayed on a fit scale, the 5mm depth scale will be selected for the SD-OCT tomographic images of the comparison target examination.
[0115] From step S904 to step S909, the tomographic images of the comparison target examination are displayed in the comparison target examination display area 822 using the scale set in step S903. The display method is the same as in steps S704 to S709. Note that the position of the scroll bar in step S908 may be set to the same position based on the information on the layer boundary of the tomographic images of the comparison source examination.
[0116] According to the above-described embodiment, it is possible to display a plurality of tomographic images with the same appearance when comparing and displaying tomographic images of different types taken by the tomographic imaging apparatus 100. This is extremely preferable because it allows a plurality of tomographic images of different types taken by the tomographic imaging apparatus 100 to be observed with the same appearance without the need for user operation to adjust the display.
[0117] Although the case where the imaging size is the same is limited here, this is not limiting. Even if examinations with different imaging sizes are selected, in steps S906 to S908, the horizontal direction of the tomographic image is rescaled by calculating the same enlargement / reduction ratio as the depth direction in Equation 2, and the position of the scroll bar is determined so that it is in the same position as the original tomographic image for comparison, thereby allowing the images to be displayed with the same appearance.
[0118] Although the flow for displaying the comparison target examination has been described in this embodiment, even if the display scale of the comparison source is changed, the display of the comparison target tomographic image can be made to look the same by performing steps S902 to S909 with the scale type changed. Furthermore, even if the display scale of the comparison target is changed, the display of the comparison target tomographic image can be made to look the same by performing the flow from step S902 to step S909 with the comparison source and comparison target swapped.
[0119] In addition, although the present embodiment describes a comparison of SS-OCT and SD-OCT tomographic images as tomographic images obtained using different types of tomographic imaging devices, this is not limiting. Even when displaying tomographic images from an SD-OCT device with a long imaging depth and an SD-OCT device with a short imaging depth side by side, multiple tomographic images can be displayed with the same appearance by selecting the scale of the tomographic image to be compared based on the imaging depth and the type of display scale of the tomographic image to be compared.
[0120] Example 3 In this embodiment, an example of preview display of a tomographic image when capturing a narrow-angle tomographic image is described when performing imaging with a wide-angle, deep-penetration tomographic imaging apparatus 100. When performing imaging using the same imaging pattern as SD-OCT with a wide-angle, deep-penetration tomographic imaging apparatus 100 such as SS-OCT, it is desirable to be able to capture an image with the same appearance as SD-OCT imaging.
[0121] In this embodiment, when displaying multiple tomographic images taken with different types of tomographic imaging devices, the tomographic structures are said to look the same if they are displayed with similar aspect ratios, but they do not have to look exactly the same as long as the tomographic structures are easy to compare visually.
[0122] (Tomographic image comparison display screen according to this embodiment) An example of the imaging screen for capturing a tomographic image, which is displayed by the display control unit 430 of this embodiment, will be described with reference to Fig. 10. Fig. 10 shows a tomographic image imaging screen 1000 for capturing and acquiring a tomographic image from the tomographic imaging apparatus 100 via the imaging control unit 410.
[0123] The tomographic image capture screen 1000 has a capture pattern display area 1010 and a capture preview display area 1020. The capture pattern display area 1010 displays the left and right eyes, adjustment mode, scan mode, fixation light type, etc. The user can change the scan mode and fixation light type using an input unit 130 such as a mouse.
[0124] The imaging preview display area 1020 has an anterior eye preview display section 1021, an SLO preview display section 1022, and a tomographic preview display area 1023, and displays an anterior eye preview image, an SLO preview image, and a tomographic preview image acquired from the tomographic imaging device 100 in real time as live images on the respective display sections. The SLO preview display section 1020 displays the imaging pattern and fixation light position of the tomographic image on the SLO preview image.
[0125] The user can also change the size and position of the imaging pattern of the tomographic image and the position of the fixation light via the input unit 130. When the imaging pattern is changed, the imaging control unit 410 changes the content of the tomographic preview image acquired by the tomographic imaging device 100 in accordance with the change, and the changed tomographic preview image is displayed on the tomographic preview display unit 1023.
[0126] (Display flow of tomographic images when performing narrow-angle imaging with SS-OCT according to this embodiment) The display flow of a tomographic image when narrow-angle imaging similar to SD-OCT is performed using the tomographic imaging apparatus 100 capable of acquiring wide-angle and deep-depth range tomographic images like the SS-OCT according to this embodiment will be described with reference to Fig. 11. Fig. 11 shows a flowchart of the operation for displaying a tomographic image when narrow-angle imaging is performed with the SS-OCT according to this embodiment.
[0127] When capturing a narrow-angle tomographic image using SS-OCT, a tomographic image with a narrow angle of view that is long in the depth direction and has a thin retinal portion is displayed in the tomographic preview display area 1023. Here, by the display control unit 430 changing the scale of the tomographic preview image during narrow-angle imaging, it is possible to display a tomographic preview image with the same appearance as a tomographic preview image in SD-OCT even when capturing an image using SS-OCT.
[0128] Specifically, in step S1101, the user selects a shooting pattern on the shooting pattern display area 1010 via the input unit 130. After selecting the shooting pattern, the size of the shooting pattern can also be changed on the SLO preview display.
[0129] In step S1102, the display control unit 430 determines whether the imaging pattern specified in step S1101 has a narrow angle of view. For example, if the angle of view is equal to or less than 10 mm, which is the imaging angle of view for SD-OCT, it is determined to be a narrow angle of view.
[0130] In step S1103, the display control unit 430 determines the scale based on the determination result of step S1102. If the angle of view is narrow, a 2 mm depth scale is set, and if the angle of view is not narrow, a fit scale display is set. That is, when displaying a tomographic image captured with a narrow angle of view, a partial image of the tomographic image that is short in the depth direction is displayed. In this case, in the case of a cross imaging pattern in which images are captured vertically and horizontally, the angles of view may differ for each, but the scale may be set by determining whether each is a narrow angle of view, or if even one angle of view is determined to be narrow, all may be unified and set to the scale for the narrow angle of view.
[0131] In step S1104, the display control unit 430 checks the actual length and width of the tomographic preview image acquired from the tomographic imaging apparatus 100. The actual length in the horizontal direction is determined from the imaging pattern set in step 1101, and the actual length in the depth direction is determined from information stored in advance as information on the tomographic imaging apparatus 100 or from information acquired by communicating with the tomographic imaging apparatus 100.
[0132] In step S1105, the display control unit 430 checks the number of pixels in the length and width of the tomographic preview display area 1023.
[0133] In step S1106, the display control unit 430 checks the number of vertical and horizontal pixels of the tomographic preview image acquired from the tomographic image acquisition device 100. The number of vertical and horizontal pixels of the tomographic preview image is stored in advance as information of the tomographic image acquisition device 100, or information acquired by communicating with the tomographic image acquisition device 100 is used.
[0134] In step S1107, the display control unit 430 calculates the vertical and horizontal zoom ratios of the tomographic preview image from the scale confirmed in steps S1103 to S1106, the actual size of the tomographic preview image, the size of the display area, and the size of the tomographic preview image. The calculation method is the same as in step S706.
[0135] In step S1108, the imaging control unit 410 acquires a tomographic preview image from the tomographic imaging apparatus 100 via the image acquisition unit 420, and passes it to the display control unit 430.
[0136] In step S1109, the display control unit 430 generates a tomographic image enlarged or reduced at the magnification calculated in S1107. The enlarged or reduced tomographic image is generated by performing interpolation using a nearest neighbor method, a bilinear method, a bicubic method, super-resolution using machine learning, or the like.
[0137] In step S1110, when the magnification calculated in S1107 is equal to or greater than 1, a default position for the tomographic preview image is determined. The default position is specified as a position where the center of the tomographic image is displayed as a partial image. Note that since tomographic images tend to become darker in the depth direction, a position may be set that allows for capturing a bright portion with a narrow angle of view without the retina being included. The position may also be changed depending on the subject being captured, such as in choroid observation mode.
[0138] In addition, if the tomographic imaging device 100 has a function to automatically determine the position at which to display the tomographic image, the position at which to display the tomographic image may be set to match the initial display position, or may be set to match the position currently displayed in the tomographic preview display area 1023.
[0139] In step S1111, the display control unit 430 displays the tomographic preview image generated in step S1109 in the tomographic preview display area 1023 at the position specified in step S1110.
[0140] The display control unit repeats steps S1109 to S1111 while continuously acquiring tomographic preview images as moving images from the tomographic imaging device 100 via the imaging control unit 410 and the image acquisition unit 420. During this time, the display position in step S1110 is maintained in the previous state. Even if the display position is changed by the user, the tomographic preview image is displayed while maintaining the changed position.
[0141] According to the present embodiment described above, the tomographic preview display of the tomographic imaging apparatus 100 that acquires tomographic images that are long in the depth direction, such as SS-OCT, can be displayed in the same appearance as when capturing images using SD-OCT, thereby improving the visibility of a region of interest in the subject's eye, such as the retina.
[0142] Furthermore, when determining whether the angle of view is narrow, the SLO preview image can be enlarged and displayed within the same range as SD-OCT, allowing for more precise adjustment of the position of the shooting pattern, improving usability.
[0143] Although the narrow angle of view is determined based on the angle of view of the shooting pattern in step S1102, a method may be used in which the shooting pattern selected in step S1101 is set in advance to indicate whether it is a narrow angle of view mode, and the determination is made based on the setting.
[0144] Example 4 The ophthalmologic system 10 of this embodiment can display a tomographic image by applying different scales depending on the angle of view of the tomographic image acquired by the tomographic imaging apparatus 100, which is an example of an ophthalmologic examination apparatus.
[0145] When a tomographic image captured with a narrow angle of view is selected, only a portion of the depth of the tomographic image, i.e., a partial image, is displayed in the display area at a scale that allows the partial image to be displayed in the display area. By displaying a partial image that is shorter in the depth direction than the tomographic image as acquired, the region of interest, for example, the retina, can be more easily viewed.
[0146] The depth direction length (imaging depth) of a tomographic image acquired by an OCT tomographic imaging device depends on the properties of the measurement light irradiated onto the subject's eye and the properties of the sensor that receives the interference light. Changing the depth direction length of the acquired tomographic image requires complex changes and adjustments to the optical system configuration, such as changing the light source or sampling rate, so the depth direction length may not be changeable. In this embodiment, by post-processing the acquired tomographic image, the region of interest can be displayed in an easily visible manner without complex changes and adjustments to the optical system configuration.
[0147] The device configuration is the same as in Examples 1 to 3, so a description thereof will be omitted.
[0148] Using FIG. 12, the display of a tomographic image when imaging is performed by switching between a wide angle and a narrow angle using the tomographic imaging apparatus 100 will be described.
[0149] By using a tomographic imaging device 100, such as an SS-OCT, it is possible to capture a tomographic image with a wide field of view and a large depth range, as shown in Figure 12(a). By acquiring a tomographic image with a wide field of view and a large depth range, it is possible to observe a wide area of the retina and discover abnormalities at positions away from the macula.
[0150] Here, it is possible to acquire a tomographic image with a narrower angle of view, thereby acquiring a tomographic image with higher lateral resolution than a tomographic image with a wide angle of view. In this case, if the entire tomographic image with a narrow angle of view and a wide depth range is displayed in the same display area as the tomographic image in Figure 12(a), the depth direction will be blurred, and it may be difficult to visually recognize the retina, which is an example of a region of interest.
[0151] In this embodiment, a partial image that is shorter in the depth direction than the acquired tomographic image is displayed, as shown in Fig. 12(b). At this time, a configuration may be adopted in which a region that is not displayed as a partial image is newly displayed in response to a user's instruction using a scroll bar or the like. Also, a configuration may be adopted in which the region that is not displayed as a partial image is previously trimmed.
[0152] An operation flow for controlling the tomographic imaging apparatus 100 to acquire a tomographic image and varying the display scale according to the angle of view of the tomographic image will be described with reference to FIG.
[0153] In step S1301, the user selects or changes the shooting pattern for shooting. The shooting pattern includes the angle of view. Other settings for the shooting pattern may include the left or right eye, shooting size, shooting format, number of scans in the X-axis direction, number of scans in the Y-axis direction, and number of repeated scans at the same position.
[0154] In step S1302, the tomographic imaging apparatus 100 is controlled to acquire a tomographic image based on the imaging pattern set in S1301. Next, in step S1303, the angle of view of the acquired tomographic image is confirmed. At this time, information on the angle of view associated with the tomographic image may be confirmed, or the angle of view of the tomographic image set in the tomographic imaging apparatus 100 may be confirmed.
[0155] In step S1304, a display scale for the tomographic image is determined according to the angle of view. At this time, if a tomographic image captured with a narrow angle of view is selected, it is displayed at a scale that displays only a portion of the depth direction of the tomographic image, i.e., a partial image, in the display area. On the other hand, if a tomographic image captured with a wide angle of view is selected, it is displayed at a scale that displays the entire image in the display area. For example, a 2 mm Depth scale may be set for a narrow angle of view, and a Fit scale may be set for a wide angle of view.
[0156] The image processing and display operation flow in steps S1305 to S1310 is the same as in the first embodiment, and therefore a description thereof will be omitted.
[0157] As a report displaying tomographic images, a plurality of tomographic images acquired at different angles of view may be displayed side by side as shown in Fig. 12, or only tomographic images at the same angle of view may be displayed. The display method for displaying other plurality of tomographic images is the same as in Example 1, and therefore description thereof will be omitted.
[0158] <Other Examples> Examples 1 to 4 of this specification may be carried out in appropriate combination.
[0159] The technology disclosed herein can also be realized by providing software (programs) that realize one or more functions of the various embodiments described above to a system or device via a network or a storage medium, and having a computer in the system or device read and execute the programs. The computer has one or more processors or circuits, and may include multiple separate computers or a network of multiple separate processors or circuits to read and execute computer-executable instructions.
[0160] In this case, the processor or circuitry may include a central processing unit (CPU), a microprocessing unit (MPU), a graphics processing unit (GPU), an application specific integrated circuit (ASIC), or a field programmable gateway (FPGA), and may also include a digital signal processor (DSP), a data flow processor (DFP), or a neural processing unit (NPU).
Claims
1. 1. An information processing device that acquires a tomographic image of a subject's eye using interference light obtained by combining return light from the subject's eye irradiated with measurement light and reference light, a control means for controlling a scanning means for scanning the measurement light at the subject's eye at a selected angle of view when any of a plurality of angles of view including a first angle of view and a second angle of view narrower than the first angle of view is selected as an angle of view for acquiring a tomographic image of the subject's eye; a display control means for displaying a first tomographic image acquired at the first angle of view in a display area when the first angle of view is selected, and for displaying a partial image included in a second tomographic image acquired at the second angle of view, the partial image having a length in a depth direction of the subject's eye shorter than that of the second tomographic image, in a manner that fits the display area when the second angle of view is selected; Equipped with the length in the depth direction of the partial image is a length based on the length in the depth direction of a tomographic image acquired by an ophthalmic examination apparatus different from the ophthalmic examination apparatus that acquired the tomographic image, the ophthalmic examination apparatus that has acquired the tomographic image is an SS-OCT that acquires the tomographic image of the test eye using interference light obtained by combining return light from the test eye that has been irradiated with measurement light by a wavelength swept light source and reference light; The information processing device is an SD-OCT that uses interference light acquired through a spectroscope, and the ophthalmic examination device that is different from the ophthalmic examination device that acquired the tomographic image is different from the SD-OCT that uses interference light acquired through a spectroscope.
2. 1. An information processing device that acquires a tomographic image of a subject's eye using interference light obtained by combining return light from the subject's eye irradiated with measurement light and reference light, an acquisition means for acquiring the selected tomographic image in response to a user's instruction to select at least one of a plurality of tomographic images including a first tomographic image of the subject's eye and a second tomographic image having a depth length longer than that of the first tomographic image in the depth direction of the subject's eye; a display control means for displaying the first tomographic image in a display area when the first tomographic image is selected, and for displaying a partial image included in the second tomographic image, the partial image having a length in the depth direction of the subject's eye shorter than that of the second tomographic image, so as to fit the partial image in the display area when the second tomographic image is selected; An information processing device comprising:
3. 3. The information processing apparatus according to claim 1, wherein the measurement light is emitted by a wavelength swept light source.
4. an acquisition means for acquiring a selected tomographic image in response to a user's instruction to select at least one of a first tomographic image acquired by SD-OCT using interference light acquired through a spectroscope and a second tomographic image acquired by SS-OCT, which acquires a tomographic image of the subject's eye using interference light obtained by combining return light from the subject's eye irradiated with measurement light by a wavelength swept light source and reference light; a display control means for displaying the first tomographic image in a display area when the first tomographic image is selected, and for displaying a partial image included in the second tomographic image, the partial image having a length in the depth direction of the subject's eye shorter than that of the second tomographic image, so as to fit the partial image in the display area when the second tomographic image is selected; An information processing device comprising:
5. The information processing apparatus according to claim 1 , wherein the display control means updates the display of the partial image in the second tomographic image to a display of a partial image different from the partial image in response to a user instruction.
6. The information processing device according to any one of claims 1 to 5, wherein the display control means displays the partial image obtained using information on layer boundaries obtained by analyzing the second tomographic image so as to fit the partial image to the display area.
7. 7. The information processing device according to claim 1, wherein the display control means displays at least one of the first tomographic image and the second tomographic image on a display unit as a report, and further displays at least one of a scan mode for scanning the test eye with measurement light, the left or right eye, the examination date and time, and patient information on the display unit.
8. The information processing device according to claim 7, wherein the display control means, in response to a user's instruction to select at least two of a plurality of tomographic images including the first tomographic image and the second tomographic image as a comparison source image and a comparison target image, displays the comparison source image and the comparison target image side by side on the display unit so that the depth-wise lengths of the displayed areas of the comparison source image and the comparison target image in the subject's eye are the same.
9. 9. The information processing apparatus according to claim 7, wherein the display control means causes the display unit to display at least one of the first tomographic image and the partial image as a live image.
10. 10. The information processing apparatus according to claim 9, wherein the display control means further causes the display unit to display a front image of the subject's eye as a live image.
11. The information processing apparatus according to claim 1 , wherein a tomographic image of a fundus of the subject's eye is acquired as the tomographic image of the subject's eye.
12. An ophthalmologic system in which the information processing device according to claim 1 and an ophthalmologic examination device including a detection unit for detecting the interference light are communicably connected.
13. An ophthalmic examination apparatus that acquires a tomographic image of a subject's eye by using interference light obtained by combining return light from the subject's eye irradiated with measurement light and reference light, a control means for controlling a scanning means for scanning the measurement light at the subject's eye at a selected angle of view when any of a plurality of angles of view including a first angle of view and a second angle of view narrower than the first angle of view is selected as an angle of view for acquiring a tomographic image of the subject's eye; a display control means for displaying a first tomographic image acquired at the first angle of view in a display area when the first angle of view is selected, and for displaying a partial image included in a second tomographic image acquired at the second angle of view, the partial image having a length in a depth direction of the subject's eye shorter than that of the second tomographic image, in a manner that fits the display area when the second angle of view is selected; Equipped with the length in the depth direction of the partial image is a length based on the length in the depth direction of a tomographic image acquired by an ophthalmic examination apparatus different from the ophthalmic examination apparatus that acquired the tomographic image, the ophthalmic examination apparatus that has acquired the tomographic image is an SS-OCT that acquires the tomographic image of the test eye using interference light obtained by combining return light from the test eye that has been irradiated with measurement light by a wavelength swept light source and reference light; The ophthalmic examination apparatus different from the ophthalmic examination apparatus that acquired the tomographic image is an SD-OCT ophthalmic examination apparatus that uses interference light acquired through a spectroscope.
14. 14. The ophthalmic examination apparatus according to claim 13, wherein the depth direction length of the acquired tomographic image in the subject's eye cannot be changed when the first tomographic image is acquired at the first angle of view and when the second tomographic image is acquired at the second angle of view.
15. An ophthalmic examination apparatus that acquires a tomographic image of a subject's eye by using interference light obtained by combining return light from the subject's eye irradiated with measurement light and reference light, an acquisition means for acquiring the selected tomographic image in response to a user's instruction to select at least one of a plurality of tomographic images including a first tomographic image of the subject's eye and a second tomographic image having a depth length longer than a depth length of the first tomographic image in the subject's eye; a display control means for displaying the first tomographic image in a display area when the first tomographic image is selected, and for displaying a partial image included in the second tomographic image, the partial image having a length in the depth direction of the subject's eye shorter than that of the second tomographic image, so as to fit the partial image in the display area when the second tomographic image is selected; An ophthalmic examination apparatus comprising:
16. A control method for an ophthalmic examination apparatus that acquires a tomographic image of a subject's eye by using interference light obtained by combining return light from the subject's eye irradiated with measurement light and reference light, comprising: When one of a plurality of angles of view including a first angle of view and a second angle of view narrower than the first angle of view is selected as an angle of view for acquiring a tomographic image of the subject's eye, controlling a scanning unit that scans the subject's eye with the measurement light at the selected angle of view; a step of displaying a first tomographic image acquired at the first angle of view in a display area when the first angle of view is selected, and displaying a partial image included in a second tomographic image acquired at the second angle of view, the partial image having a shorter length in a depth direction of the subject's eye than the second tomographic image, in a manner that fits the display area when the second angle of view is selected; Including, the length in the depth direction of the partial image is a length based on the length in the depth direction of a tomographic image acquired by an ophthalmic examination apparatus different from the ophthalmic examination apparatus that acquired the tomographic image, the ophthalmic examination apparatus that has acquired the tomographic image is an SS-OCT that acquires the tomographic image of the test eye using interference light obtained by combining return light from the test eye that has been irradiated with measurement light by a wavelength swept light source and reference light; A method for controlling an ophthalmic examination apparatus, wherein the ophthalmic examination apparatus different from the ophthalmic examination apparatus that acquired the tomographic image is an SD-OCT that uses interference light acquired via a spectroscope.
17. A control method for an ophthalmic examination apparatus that acquires a tomographic image of a subject's eye by using interference light obtained by combining return light from the subject's eye irradiated with measurement light and reference light, comprising: acquiring the selected tomographic image in response to a user's instruction to select at least one of a plurality of tomographic images including a first tomographic image of the subject's eye and a second tomographic image having a depth length longer than a depth length of the first tomographic image in the subject's eye; a step of displaying the first tomographic image in a display area when the first tomographic image is selected, and displaying a partial image included in the second tomographic image, the partial image having a length in a depth direction of the subject's eye shorter than that of the second tomographic image, so as to fit the partial image in the display area when the second tomographic image is selected; A method for controlling an ophthalmic examination apparatus comprising:
18. a step of acquiring a selected tomographic image in response to a user's instruction to select at least one of a first tomographic image acquired by SD-OCT using interference light acquired through a spectroscope and a second tomographic image acquired by SS-OCT, which acquires a tomographic image of the subject's eye using interference light obtained by combining return light from the subject's eye irradiated with measurement light by a wavelength swept light source and reference light; a step of displaying the first tomographic image in a display area when the first tomographic image is selected, and displaying a partial image included in the second tomographic image, the partial image having a length in a depth direction of the subject's eye shorter than that of the second tomographic image, so as to fit the partial image in the display area when the second tomographic image is selected; A control method for an information processing device including:
19. A program that causes a computer to execute the control method according to any one of claims 16 to 18.
Citation Information
Patent Citations
Image processing apparatus, control method therefor, and program
JP2017006436A
Oct apparatus
JP2019150409A
Ophthalmologic imaging apparatus, control device and control method therefor, and program
JP2020110256A
Image processing device
JP2021037170A
Report driven workflow for ophthalmic image data acquisition
US20170228521A1