Autofluorescence photography device and its operating method, autofluorescence image evaluation device and its evaluation method
The autofluorescence imaging device with filters allows for quantitative assessment of cataract and presbyopia progression, addressing subjective judgments in current methods and reducing unnecessary surgeries.
Patent Information
- Application Number
- JP2024534416
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2022-03-02
- Filing Date
- 2022-11-17
- Publication Date
- 2024-12-05
- Estimated Expiration
- 2042-11-17
AI Technical Summary
Current methods for determining the progression of cataracts and presbyopia rely on subjective medical professional observations, leading to inconsistent judgments and potential unnecessary surgeries.
An autofluorescence imaging device and evaluation method using filters with varying light transmittances to capture and analyze autofluorescence images of the eye, allowing for quantitative assessment of lens abnormalities.
Enables precise determination of cataract and presbyopia progression, reducing unnecessary surgeries and associated costs by providing objective, quantitative evaluations.
Smart Images

Figure 2024545158000001_ABST
Abstract
Description
[Technical field]
[0001] The present disclosure relates to an apparatus and operating method for capturing autofluorescence (AF) images of a test eye, and an apparatus and evaluation method for evaluating autofluorescence images, and more specifically, to AF image capture and evaluation based on a filter that can quantitatively evaluate ophthalmic diseases or the progression of presbyopia. [Background technology]
[0002] The Lens Opacities Classification System (LOCS) is a standard for classifying conventional nuclear cataracts. LOCS divides the lens into three parts: the cortex, nucleus, and posterior capsule, and classifies the cortex and posterior capsule into five stages based on opacity, and the nucleus into six stages based on opacity and color. Medical professionals use the LOCS to determine whether or not a patient has nuclear cataracts, based on the results of directly observing the lens slices with a slit lamp microscope. Cataract removal surgery involves removing the opacified lens and inserting an artificial lens.
[0003] However, depending on the stage of cataract, surgery to remove cataract may not be necessary, and currently, the stage of cataract is judged only by direct observation by medical professionals, which causes problems such as different judgment results depending on the medical professionals, and there is a possibility that patients who do not need surgery may end up undergoing surgery to remove cataract. Therefore, a method for quantitatively judging the stage of cataract or the stage of presbyopia is required.
[0004] There is also a conventional fundus autofluorescence (FAF) imaging technique. Unlike fluorescence angiography, FAF does not require the injection of fluorescent dye to image the retina, but generates images by utilizing the fluorescent properties of lipofuscin in the retinal pigment epithelium (RPE). Since abnormal patterns of autofluorescence (AF) in FAF images act as markers for retinal disease, conventional FAF was used to evaluate the presence or absence of retinal disease or abnormalities, but not for the presence or absence of lens abnormalities.
[0005] Patent Document 1 describes a technology for determining the intensity histogram in a patient's FAF image and comparing it with a control group to determine the presence or absence of abnormalities. However, this is also a technology for identifying retinal diseases, and it is difficult to use it for quantitative evaluation of lens abnormalities, including the progression of presbyopia or cataracts. [Prior art documents] [Patent documents]
[0006] [Patent Document 1] Korean Patent No. 10-1643953 Summary of the Invention [Problem to be solved by the invention]
[0007] One embodiment of the present disclosure provides an apparatus and method of operation for capturing autofluorescence images of a test eye based on a filter for assessing the presence or absence of lens abnormalities. Another embodiment of the present disclosure provides an apparatus and method for analyzing and evaluating autofluorescence images of a subject's eye captured based on a filter for evaluation of lens abnormalities. Another embodiment of the present disclosure provides a filter that can be used in an apparatus that takes autofluorescence images of a subject's eye for evaluation of lens abnormalities. [Means for solving the problem]
[0008] One embodiment of the present disclosure provides an apparatus for imaging autofluorescence of a subject's eye and a method of operating the same.
[0009] One embodiment of the present disclosure provides an apparatus and an evaluation method for quantitatively evaluating an autofluorescence image of a test eye.
[0010] An autofluorescence imaging device according to one embodiment of the present disclosure includes a light source that illuminates a test eye through a predetermined optical path, an image sensor that images the test eye, at least a portion of which emits autofluorescence due to illumination from the light source, and a filter arranged between the image sensor and the test eye, the filter including multiple portions having different light transmittances.
[0011] An autofluorescence image evaluation device according to an embodiment of the present disclosure includes a processor and a memory electrically connected to the processor and storing at least one code executed by the processor, the memory storing code for causing the processor to analyze an autofluorescence image of a test eye and determine information related to the opacity or cataract grade of the test eye, and the autofluorescence image may be an image generated based on an output of an image sensor in which autofluorescence of the test eye generated by illumination from a light source is incident after passing through a filter disposed between the image sensor and the test eye and including a plurality of portions having different light transmittances.
[0012] An operating method of an autofluorescence imaging device according to one embodiment of the present disclosure includes a step in which a processor causes a light source to emit light so as to illuminate the test eye through a predetermined optical path, and a step in which the processor controls an image sensor to image the test eye, at least a portion of which is illuminated with autofluorescence due to the illumination from the light source, wherein the step of imaging the test eye includes a step in which the image sensor generates an output signal based on the autofluorescence of the test eye that passes through a filter including a plurality of portions having different light transmittances and enters the image sensor.
[0013] An evaluation method of an autofluorescence image evaluation device according to an embodiment of the present disclosure includes a step of a processor receiving at least a portion of an autofluorescence image of a test eye, and a step of the processor analyzing the autofluorescence image to determine information related to the opacity or cataract grade of the test eye, and the autofluorescence image may be an image generated based on the output of an image sensor in which autofluorescence of the test eye generated by illumination from a light source is incident through a filter disposed between the image sensor and the test eye and including a plurality of portions having different light transmittances. Effect of the Invention
[0014] An autofluorescence imaging device and an operating method thereof according to an embodiment of the present disclosure can capture an autofluorescence image that allows quantitative determination of the presence or absence of a crystalline lens abnormality.
[0015] The autofluorescence image evaluation device and evaluation method according to the embodiment of the present disclosure can quantitatively evaluate the presence or absence of lens abnormalities, including the progression of presbyopia or cataract, based on an autofluorescence image.
[0016] The embodiments of the present disclosure can quantitatively evaluate the presence or absence of a patient's lens abnormality and prevent unnecessary cataract surgery, thereby reducing the inconvenience to the patient and saving the cost of unnecessary surgery. [Brief description of the drawings]
[0017] [Figure 1] 1 is a diagram illustrating an environment in which an autofluorescence imaging device according to an embodiment of the present disclosure captures an image using a filter for evaluating the presence or absence of a lens abnormality. [Diagram 2] 1 is a block diagram showing a schematic configuration of an autofluorescence imaging device according to an embodiment of the present disclosure. [Diagram 3] 1 is a flowchart for explaining an operation method of an autofluorescence imaging device according to an embodiment of the present disclosure. [Figure 4] 1 is a flowchart for explaining an operation method of an autofluorescence imaging device according to an embodiment of the present disclosure. [Diagram 5] 1 is a diagram illustrating an embodiment of a filter for evaluating the presence or absence of a lens abnormality according to an embodiment of the present disclosure. [Figure 6] 1 is a diagram illustrating an embodiment of a filter for evaluating the presence or absence of a lens abnormality according to an embodiment of the present disclosure. [Figure 7] 1 is a block diagram showing a schematic configuration of an autofluorescence image evaluation device according to an embodiment of the present disclosure. [Figure 8] 1 is a flowchart for explaining a method for evaluating an autofluorescence image evaluation device according to an embodiment of the present disclosure. [Figure 9] 1 is a diagram for explaining an evaluation method of an autofluorescence image evaluation device according to an embodiment of the present disclosure. [Figure 10] 1 is a diagram for explaining an evaluation method of an autofluorescence image evaluation device according to an embodiment of the present disclosure. MODE FOR CARRYING OUT THEINVENTION
[0018] Hereinafter, the embodiments disclosed herein will be described in detail with reference to the accompanying drawings. Identical or similar components are given the same reference numerals regardless of the drawing reference numerals, and redundant description thereof will be omitted. The suffixes "module" and "part" for components used in the following description are given or mixed for the sake of ease of specification preparation only, and do not have any mutually distinguishing meaning or role. In addition, when it is determined that a detailed description of related known technology may make the gist of the embodiments disclosed herein unclear in describing the embodiments disclosed herein, the detailed description will be omitted. In addition, the accompanying drawings are intended only to facilitate understanding of the embodiments disclosed herein, and the technical ideas disclosed herein are not limited by the accompanying drawings, and should be understood to include all modifications, equivalents, or alternatives included in the ideas and technical scope of the present invention.
[0019] Although terms including ordinal numbers such as "first", "second", etc. may be used to describe various components, the components are not limited by the terms, and the terms are used only to distinguish one component from another.
[0020] When a component is referred to as being "coupled" or "connected" to another component, it should be understood that the component may be directly coupled or connected to the other component, and that there may be other components in between. Conversely, when a component is referred to as being "directly coupled" or "directly connected" to another component, it should be understood that there are no other components in between.
[0021] The environment and configuration for driving an autofluorescence imaging device according to an embodiment of the present disclosure will be described with reference to FIGS.
[0022] The autofluorescence imaging device 100 according to the embodiment of the present disclosure may include a filter (hereinafter, referred to as an "analysis filter") 150 for evaluating lens abnormalities inside a main body 100a including a camera, or may be configured to be disposed outside the main body 100a. In another embodiment, the analysis filter 150 may be embodied in the form of glasses, and an autofluorescence image may be captured in a state where the subject is wearing the analysis filter 150 in the form of glasses when capturing an image with the autofluorescence imaging device 100.
[0023] The autofluorescence imaging device 100 can be set to emit excitation light from a light source and guide the excitation light along a preset optical path to illuminate the patient's eye to be examined.
[0024] The autofluorescence imaging device 100 includes an image sensor 140 to which autofluorescence (AF) emitted from the subject's eye in response to excitation light is incident, and an analysis filter may be disposed between the image sensor 140 and the subject's eye. The analysis filter may be configured to be disposed inside or outside the main body 100a. An embodiment in which the analysis filter is disposed outside includes a case in which the subject wears an analysis filter 150 in the form of glasses. That is, the autofluorescence generated from the subject's eye in response to excitation light may pass through the analysis filter 150 and be incident on the image sensor 140.
[0025] Autofluorescence can originate from the crystalline lens as well as lipofuscin in the retinal pigment epithelium (RPE) of the examined eye.
[0026] That is, when an autofluorescence image is captured using an analysis filter according to an embodiment of the present invention for lenses with different opacities as shown in Fig. 9, contrary to the general expectation that the retinal autofluorescence should be blocked by the opacity of the lens, the inventors confirmed an increase in brightness of a part of the image due to the autofluorescence of the lens, and as a result, the presence or absence of a lens abnormality can be quantitatively determined based on a gray level change of the autofluorescence image corresponding to the figure pattern of the analysis filter according to an embodiment of the present invention. This is determined to be a composite phenomenon caused by a part of the retinal autofluorescence blocked by the opacity, a part of the retinal autofluorescence incident on the image sensor 140 due to scattering, refraction, etc., and scattering of the lens autofluorescence. Therefore, the progression of cataracts and presbyopia related to the opacity of the lens can be quantitatively evaluated based on the analysis filter according to an embodiment of the present invention.
[0027] The camera of the autofluorescence imaging device 100 may include an image sensor (CCD or CMOS) 140, and the field of view and focus may be adjustable so that autofluorescence can be captured from the subject's eye.
[0028] The autofluorescence imaging device may include an optical system 130 including mirrors, lenses, etc., to guide light emitted from a light source through a first filter set to pass only light of a specific wavelength to the subject's eye.
[0029] The first filter may be selected to reduce wavelengths that do not correspond to a wavelength band (e.g., wavelengths at or near about 470 nm) that excites certain cells to produce autofluorescence. However, embodiments of the present invention are not limited to a particular band of excitation wavelengths, and other wavelength bands of excitation light directed to the subject's eye are possible with other configurations of the autofluorescence imaging device. If the light source is configured to generate only light in a particular band, the first filter may be omitted.
[0030] The autofluorescence generated from the test eye by the excitation light can pass through the lenses, mirrors, etc. of the optical system 130 and enter the camera's image sensor 140. In one embodiment, the autofluorescence imaging device 100 includes a second filter for removing light in an undesired band or light that is not autofluorescence from the autofluorescence.
[0031] The analysis filter 150 can allow the autofluorescence generated from the subject's eye to pass through before it is incident on the image sensor 140, and may be configured to be disposed before or after the second filter.
[0032] When the analysis filter 150 is disposed outside the main body 100a, it may include a structure that can be attached to a rest on which the patient's forehead and chin are placed, or it may include a structure (e.g., a wheel to which the analysis filter 150 is attached and a wheel drive motor) that can be rotatably disposed in front of the camera so that the analysis filter 150 can be selectively used depending on the shooting mode.
[0033] The analysis filter 150 may include a number of sections with different light transmittances, which will be described in detail below with reference to FIGS.
[0034] The autofluorescence imaging device 100 may store the autofluorescence image generated based on the output of the image sensor 140 in the memory 120 or transmit it to a connected external device via a communication module. The autofluorescence imaging device 100 may include a processor 110 that performs post-processing of the wavelength and brightness of the light source or the generated autofluorescence image. In another embodiment, the autofluorescence imaging device 100 may be connected to an external control computing device, and the control computing device may set the autofluorescence imaging device 100 or perform post-processing of the captured autofluorescence image. In this specification, the processor 110 of the autofluorescence imaging device 100 may be understood as a concept including a computing device embodied separately from the main body 100a.
[0035] The controlling computing device may include, for example, a tablet computer, a PC, a laptop computer, a smartphone, and the like.
[0036] The communication module may include a configuration similar to part or all of the communication unit 210 of the autofluorescence image evaluation device 200 described below, and the main body 100a may be connected to the control computing device in various ways such as a cable, LAN, Wi-Fi (registered trademark), or short-range wireless communication.
[0037] A method of operation of the autofluorescence imaging device 100 according to one embodiment of the present disclosure will be described with reference to FIGS.
[0038] The autofluorescence photography device 100 controls the light source to emit light including a wavelength band capable of generating autofluorescence from the subject's eye (S110).
[0039] The light generated by the light source may include a wavelength band that excites specific cells to produce autofluorescence (eg, a wavelength at or near about 470 nm) or may include only that wavelength band.
[0040] The light emitted from the light source can be guided to illuminate the subject's eye through an optical system 130, such as optical filters, mirrors, lenses, etc. The processor 110 can control the angles, positions, etc. of the components of the optical system 130.
[0041] Light emitted from the light source and guided to the test eye via the optical system 130 generates autofluorescence in the retinal cells or crystalline lens of the test eye, and the generated autofluorescence passes through the analysis filter 150 and enters the image sensor 140 (S120).
[0042] The autofluorescence may, in one embodiment, pass through optics 130 , such as mirrors, optical filters, lenses, etc., before or after passing through analysis filter 150 .
[0043] The image sensor 140 outputs an electrical signal based on the incident autofluorescence, and the processor 110 generates an autofluorescence image based on the output of the image sensor 140 (S130).
[0044] In one embodiment, the autofluorescence imaging device 100 may include information indicating the type of image, etc., for distinguishing the autofluorescence image generated based on the analysis filter 150 according to an embodiment of the present invention from a conventional general autofluorescence image in the header information of the autofluorescence image (S140). Alternatively, a user-defined message may be generated based on Digital Imaging and Communications in Medicine (DICOM) in a Picture Archiving and Communication System (PACS) server device, which indicates that the autofluorescence imaging device 100 based on the analysis filter 150 according to an embodiment of the present invention operates as an SCU to transmit an image.
[0045] The autofluorescence imaging device 100 may store the autofluorescence image generated based on the analysis filter 150 according to one embodiment of the present invention in a control computing device or transmit it to a CIS (Clinical Information System), PACS, or HIS (Hospital Information System) server device.
[0046] In one embodiment, the autofluorescence imaging device 100 checks the position of the analysis filter 150 in order to capture an autofluorescence image based on the analysis filter 150 according to one embodiment of the present invention (S210), checks the imaging mode of the autofluorescence imaging device 100 (S220), and then outputs a warning message or confirmation message on a display, via sound, a warning light, etc. based on the comparison result (S230).
[0047] When the analysis filter 150 is positioned by rotating in a rotary manner using wheels, the autofluorescence imaging device 100 can determine the position (including whether it is attached or detached) of the analysis filter 150 using a sensor that determines the position due to rotation, or a sensor that determines whether it is attached or detached when it is attached to a mounting base in a detachable structure. Alternatively, the autofluorescence imaging device 100 can determine the position (including whether it is attached or detached) by recognizing the output of an RF chip attached to the analysis filter 150. When the analysis filter 150 is embodied in the form of glasses, it can determine whether the subject is wearing it using a human body detection sensor (such as infrared rays).
[0048] The autofluorescence imaging device 100 may be embodied to be operable in a mode for imaging conventional autofluorescence in addition to a mode for imaging autofluorescence based on the analysis filter 150 according to an embodiment of the present invention, and in this case, may include a mechanical interface (e.g., the rotary lever 160 in FIG. 1) for selecting an imaging mode, or an electrical interface of a display of the main body 150a or a control computing device. Thus, the autofluorescence imaging device 100 may output a warning message when the analysis filter 150 is in the imaging position despite being set to the mode for imaging conventional autofluorescence after confirming that the mode is for imaging autofluorescence based on the analysis filter 150 according to an embodiment of the present invention, or vice versa. Alternatively, when the analysis filter 150 is placed in the imaging position regardless of the imaging mode, a message may be output notifying that the analysis filter 150 is activated.
[0049] 5 and 6, an embodiment of an analysis filter 150 according to one embodiment of the present disclosure will be described.
[0050] The analysis filter 150 may include an outer circumferential part 510 that may be attached to a stand on which a patient's forehead and chin are placed or may be coupled to the main body 100a, and a filter part 520 through which autofluorescence generated from the subject's eye passes. The filter part 520 may include a plurality of parts 521, 522, and 523 having different light transmittances. The light transmittance in this specification is a concept that includes changes in luminous intensity or other light characteristics due to scattering and refraction after light passes through.
[0051] For example, the filter unit 520 may include a transparent first portion 521 and second portions 522 and 523 having a lower light transmittance than the first portion 521 and having a plurality of patterns formed thereon.
[0052] The first portion 521 may be transparent or opaque, but may have a higher light transmittance than the second portions 522 and 523. The filter unit 520 is made of glass or plastic, and the second portions 522 and 523 may be embodied in such a manner that a film having a different color or material is attached thereto, or the surface roughness of the second portions 522 and 523 is changed. In the case of glass, the second portions 522 and 523 may be frosted glass obtained by friction or corrosion. In the case of implementing the analysis filter 150 using glass, the second portions 522 and 523 may be embodied by etching glass using a glass etching solution or laser processing, or sandblasting by pneumatically spraying sand or emery. FIG. 11 is a photograph taken after implementing the analysis filter 150 according to an embodiment of the present invention in the form of FIG. 6(c) using a laser processing method and placing it on a printed material. As can be seen from FIG. 11, the light transmittance of the second portion is lower than that of the first portion.
[0053] In one embodiment, the second part 522 of the analysis filter 150 may be embodied in a plurality of graphic patterns, and may be a plurality of ring-shaped and circle-shaped figures. In the case of a ring-shaped figure, the inside of the circle inside the ring may be the first part. As will be described in detail below, the autofluorescence image evaluation device 200 may evaluate the presence or absence of abnormality in the crystalline lens based on the result of measuring the gray level in the part of the autofluorescence image corresponding to the first part 521 and / or the second parts 522 and 523 of the analysis filter. In the case of a ring-shaped figure, the autofluorescence image may be analyzed by treating the gray level inside the circle inside the ring and the gray level of the ring part as the first part and the second part, respectively. Therefore, in the case of a ring-shaped figure, the position for analyzing the gray level may be easily identified through graphic recognition.
[0054] In one embodiment, a plurality of graphic patterns having low light transmittance in the analysis filter 150 may be spaced apart from each other, and the plurality of graphic patterns may be arranged in a vertically symmetrical or horizontally symmetrical manner in the filter unit.
[0055] Various embodiments of the analysis filter 150 will be described with reference to Fig. 6. Fig. 6 shows an embodiment in which the outer periphery of the analysis filter 150 is omitted and only the filter portion is shown.
[0056] 6(a), the second portions 611 and 612 of the analysis filter 150 may be rectangular figures having uniform light transmittance inside and lower light transmittance than other portions (first portions). Also, the area of the figure of the second portion 612 farther from the center (located in the peripheral portion, close to the outer periphery) may be larger than the figure of the second portion 611 close to the center of the filter portion.
[0057] In an embodiment, the horizontal ratio of the figure of the second portion 612 farther from the center may be larger. In this case, in the case of an autofluorescence imaging device that scans the subject's eye, a portion of an image corresponding to the second portion in an autofluorescence image may be displayed in the same size in order to accommodate the shape of the eyeball having a larger left-right ratio or barrel distortion due to the spherical shape or lens shape of the eyeball.
[0058] 6(b), the shape of the second portion 622 far from the center may be a rectangle having a different shape from the shape of the second portion 621 close to the center. For example, the shape of the second portion 621 may be a square or rectangle, and the shape of the second portion 622 may be a parallelogram or a trapezoid. In this case, it can be seen that the barrel distortion is more actively reflected.
[0059] 6(a)-(c), in one embodiment, the plurality of figures corresponding to the second portion of the filter portion may have different numbers of figures distributed by horizontal and vertical lines crossing the center of the filter portion, for example, the number of figures distributed by vertical lines may be smaller, that is, the figures of the second portion may not be arranged in the portion 623 close to the outer periphery of the figures distributed by vertical lines. This may be a figure pattern considering a case where the shape of the eyeball is an ellipse shape with a larger ratio of left and right, or a case where more left and right portions of the subject eye are visualized due to the eyelids, etc.
[0060] Referring to FIG. 6(c), a plurality of shapes corresponding to the second portion of the filter unit may be arranged in a form extending radially from a central point.
[0061] Referring to FIG. 6(c), the plurality of figures corresponding to the second portion of the filter unit may not be arranged in a portion near the center 631. When capturing an autofluorescence image using the analysis filter 150, a point to guide the patient's gaze is necessary. Therefore, by not arranging the plurality of figures corresponding to the second portion in a portion near the center 631, the patient's gaze can be guided and an appropriate autofluorescence image can be captured. In one embodiment, the portion where the figures corresponding to the second portion are not arranged may be the position of the center 631 or a position spaced a predetermined position downward or upward from the center 631. Due to the structure of the human eyeball, even if one focuses on the center, the image may be captured differently in an autofluorescence fundus photograph. Therefore, reflecting this, the figures corresponding to the second portion may not be arranged in a position spaced a predetermined position downward or upward from the center 631 of the pattern.
[0062] The configuration of an autofluorescence image evaluation device 200 according to an embodiment of the present disclosure will be described with reference to FIG.
[0063] The autofluorescence image evaluation device 200 can quantitatively evaluate the presence or absence of a crystalline lens abnormality of the subject's eye by analyzing an autofluorescence image generated based on an analysis filter in an autofluorescence imaging device.
[0064] The autofluorescence image evaluation device 200 may be implemented as a control computing device that controls an autofluorescence imaging device, a CIS / PACS / HIS server device, or a standalone computing device. The autofluorescence image evaluation device 200 may be a computing device that can load and analyze an autofluorescence image, such as a tablet computer, a laptop computer, a PC, or a smartphone.
[0065] The autofluorescence image evaluation device 200 may include a communication unit 210 that receives an autofluorescence image from a server device of a CIS / PACS / HIS, an autofluorescence imaging device, or a control computing device of the autofluorescence imaging device.
[0066] The communication unit 210 may include a wireless communication unit or a wired communication unit.
[0067] The wireless communication unit may include at least one of a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module.
[0068] The mobile communication module transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server over a mobile communication network established by LTE (Long Term Evolution), which is a communication method for mobile communication.
[0069] The wireless Internet module is a module for wireless Internet connection and can be built into or external to the autofluorescence image evaluation device 200, and WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance) (registered trademark), etc. may be used.
[0070] A short-range communication module is a module for transmitting and receiving data via short-range communication, and can use Bluetooth (registered trademark), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee (registered trademark), NFC (Near Field Communication), etc.
[0071] The location information module is a module for acquiring the location of the autofluorescence image assessment device 200, and may be a GPS (Global Positioning System) module based on satellite navigation technology, or a module for acquiring the location based on wireless communication with a wireless communication base station or a wireless access point. The location information module may include a WiFi module.
[0072] In one embodiment, the autofluorescence image evaluation device 200 may include an interface unit 220 for user input, and the interface unit 220 may include an input unit or an output unit.
[0073] The input unit includes a user interface (UI) including a microphone and a touch interface 221 for receiving information input from a user, and the UI may include a mouse, a keyboard, as well as a mechanical or electronic interface implemented in the device, and is not particularly limited in type or form as long as it can input a user command. The electronic interface includes a display that allows touch input.
[0074] The output unit is for displaying the output of the autofluorescence image evaluation device 200 to the outside to transmit information to the user, and may include a display 222, an LED, a speaker 223, etc. for displaying visual output, auditory output, or tactile output.
[0075] The autofluorescence image evaluation device 200 may include a peripheral device interface unit for data transmission with various types of connected external devices, and may include a memory card port, an external device I / O (Input / Output) port, etc.
[0076] The autofluorescence image evaluation device 200 includes a memory 240 for storing received autofluorescence images or images captured by a camera, and for storing code for operating the processor 230 .
[0077] The autofluorescence image evaluation device 200 determines information related to the opacity or cataract grade of the subject's eye by analyzing the autofluorescence image loaded by the processor 230. The autofluorescence image analyzed by the autofluorescence image evaluation device 200 is an image generated based on the output of an image sensor in which autofluorescence of the subject's eye, generated by illumination from a light source, is incident on a filter that is disposed between the image sensor and the subject's eye and includes a plurality of portions with different light transmittances.
[0078] An evaluation method for the autofluorescence image evaluation device 200 according to an embodiment of the present disclosure will be described with reference to FIG.
[0079] The autofluorescence image evaluation device 200 receives an autofluorescence image or at least a part thereof captured based on an analysis filter from an autofluorescence imaging device, a control computing device of the autofluorescence imaging device, or a server device of a CIS / PACS / HIS (S310). The autofluorescence image evaluation device 200 may also receive only a part of the autofluorescence image corresponding to a first portion and / or a second portion of an analysis filter including a plurality of portions having different light transmittances of the autofluorescence image.
[0080] The autofluorescence image evaluation device 200 can analyze (S320) the gray levels of the autofluorescence image portions corresponding to the second portion and / or the first and second portions of the analysis filter, and determine (S330) information related to the opacity or cataract grade of the test eye.
[0081] When the autofluorescence image evaluation device 200 receives the entire autofluorescence image captured using the analysis filter, it can detect an autofluorescence image portion corresponding to the second portion of the analysis filter based on a machine learning-based learning model. In this case, the learning model may be a learning model trained using a graphic pattern of the second portion of the analysis filter or a learning model trained using an image in which a portion of the autofluorescence image corresponding to the second portion of the analysis filter is labeled.
[0082] When the autofluorescence image evaluation device 200 receives the whole or a part of the autofluorescence image captured using the analysis filter, the autofluorescence image part corresponding to the second portion of the analysis filter may be input to a machine learning-based learning model to determine the lens opacity, the cataract progression, or the presbyopia progression (S330). In this case, the learning model may be a learning model trained by an image in which the whole autofluorescence image or the part corresponding to the second portion of the analysis filter is labeled with the lens opacity, the cataract progression, or the presbyopia progression.
[0083] Machine learning-based learning models can include neural networks with CNN or R-CNN (Region based CNN), C-RNN (Convolutional Recursive Neural Network), Fast R-CNN, Faster R-CNN, R-FCN (Region based Fully Convolutional Network), YOLO (You Only Look Once) or SSD (Single Shot Multibox Detector) structures.
[0084] The learning model may be implemented in hardware, software, or a combination of hardware and software, and if some or all of the learning model is implemented in software, one or more instructions constituting the learning model may be stored in memory.
[0085] In one embodiment, the autofluorescence image evaluation device 200 can determine information related to the opacity or cataract grade of the test eye based on the result of comparing the gray levels of the autofluorescence image portions corresponding to the first and second portions of the analysis filter.
[0086] 9, color images 910, 920, 930, and 940 of test eyes having opacity grades 2, 3, 4, and 6 according to the LOCS standard, and images 911, 921, 931, and 941 taken using an analysis filter (FIGS. 6(c) and 11) according to an embodiment of the present invention can be seen. The autofluorescence image evaluation device 200 receives the images 911, 921, 931, and 941 taken using the analysis filter (FIGS. 6(c) and 11), determines the difference between the gray levels of portions 913, 923, 933, and 943 of the autofluorescence image corresponding to a first region and the gray levels of portions 913, 923, 933, and 943 of the autofluorescence image corresponding to a second region, and can determine information related to the opacity or cataract grade of the test eye based on the difference.
[0087] FIG. 10 is a diagram showing a change in gray level between portions 913, 923, 933, and 943 of an autofluorescence image corresponding to a second location and portions 913, 923, 933, and 943 of an autofluorescence image corresponding to a first location.
[0088] Referring to FIG. 10, it can be seen that the higher the opacity of the subject's eye based on the LOCS, the greater the brightness due to autofluorescence in the portions 913, 923, 933, and 943 of the autofluorescence image corresponding to the second region.
[0089] In one embodiment, the autofluorescence image evaluation device 200 may recognize the optic nerve or blood vessels in the autofluorescence image using a machine learning-based learning model, and analyze the gray levels of a portion of the autofluorescence image corresponding to a first portion that does not overlap with the optic nerve or blood vessel portion and a portion of the autofluorescence image corresponding to a second portion. In this case, the learning model may be a model that is learned using an image in which the optic nerve or blood vessels are labeled in the autofluorescence image.
[0090] In another embodiment, the autofluorescence image evaluation device 200 may analyze the gray levels of pixels that do not overlap with the optic nerve or vascular region in a portion of the autofluorescence image corresponding to the first region and a portion of the autofluorescence image corresponding to the second region.
[0091] In another embodiment, the gray levels of a plurality of portions corresponding to the second region in the autofluorescence image may be analyzed. For example, the degree of cataract may be quantitatively evaluated based on the difference in grayscale values in image portions corresponding to two figures corresponding to the second region of the analysis filter in the autofluorescence image. That is, the gray level difference between a portion corresponding to a figure located at the center of the filter unit of the analysis filter and a portion corresponding to a figure located at the outer edge of the filter unit in the autofluorescence image may be analyzed.
[0092] The present disclosure described above may be embodied as computer readable codes on a medium having a program recorded thereon. The computer readable medium includes any type of storage device in which data readable by a computer system is stored. Examples of the computer readable medium include a hard disk drive (HDD), a solid state disk (SSD), a silicon disk drive (SDD), a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like. The computer may also include a processor of each device.
[0093] On the other hand, the program may be one specially designed and constructed for the present disclosure, or it may be one known and usable by those of ordinary skill in the art of computer software. Examples of the program may include not only machine code, such as that produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter, etc.
[0094] In the specification of this disclosure (particularly the claims), the use of the term "said" and similar indicators may refer to either the singular or the plural. In addition, when a range is described in this disclosure, it includes inventions to which individual values within the range are applied (unless otherwise stated), and is equivalent to describing each individual value constituting the range in the detailed description of the invention.
[0095] Unless the steps constituting the method according to the present disclosure are clearly described in a certain order or to the contrary, the steps may be performed in any suitable order. The order of the steps is not necessarily intended to limit the present disclosure. The use of all examples or exemplary terms (e.g., etc.) in the present disclosure is merely for the purpose of describing the present disclosure in detail, and the scope of the present disclosure is not limited by the examples or exemplary terms unless otherwise limited by the claims. In addition, it is understood that a person skilled in the art can make various modifications, combinations and changes according to design conditions and factors within the scope of the claims or their equivalents.
[0096] Therefore, the concept of the present disclosure should not be limited to the above-described embodiments, and it can be said that not only the scope of the claims described below, but also all scopes equivalent to or equivalently modified from the scope of the claims belong to the scope of the concept of the present disclosure.
[0097] The present invention is the result of research carried out with the support of Korea University. Research support: Korea University Project number: K2107901 Project title: Development of holography-based optical technology to alleviate visual impairment caused by cataracts and corneal opacity [Explanation of symbols]
[0098] 100: Autofluorescence imaging device 100a: Autofluorescence imaging device body 150:Analysis Filter 160: Rotating lever 510: Outer periphery 520: Filter section
Claims
1. A light source that illuminates the subject's eye through a preset optical path; an image sensor that captures an image of the subject's eye, at least a portion of which emits autofluorescence when illuminated by the light source; a filter disposed between the image sensor and the subject's eye, The filter includes a plurality of regions having different light transmittances. Autofluorescence imaging device.
2. The image sensor includes: The light source is configured so that autofluorescence from the subject's eye generated by illumination of the light source passes through the filter and enters the subject's eye.
2. The autofluorescence imaging device according to claim 1.
3. The filter comprises: A first portion and a second portion having a plurality of figures formed thereon, the second portion having a lower light transmittance than the first portion.
2. The autofluorescence imaging device according to claim 1.
4. The second portion includes a plurality of figures arranged at a distance from each other, and the plurality of figures have a vertically symmetrical or horizontally symmetrical shape.
4. The autofluorescence imaging device according to claim 3.
5. The second portion includes a plurality of ring-shaped patterns and a plurality of circle-shaped patterns having a uniform light transmittance therein.
4. The autofluorescence imaging device according to claim 3.
6. the second portion includes a plurality of rectangular shapes having uniform light transmittance therethrough; 4. The autofluorescence imaging device according to claim 3.
7. At least two of the plurality of rectangular shapes have different areas.
7. The autofluorescence imaging device according to claim 6.
8. At least some of the plurality of rectangular shapes have a larger area near the periphery of the filter than near the center of the filter, 8. The autofluorescence imaging device according to claim 7.
9. At least two of the plurality of rectangular shapes have different aspect ratios.
7. The autofluorescence imaging device according to claim 6.
10. A processor; A memory electrically connected to the processor and storing at least one code executed by the processor; the memory stores code for causing the processor to analyze an autofluorescence image of the subject's eye to determine information related to opacity or cataract grade of the subject's eye; The autofluorescence image is an image generated based on an output of the image sensor in which autofluorescence of the test eye, generated by illumination from a light source, is incident on the test eye through a filter disposed between the image sensor and the test eye and including a plurality of portions having different light transmittances. Autofluorescence imaging evaluation device.
11. The memory further stores a code for causing the processor to determine information related to the opacity or cataract grade based on a result of comparing gray levels of a plurality of image portions corresponding to a plurality of portions having different light transmittances of the filter in the autofluorescence image. The autofluorescence image evaluation device according to claim 10.
12. the autofluorescence image includes a first image portion and a second image portion, which respectively correspond to a first portion of the filter and a second portion having a plurality of figures formed thereon and having a light transmittance lower than that of the first portion; The memory further stores code for causing the processor to determine information related to the opacity or cataract grade based on a result of comparing gray levels of the first image portion and the second image portion. The autofluorescence image evaluation device according to claim 11.
13. The memory further stores a code for causing the processor to recognize an optic nerve or a blood vessel in the autofluorescence image, and to determine information related to the opacity or cataract grade based on a result of comparing gray levels of the first image portion and the second image portion where the optic nerve or the blood vessel is not present, or to determine information related to the opacity or cataract grade based on a result of comparing gray levels of the first image portion and the second image portion where the optic nerve or the blood vessel is not present. The autofluorescence image evaluation device according to claim 12.
14. The memory further stores code for causing the processor to determine information related to the opacity or cataract grade based on a difference in gray levels between the first image portion and the second image portion. The autofluorescence image evaluation device according to claim 12.
15. A processor causes a light source to emit light so as to illuminate the subject's eye through a preset optical path; The processor controls an image sensor to capture an image of the subject's eye, at least a portion of which is illuminated by the light source due to autofluorescence; The step of photographing the subject's eye includes: generating an output signal based on autofluorescence of the subject's eye passing through a filter including a plurality of portions having different light transmittances and incident on the image sensor, A method of operation of an autofluorescence imaging device.
16. the processor determining a position of the filter; the processor ascertaining a capture mode; and outputting a message when the position of the filter and the image capture mode are inconsistent.
16. A method of operating an autofluorescence imaging device according to claim 15.
17. generating an autofluorescence fundus image based on the output signal of the image sensor; and adding image type information indicating an image captured based on the filter to the autofluorescence fundus image by the processor.
16. A method of operating an autofluorescence imaging device according to claim 15.
18. receiving at least a portion of an autofluorescence image of a subject's eye from the processor; and determining information related to the opacity or cataract grade of the subject's eye by analyzing the autofluorescence image by the processor; The autofluorescence image is an image generated based on an output of the image sensor in which autofluorescence of the test eye, generated by illumination from a light source, is incident on the test eye through a filter disposed between the image sensor and the test eye and including a plurality of portions having different light transmittances. A method for evaluating an autofluorescence image evaluation device.
19. The step of determining the information further comprises: determining information related to the opacity or cataract grade based on a result of comparing gray levels of a plurality of image portions corresponding to a plurality of portions having different light transmittances of the filter in the autofluorescence image; A method for evaluating the autofluorescence image evaluation device according to claim 18.
Citation Information
Patent Citations
System for ophthalmologic imaging
JP2008035944A
Fundus camera
JP2010274048A
Ophthalmography device
JP2014045785A
Ophthalmologic apparatus
JP2018000290A
Method and apparatus for detecting diseases associated with the eye
KR101643953B1
