Self-fluorescence image evaluation device

Abstract

To provide a device that captures a self-fluorescence image of a subject eye on the basis of a filter for evaluating presence or absence of abnormality in a crystal lens, and an operation method.SOLUTION: A self-fluorescence imaging device 100 according to an embodiment of the present disclosure includes: a light source that illuminates a subject eye through a preset optical path; an image sensor that captures the subject eye at least a part of which emits light by self-fluorescence due to illumination by the light source; and a filter 150 arranged between the image sensor and the subject eye. The filter may include a plurality of portions having different light transmission degrees.SELECTED DRAWING: Figure 1

Description

[Technical Field]

[0001] The present disclosure relates to an apparatus and operating method for capturing autofluorescence (AF) images of a subject's eye, and an apparatus and evaluation method for evaluating autofluorescence images, and more specifically, to AF image capturing and evaluation based on a filter that can quantitatively evaluate ophthalmic diseases or the progression of presbyopia. [Background technology]

[0002] The Lens Opacities Classification System (LOCS) is the standard for classifying conventional nuclear cataracts. The LOCS divides the lens into three parts: the cortex, nucleus, and posterior capsule. The cortex and posterior capsule are classified into five levels based on opacity, and the nucleus into six levels based on opacity and color. Medical professionals use a slit lamp microscope to directly examine the lens layers and use the LOCS to determine whether a patient has a nuclear cataract. Cataract removal surgery involves removing the opacified lens and inserting an artificial lens.

[0003] However, depending on the stage of cataract, cataract removal surgery may not be necessary, and currently, the stage of cataract is determined solely by direct observation by medical professionals, which can lead to discrepancies in the results of different medical professionals, potentially resulting in patients undergoing cataract removal surgery when surgery is not necessary. Therefore, a method is needed that can quantitatively determine the stage of cataract or presbyopia.

[0004] Fundus autofluorescence (FAF) imaging technology also exists. Unlike fluorescein angiography, FAF does not require the injection of fluorescent dye to image the retina, but instead generates images by utilizing the fluorescent properties of lipofuscin within the retinal pigment epithelium (RPE). Abnormal patterns of autofluorescence (AF) in FAF images act as markers of retinal disease, so conventional FAF was used to evaluate the presence or absence of retinal disease or abnormalities, but not the presence or absence of lens abnormalities.

[0005] Patent Document 1 describes a technology that determines an intensity histogram from a patient's FAF image and compares it with a control group to determine whether or not there is an abnormality. However, this is also a technology that identifies retinal diseases, and it is difficult to use it for quantitative evaluation of lens abnormalities, including the progression of presbyopia or cataracts. [Prior art documents] [Patent documents]

[0006] [Patent Document 1] Korean Patent Registration No. 10-1643953 Summary of the Invention [Problem to be solved by the invention]

[0007] One embodiment of the present disclosure provides an apparatus and method for capturing an autofluorescence image of a subject's eye based on a filter for evaluating the presence or absence of a lens abnormality. Another embodiment of the present disclosure provides an apparatus and method for analyzing and evaluating an autofluorescence image of a subject's eye captured based on a filter for evaluating a lens abnormality. Another embodiment of the present disclosure provides a filter that can be used in an apparatus for capturing an autofluorescence image of a subject's eye for evaluating a lens abnormality. [Means for solving the problem]

[0008] One embodiment of the present disclosure provides an apparatus for capturing autofluorescence of a subject's eye and a method of operating the same.

[0009] An embodiment of the present disclosure provides an apparatus and an evaluation method for quantitatively evaluating an autofluorescence image of an eye to be examined.

[0010] An autofluorescence photography device according to one embodiment of the present disclosure includes a light source that illuminates a test eye through a predetermined optical path, an image sensor that photographs the test eye, at least a portion of which is autofluorescent due to illumination from the light source, and a filter arranged between the image sensor and the test eye, the filter including multiple portions with different light transmittances.

[0011] An autofluorescence image evaluation device according to an embodiment of the present disclosure includes a processor and a memory electrically connected to the processor and storing at least one code executed by the processor. The memory stores code that causes the processor to analyze an autofluorescence image of a subject's eye and determine information related to the opacity or cataract grade of the subject's eye. The autofluorescence image may be an image generated based on the output of an image sensor in which autofluorescence from the subject's eye, generated by illumination from a light source, is incident after passing through a filter disposed between the image sensor and the subject's eye and including a plurality of regions with different light transmittances.

[0012] An operating method of an autofluorescence imaging device according to one embodiment of the present disclosure includes a step in which a processor causes a light source to emit light so as to illuminate the test eye through a predetermined optical path, and a step in which the processor controls an image sensor to capture an image of the test eye, at least a portion of which is illuminated with autofluorescence by the illumination from the light source, wherein the step of capturing an image of the test eye includes a step in which the image sensor generates an output signal based on the autofluorescence of the test eye that has passed through a filter including multiple regions with different light transmittances and entered the image sensor.

[0013] An evaluation method for an autofluorescence image evaluation device according to an embodiment of the present disclosure includes a step of receiving at least a portion of an autofluorescence image of a test eye from a processor, and a step of the processor analyzing the autofluorescence image to determine information related to the opacity or cataract grade of the test eye. The autofluorescence image may be an image generated based on the output of an image sensor in which autofluorescence from the test eye, generated by illumination from a light source, is incident after passing through a filter disposed between the image sensor and the test eye and including a plurality of regions with different light transmittances. [Effects of the Invention]

[0014] The autofluorescence imaging device and the operating method thereof according to the embodiment of the present disclosure can capture an autofluorescence image that allows quantitative determination of the presence or absence of a lens abnormality.

[0015] The autofluorescence image evaluation device and evaluation method according to the embodiment of the present disclosure can quantitatively evaluate the presence or absence of lens abnormalities, including the progression of presbyopia or cataract, based on the autofluorescence image.

[0016] The embodiments of the present disclosure can quantitatively evaluate the presence or absence of lens abnormalities in patients and prevent unnecessary cataract surgery, thereby reducing patient inconvenience and saving unnecessary surgical costs. [Brief explanation of the drawings]

[0017] [Figure 1] 1 is a diagram illustrating an environment in which an autofluorescence imaging device according to an embodiment of the present disclosure captures an image using a filter for evaluating the presence or absence of a lens abnormality. [Figure 2] 1 is a block diagram showing a schematic configuration of an autofluorescence imaging device according to an embodiment of the present disclosure. [Figure 3] 1 is a flowchart illustrating an operation method of an autofluorescence imaging device according to an embodiment of the present disclosure. [Figure 4] 1 is a flowchart illustrating an operation method of an autofluorescence imaging device according to an embodiment of the present disclosure. [Figure 5] 1 is a diagram illustrating an embodiment of a filter for assessing the presence or absence of a lens abnormality according to an embodiment of the present disclosure. [Figure 6] 1 is a diagram illustrating an embodiment of a filter for assessing the presence or absence of a lens abnormality according to an embodiment of the present disclosure. [Figure 7] 1 is a block diagram illustrating a schematic configuration of an autofluorescence image evaluation device according to an embodiment of the present disclosure. [Figure 8] 1 is a flowchart for explaining an evaluation method for an autofluorescence image evaluation device according to an embodiment of the present disclosure. [Figure 9] 1 is a diagram for explaining an evaluation method for an autofluorescence image evaluation device according to an embodiment of the present disclosure. [Figure 10] 1 is a diagram for explaining an evaluation method for an autofluorescence image evaluation device according to an embodiment of the present disclosure. MODE FOR CARRYING OUT THE INVENTION

[0018] Hereinafter, embodiments disclosed herein will be described in detail with reference to the accompanying drawings. Identical or similar components will be designated by the same reference numerals, regardless of the reference numerals, and redundant descriptions thereof will be omitted. The suffixes "module" and "section" used in the following description are used solely for the convenience of drafting the specification and do not have any distinguishing meanings or functions. Furthermore, when describing embodiments disclosed herein, if a detailed description of related publicly known technology is deemed to obscure the gist of the embodiments disclosed herein, such detailed description will be omitted. Furthermore, the accompanying drawings are intended to facilitate understanding of the embodiments disclosed herein, and are not intended to limit the technical concept of the present disclosure. The accompanying drawings should be understood to include all modifications, equivalents, and alternatives within the concept and technical scope of the present invention.

[0019] Terms including ordinal numbers such as "first," "second," etc. may be used to describe various components, but the components are not limited by these terms. These terms are used only to distinguish one component from another.

[0020] When a component is said to be "coupled" or "connected" to another component, it should be understood that the component may be directly coupled or connected to the other component, and that there may be other components in between. Conversely, when a component is said to be "directly coupled" or "directly connected" to another component, it should be understood that there are no other components in between.

[0021] The environment and configuration for driving an autofluorescence imaging device according to an embodiment of the present disclosure will be described with reference to FIGS.

[0022] The autofluorescence imaging device 100 according to an embodiment of the present disclosure may include a filter (hereinafter referred to as an "analysis filter") 150 for evaluating lens abnormalities inside a main body 100a including a camera, or may be configured to be disposed outside the main body 100a. In another embodiment, the analysis filter 150 may be embodied in the form of glasses, and an autofluorescence image may be captured with the subject wearing the analysis filter 150 in the form of glasses when capturing an image with the autofluorescence imaging device 100.

[0023] The autofluorescence imaging device 100 can be set to emit excitation light from a light source and guide the excitation light along a preset optical path to illuminate the patient's eye to be examined.

[0024] The autofluorescence imaging device 100 includes an image sensor 140 onto which autofluorescence (AF) emitted from the subject's eye in response to excitation light is incident, and an analysis filter may be disposed between the image sensor 140 and the subject's eye. The analysis filter may be configured to be disposed inside or outside the main body 100a. An embodiment in which the analysis filter is disposed outside includes a case in which the subject wears an analysis filter 150 in the form of glasses. That is, the autofluorescence generated from the subject's eye in response to excitation light passes through the analysis filter 150 and is incident on the image sensor 140.

[0025] Autofluorescence can originate from the lens as well as lipofuscin in the retinal pigment epithelium (RPE) of the examined eye.

[0026] That is, when an autofluorescence image is captured using an analysis filter according to an embodiment of the present invention for lenses with different degrees of opacity, as shown in Figure 9, contrary to the general expectation that retinal autofluorescence would be blocked by lens opacity, the inventors observed an increase in brightness of a portion of the image due to the lens autofluorescence, and as a result, the presence or absence of a lens abnormality can be quantitatively determined based on the change in gray level of the autofluorescence image corresponding to the graphic pattern of the analysis filter according to an embodiment of the present invention. This is determined to be a composite phenomenon resulting from a portion of the retinal autofluorescence being blocked by opacity, a portion of the retinal autofluorescence being incident on the image sensor 140 due to scattering, refraction, etc., and the scattering of the lens autofluorescence. Therefore, the progression of cataracts and presbyopia, which are related to lens opacity, can be quantitatively evaluated using an analysis filter according to an embodiment of the present invention.

[0027] The camera of the autofluorescence imaging device 100 may include an image sensor (CCD or CMOS) 140, and the field of view and focus are adjustable so that autofluorescence can be captured from the subject's eye.

[0028] The autofluorescence imaging device may include an optical system 130 including mirrors, lenses, etc., to guide light emitted from a light source to the subject's eye through a first filter set to pass only light of a specific wavelength.

[0029] The first filter can be selected to reduce wavelengths that do not correspond to a wavelength band (e.g., wavelengths at or near about 470 nm) that excites specific cells to generate autofluorescence. However, embodiments of the present invention are not limited to a specific band of excitation wavelengths, and other wavelength bands of excitation light directed to the subject's eye are possible using other configurations of the autofluorescence imaging device. If the light source is configured to generate only light in a specific band, the first filter may be omitted.

[0030] The autofluorescence generated from the subject's eye by the excitation light can pass through the lenses, mirrors, etc. of the optical system 130 and enter the camera's image sensor 140. In one embodiment, the autofluorescence imaging device 100 includes a second filter for removing light in an undesired band or light that is not autofluorescence from the autofluorescence.

[0031] The analysis filter 150 can allow autofluorescence generated from the subject's eye to pass through before it enters the image sensor 140, and may be configured to be disposed before or after the second filter.

[0032] When the analysis filter 150 is arranged outside the main body 100a, it may include a structure that can be attached to a rest on which the patient's forehead and chin are placed, or it may include a structure (e.g., a wheel to which the analysis filter 150 is attached and a wheel drive motor) that can be rotatably arranged in front of the camera so that the analysis filter 150 can be selectively used depending on the shooting mode.

[0033] The analysis filter 150 may include a plurality of sections with different light transmittances, which will be described in detail below with reference to FIGS.

[0034] The autofluorescence imaging device 100 can store the autofluorescence image generated based on the output of the image sensor 140 in the memory 120 or transmit it to a connected external device via a communication module. The autofluorescence imaging device 100 can include a processor 110 that performs post-processing of the wavelength and brightness of the light source or the generated autofluorescence image. In another embodiment, the autofluorescence imaging device 100 can be connected to an external control computing device, and the control computing device can set the autofluorescence imaging device 100 or perform post-processing of the captured autofluorescence image. In this specification, the processor 110 of the autofluorescence imaging device 100 can be understood as a concept including a computing device embodied separately from the main body 100a.

[0035] The controlling computing device may include, for example, a tablet computer, a PC, a laptop computer, a smartphone, and the like.

[0036] The communication module may include a configuration similar to part or all of the communication unit 210 of the autofluorescence image evaluation device 200 described below, and the main body 100a may be connected to the control computing device in various ways, such as by cable, LAN, Wi-Fi (registered trademark), or short-range wireless communication.

[0037] 2 and 3, a method of operation of the autofluorescence imaging device 100 according to one embodiment of the present disclosure will be described.

[0038] The autofluorescence photography device 100 controls the light source to emit light including a wavelength band capable of generating autofluorescence from the subject's eye (S110).

[0039] The light emitted from the light source may include a wavelength band (eg, wavelengths at or near about 470 nm) that excites specific cells to produce autofluorescence, or may include only that wavelength band.

[0040] Light emitted from the light source can be guided to illuminate the subject's eye by passing through an optical system 130, such as optical filters, mirrors, lenses, etc. The processor 110 can control the angles, positions, etc. of the components of the optical system 130.

[0041] Light emitted from the light source and guided to the subject's eye through the optical system 130 generates autofluorescence in the retinal cells or lens of the subject's eye, and the generated autofluorescence passes through the analysis filter 150 and enters the image sensor 140 (S120).

[0042] In one embodiment, the autofluorescence may pass through an optical system 130 such as mirrors, optical filters, lenses, etc. before or after passing through the analysis filter 150 .

[0043] The image sensor 140 outputs an electrical signal based on the incident autofluorescence, and the processor 110 generates an autofluorescence image based on the output of the image sensor 140 (S130).

[0044] In one embodiment, the autofluorescence imaging device 100 may include information indicating the type of image in the header information of the autofluorescence image to distinguish the autofluorescence image generated based on the analysis filter 150 according to an embodiment of the present invention from a conventional general autofluorescence image (S140). Alternatively, a user-defined message may be generated in accordance with Digital Imaging and Communications in Medicine (DICOM) in a Picture Archiving and Communication System (PACS) server device, which indicates that the autofluorescence imaging device 100 based on the analysis filter 150 according to an embodiment of the present invention operates as an SCU and transmits the image.

[0045] The autofluorescence imaging device 100 may store the autofluorescence image generated based on the analysis filter 150 according to one embodiment of the present invention in a control computing device or transmit it to a CIS (Clinical Information System), PACS, or HIS (Hospital Information System) server device.

[0046] In one embodiment, the autofluorescence imaging device 100 checks the position of the analysis filter 150 (S210) in order to capture an autofluorescence image based on the analysis filter 150 according to one embodiment of the present invention, checks the imaging mode of the autofluorescence imaging device 100 (S220), and then outputs a warning message or a confirmation message on a display, via sound, a warning light, etc. based on the comparison result (S230).

[0047] If the analysis filter 150 is positioned by rotating in a rotary manner using a wheel, the autofluorescence imaging device 100 can determine the position (including whether it is attached or detached) of the analysis filter 150 using a sensor that determines the position due to rotation, or if it is detachably connected to a mounting base, a sensor that determines whether it is attached or detached. Alternatively, the autofluorescence imaging device 100 can determine the position (including whether it is attached or detached) by recognizing the output of an RF chip attached to the analysis filter 150. If the analysis filter 150 is embodied in the form of glasses, it can determine whether the subject is wearing it using a human body detection sensor (such as infrared rays).

[0048] The autofluorescence imaging device 100 may be embodied to be operable in a mode for capturing autofluorescence using the analysis filter 150 according to an embodiment of the present invention as well as a mode for capturing conventional autofluorescence. In this case, a mechanical interface (e.g., the rotary lever 160 of FIG. 1) for selecting the imaging mode may be included, or a display on the main body 150a or an electrical interface on a control computing device may be included. Therefore, the autofluorescence imaging device 100 may check whether it is in a mode for capturing autofluorescence using the analysis filter 150 according to an embodiment of the present invention, and then output a warning message if the analysis filter 150 is in the imaging position despite being set to the mode for capturing conventional autofluorescence, or vice versa. Alternatively, if the analysis filter 150 is placed in the imaging position regardless of the imaging mode, a message notifying that the analysis filter 150 is activated may be output.

[0049] 5 and 6, an embodiment of an analysis filter 150 according to an embodiment of the present disclosure will be described.

[0050] The analysis filter 150 may include an outer peripheral portion 510 that can be attached to a rest on which a patient places their forehead and chin or that can be coupled to the main body 100a, and a filter portion 520 through which autofluorescence generated from the subject's eye passes. The filter portion 520 may include a plurality of portions 521, 522, and 523 with different light transmittances. The term "light transmittance" as used herein refers to a change in luminous intensity or other light characteristics due to scattering or refraction after light passes through.

[0051] For example, the filter unit 520 may include a transparent first portion 521 and second portions 522 and 523 having a lower light transmittance than the first portion 521 and having a plurality of patterns formed thereon.

[0052] The first portion 521 may be transparent or opaque and have a higher light transmittance than the second portions 522 and 523. The filter unit 520 may be made of glass or plastic, and the second portions 522 and 523 may be covered with films of different colors or materials, or the surface roughness of the second portions 522 and 523 may be varied. In the case of glass, the second portions 522 and 523 may be frosted glass formed by friction or corrosion. When the analysis filter 150 is made of glass, the second portions 522 and 523 may be etched using a glass etchant or laser processing, or sandblasted using air-pressured spraying of sand or emery. FIG. 11 is a photograph taken after the analysis filter 150, according to one embodiment of the present invention, is formed in the form shown in FIG. 6(c) using a laser processing method and placed on a printed material. As can be seen from FIG. 11, the light transmittance of the second portion is lower than that of the first portion.

[0053] In one embodiment, the second portion 522 of the analysis filter 150 may be embodied as a plurality of graphic patterns, such as a plurality of ring-shaped and a plurality of circle-shaped figures. In the case of a ring-shaped figure, the circular area inside the ring may be the first portion. As will be described in detail below, the autofluorescence image evaluation device 200 may evaluate the presence or absence of a lens abnormality based on the results of measuring the gray level in the portion of the autofluorescence image corresponding to the first portion 521 and / or second portions 522 and 523 of the analysis filter. In the case of a ring-shaped figure, the autofluorescence image may be analyzed by using the gray level inside the circular area inside the ring and the gray level of the ring portion as the first portion and the second portion, respectively. Therefore, in the case of a ring-shaped figure, the position for analyzing the gray level may be easily identified through graphic recognition.

[0054] In one embodiment, a plurality of graphic patterns having low light transmittance in the analysis filter 150 may be spaced apart from each other, and the plurality of graphic patterns may be arranged in a vertically symmetrical or horizontally symmetrical manner in the filter unit.

[0055] Various embodiments of the analysis filter 150 will be described with reference to Fig. 6. Fig. 6 shows an embodiment in which the outer periphery of the analysis filter 150 is omitted and only the filter portion is shown.

[0056] 6(a), the second portions 611 and 612 of the analysis filter 150 may be rectangular figures having uniform light transmittance inside and lower light transmittance than the other portions (first portions). Also, the area of ​​the figure of the second portion 612 farther from the center (located on the periphery, close to the outer periphery) may be larger than the figure of the second portion 611 close to the center of the filter portion.

[0057] In one embodiment, the horizontal ratio of the figure of the second portion 612 farther from the center may be larger. In this case, in the case of an autofluorescence imaging device that scans the subject's eye, the portion of the image corresponding to the second portion in the autofluorescence image may be displayed at the same size to accommodate the shape of the eyeball with a larger left-right ratio or barrel distortion due to the spherical shape or lens shape of the eyeball.

[0058] 6(b), the shape of the second portion 622 farther from the center may be a quadrangle having a different shape from the shape of the second portion 621 closer to the center. For example, the shape of the second portion 621 may be a square or rectangle, and the shape of the second portion 622 may be a parallelogram or trapezoid. In this case, it can be seen that the barrel distortion is more actively reflected.

[0059] 6(a) to 6(c), in one embodiment, the plurality of figures corresponding to the second portion of the filter unit may have different numbers of distributions of figures formed by horizontal and vertical lines crossing the center of the filter unit, for example, the number of distributions of figures formed by vertical lines may be fewer, that is, the distribution of figures formed by vertical lines may not include figures of the second portion in a portion 623 close to the periphery. This may be a figure pattern taking into consideration a case where the shape of the eyeball is an ellipsoidal shape with a larger ratio of left to right, or a case where more of the left and right portions of the subject's eye are visualized due to the eyelids, etc.

[0060] Referring to FIG. 6(c), a plurality of shapes corresponding to the second portion of the filter unit may be arranged in a form extending radially from a central point.

[0061] Referring to FIG. 6( c), the plurality of figures corresponding to the second portion of the filter unit may not be located in a portion near the center 631. When capturing an autofluorescence image using the analysis filter 150, a point to guide the patient's gaze is necessary. Therefore, by not locating the plurality of figures corresponding to the second portion in a portion near the center 631, the patient's gaze can be guided and an appropriate autofluorescence image can be captured. In one embodiment, the portion where the figures corresponding to the second portion are not located may be the center 631 or a position spaced a predetermined distance below or above the center 631. Due to the structure of the human eyeball, even if one focuses on the center, an autofluorescence fundus photograph may be captured differently. To reflect this, the figures corresponding to the second portion may not be located in a position spaced a predetermined distance below or above the center 631 of the pattern.

[0062] The configuration of an autofluorescence video evaluation device 200 according to an embodiment of the present disclosure will be described with reference to FIG.

[0063] The autofluorescence image evaluation device 200 can quantitatively evaluate the presence or absence of a lens abnormality in the subject's eye by analyzing an autofluorescence image generated by an autofluorescence imaging device based on an analysis filter.

[0064] The autofluorescence image evaluation device 200 may be implemented as a control computing device that controls an autofluorescence imaging device, a CIS / PACS / HIS server device, or a standalone computing device. The autofluorescence image evaluation device 200 may be a computing device that can load and analyze autofluorescence images, such as a tablet computer, laptop computer, PC, or smartphone.

[0065] The autofluorescence image evaluation device 200 may include a communication unit 210 that receives an autofluorescence image from a server device of a CIS / PACS / HIS, ​​an autofluorescence imaging device, or a control computing device of the autofluorescence imaging device.

[0066] The communication unit 210 may include a wireless communication unit or a wired communication unit.

[0067] The wireless communication unit may include at least one of a mobile communication module, a wireless Internet module, a short-range communication module, and a location information module.

[0068] The mobile communication module is based on LTE (Long Term Evolution), a communication method for mobile communication. It transmits and receives radio signals to and from at least one of a base station, an external terminal, and a server on a mobile communication network built by a mobile communications network such as Mobile Evolution.

[0069] The wireless internet module is a module for wireless internet connection and can be built into or external to the autofluorescence video evaluation device 200, and may use WLAN (Wireless LAN), Wi-Fi (Wireless-Fidelity), Wi-Fi (Wireless Fidelity) Direct, DLNA (Digital Living Network Alliance) (registered trademark), etc.

[0070] A short-range communication module is a module for transmitting and receiving data via short-range communication, and can use Bluetooth (registered trademark), RFID (Radio Frequency Identification), Infrared Data Association (IrDA), UWB (Ultra Wideband), ZigBee (registered trademark), NFC (Near Field Communication), etc.

[0071] The location information module is a module for acquiring the location of the autofluorescence video evaluation device 200, and may be a GPS (Global Positioning System) module based on satellite navigation technology, or a module for acquiring the location based on wireless communication with a wireless communication base station or wireless access point. The location information module may include a WiFi module.

[0072] In one embodiment, the autofluorescence image evaluation device 200 may include an interface unit 220 for user input, and the interface unit 220 may include an input unit or an output unit.

[0073] The input unit includes a user interface (UI) including a microphone and a touch interface 221 for receiving information input from a user. The UI may include a mouse, a keyboard, or a mechanical or electronic interface implemented in the device, and is not particularly limited in type or form as long as it can input user commands. The electronic interface includes a display that allows touch input.

[0074] The output unit is for transmitting the output of the autofluorescence video evaluation device 200 to the outside to convey information to the user, and may include a display 222, an LED, a speaker 223, etc. for displaying visual output, auditory output, or tactile output.

[0075] The autofluorescence image evaluation device 200 may include a peripheral device interface unit for data transmission with various types of connected external devices, and may include a memory card port, an external device I / O (Input / Output) port, etc.

[0076] The autofluorescence image evaluation device 200 includes a memory 240 that stores received autofluorescence images or images captured by a camera, and stores code for driving the processor 230 .

[0077] The autofluorescence image evaluation device 200 determines information related to the opacity or cataract grade of the subject's eye by analyzing the loaded autofluorescence image using the processor 230. The autofluorescence image analyzed by the autofluorescence image evaluation device 200 is an image generated based on the output of an image sensor in which autofluorescence from the subject's eye, generated by illumination from a light source, is incident on a filter disposed between the image sensor and the subject's eye and includes multiple regions with different light transmittances.

[0078] An evaluation method for the autofluorescence image evaluation device 200 according to an embodiment of the present disclosure will be described with reference to FIG.

[0079] The autofluorescence image evaluation device 200 receives an autofluorescence image, or at least a portion thereof, captured based on an analysis filter from an autofluorescence imaging device, a control computing device for the autofluorescence imaging device, or a CIS / PACS / HIS server device (S310). The autofluorescence image evaluation device 200 may also receive only a portion of the autofluorescence image corresponding to a first portion and / or a second portion of an analysis filter that includes multiple portions with different light transmittances for the autofluorescence image.

[0080] The autofluorescence image evaluation device 200 can analyze (S320) the gray levels of the autofluorescence image portion corresponding to the second portion and / or the first and second portions of the analysis filter, and determine (S330) information related to the opacity or cataract grade of the subject's eye.

[0081] When the autofluorescence image evaluation device 200 receives the entire autofluorescence image captured using the analysis filter, it can detect the autofluorescence image portion corresponding to the second portion of the analysis filter based on a machine learning-based learning model. In this case, the learning model may be trained using a graphic pattern of the second portion of the analysis filter or a learning model trained using an autofluorescence image in which a portion corresponding to the second portion of the analysis filter is labeled.

[0082] When the autofluorescence image evaluation device 200 receives all or a part of the autofluorescence image captured using the analysis filter, the autofluorescence image portion corresponding to the second portion of the analysis filter may be input into a machine learning-based learning model to determine the lens opacity, the cataract progression level, or the presbyopia progression level (S330). In this case, the learning model may be a learning model trained using an image in which the entire autofluorescence image or the portion corresponding to the second portion of the analysis filter is labeled with the lens opacity, the cataract progression level, or the presbyopia progression level.

[0083] Machine learning-based learning models can include neural networks with CNN or R-CNN (Region-based CNN), C-RNN (Convolutional Recursive Neural Network), Fast R-CNN, Faster R-CNN, R-FCN (Region-based Fully Convolutional Network), YOLO (You Only Look Once), or SSD (Single Shot Multibox Detector) structures.

[0084] The learning model may be implemented in hardware, software, or a combination of hardware and software, and if part or all of the learning model is implemented in software, one or more commands constituting the learning model may be stored in memory.

[0085] In one embodiment, the autofluorescence image evaluation device 200 can determine information related to the opacity or cataract grade of the subject's eye based on the result of comparing the gray levels of the autofluorescence image portions corresponding to the first and second portions of the analysis filter.

[0086] 9, color images 910, 920, 930, and 940 of test eyes with opacity grades 2, 3, 4, and 6 according to the LOCS standard are shown, along with images 911, 921, 931, and 941 captured using an analysis filter (FIGS. 6(c) and 11) according to an embodiment of the present invention. The autofluorescence image evaluation device 200 receives the images 911, 921, 931, and 941 captured using the analysis filter (FIGS. 6(c) and 11), determines the difference in gray level between portions 913, 923, 933, and 943 of the autofluorescence image corresponding to a first location and portions 913, 923, 933, and 943 of the autofluorescence image corresponding to a second location, and determines information related to the opacity or cataract grade of the test eye based on the difference.

[0087] FIG. 10 is a diagram showing the gray level change between portions 913, 923, 933, and 943 of the autofluorescence image corresponding to the second region and portions 913, 923, 933, and 943 of the autofluorescence image corresponding to the first region.

[0088] Referring to FIG. 10, it can be seen that the higher the opacity of the subject's eye based on the LOCS, the greater the brightness due to autofluorescence in the portions 913, 923, 933, and 943 of the autofluorescence image corresponding to the second region.

[0089] In one embodiment, the autofluorescence image evaluation device 200 may recognize the optic nerve or blood vessels in the autofluorescence image using a machine learning-based learning model, and analyze the gray levels of a portion of the autofluorescence image corresponding to a first region that does not overlap with the optic nerve or blood vessels and a portion of the autofluorescence image corresponding to a second region. In this case, the learning model may be a model trained using an autofluorescence image in which the optic nerve or blood vessels are labeled.

[0090] In another embodiment, the autofluorescence image evaluation device 200 can analyze the gray levels of pixels that do not overlap with the optic nerve or vascular region in the portion of the autofluorescence image corresponding to the first region and the portion of the autofluorescence image corresponding to the second region.

[0091] In another embodiment, the gray levels of a plurality of portions corresponding to the second region in the autofluorescence image may be analyzed. For example, the degree of cataract may be quantitatively evaluated based on the difference in grayscale values ​​between image portions in the autofluorescence image corresponding to two figures corresponding to the second region of the analysis filter. That is, the gray level difference between a region corresponding to a figure located at the center of the filter unit of the analysis filter and a region corresponding to a figure located at the outer edge of the filter unit in the autofluorescence image may be analyzed.

[0092] The present disclosure described above can be embodied as computer-readable code on a medium having a program recorded thereon. The computer-readable medium includes any type of storage device on which data readable by a computer system is stored. Examples of computer-readable media include a hard disk drive (HDD), a solid-state disk (SSD), a silicon disk drive (SDD), a read-only memory (ROM), a random access memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, and an optical data storage device. The computer may also include a processor of each device.

[0093] On the other hand, the program may be one specially designed and constructed for the present disclosure, or it may be one known and available to those of ordinary skill in the art of computer software. Examples of the program may include not only machine code, such as that produced by a compiler, but also high-level language code that can be executed by a computer using an interpreter, etc.

[0094] In the specification of this disclosure (particularly the claims), the use of the term "said" and similar indicators may refer to either the singular or the plural. Furthermore, when a range is stated in this disclosure, it includes inventions to which individual values ​​within that range are applied (unless otherwise specified), and is equivalent to describing each individual value constituting the range in the detailed description of the invention.

[0095] Unless explicitly stated or contrary to the order of steps constituting a method according to the present disclosure, the steps may be performed in any suitable order. The order of the steps described above is not necessarily intended to limit the present disclosure. The use of all examples or exemplary terms (e.g., ", etc.") in this disclosure is merely for the purpose of illustrating the present disclosure in detail, and the scope of the present disclosure is not limited by the examples or exemplary terms unless otherwise limited by the claims. Furthermore, it will be appreciated by those skilled in the art that various modifications, combinations, and variations can be made within the scope of the appended claims or their equivalents, depending on design conditions and factors.

[0096] Therefore, the concept of the present disclosure should not be limited to the above-described embodiments, and it can be said that not only the scope of the claims described below, but also all scopes equivalent to or modified equivalently from the scope of the claims belong to the scope of the concept of the present disclosure.

[0097] The present invention is the result of research carried out with the support of Korea University. Research support: Korea University Project number: K2107901 Project title: Development of holography-based optical technology to alleviate visual impairment caused by cataracts and corneal opacity [Explanation of symbols]

[0098] 100: Autofluorescence imaging device 100a: Autofluorescence imaging device main body 150: Analysis filter 160: Rotating lever 510: Outer periphery 520: Filter section

Claims

1. a light source that illuminates the subject's eye through a preset optical path; an image sensor that captures an image of the subject's eye, at least a portion of which is illuminated by the light source and emits autofluorescence; a filter disposed between the image sensor and the subject's eye, The filter includes a plurality of regions having different light transmittances. Autofluorescence imaging device.

2. The image sensor The filter is set so that autofluorescence of the subject's eye generated by illumination from the light source passes through the filter and enters the subject's eye. The autofluorescence imaging device according to claim 1.

3. The filter is a first portion and a second portion having a plurality of patterns formed thereon and having a light transmittance lower than that of the first portion; The autofluorescence imaging device according to claim 1.

4. The second portion includes a plurality of figures spaced apart from each other, and the plurality of figures have a vertically symmetrical or horizontally symmetrical form. The autofluorescence imaging device according to claim 3.

5. The second portion includes a plurality of ring-shaped shapes and a plurality of circle-shaped shapes having uniform light transmittance therein. The autofluorescence imaging device according to claim 3.

6. the second portion includes a plurality of rectangular shapes having uniform light transmittance therein; The autofluorescence imaging device according to claim 3.

7. At least two of the plurality of rectangular shapes have different areas. The autofluorescence imaging device according to claim 6.

8. At least some of the plurality of rectangular shapes have a larger area near the periphery of the filter than near the center of the filter, The autofluorescence imaging device according to claim 7.

9. At least two of the plurality of rectangular shapes have different aspect ratios. The autofluorescence imaging device according to claim 6.

10. a processor; a memory electrically connected to the processor and storing at least one code executed by the processor; the memory stores code for causing the processor to analyze an autofluorescence image of the subject's eye to determine information related to the opacity or cataract grade of the subject's eye; The autofluorescence image is an image generated based on an output of the image sensor, in which autofluorescence of the subject's eye, generated by illumination from a light source, is incident upon the image sensor after passing through a filter disposed between the image sensor and the subject's eye and including a plurality of portions having different light transmittances. Autofluorescence imaging evaluation device.

11. The memory further stores a code for causing the processor to determine information related to the opacity or cataract grade based on a result of comparing gray levels of a plurality of image portions corresponding to a plurality of portions in the autofluorescence image where the light transmittance of the filter is different from each other. The autofluorescence image evaluation device according to claim 10.

12. the autofluorescence image includes a first image portion and a second image portion corresponding to a first portion of the filter and a second portion having a plurality of patterns formed thereon and having a light transmittance lower than that of the first portion, respectively; The memory further stores code for causing the processor to determine information related to the opacity or cataract grade based on a result of comparing the gray levels of the first image portion and the second image portion. The autofluorescence image evaluation device according to claim 11.

13. The memory further stores a code for causing the processor to recognize an optic nerve or a blood vessel in the autofluorescence image and determine information related to the opacity or cataract grade based on a result of comparing gray levels of the first image portion and the second image portion where the optic nerve or the blood vessel is not present, or to determine information related to the opacity or cataract grade based on a result of comparing gray levels of the first image portion and the second image portion where the optic nerve or the blood vessel is not present. The autofluorescence image evaluation device according to claim 12.

14. The memory further stores code for causing the processor to determine information related to the opacity or cataract grade based on a difference in gray levels between the first image portion and the second image portion. The autofluorescence image evaluation device according to claim 12.

15. a processor causing the light source to emit light so as to illuminate the subject's eye through a preset optical path; a step in which the processor controls an image sensor to capture an image of the subject's eye, at least a portion of which is illuminated by the light source due to autofluorescence; The step of photographing the subject's eye includes: generating an output signal based on autofluorescence of the subject's eye that has passed through a filter including a plurality of regions having different light transmittances and is incident on the image sensor, Method of operation of an autofluorescence imaging device.

16. the processor determining the position of the filter; the processor checking a capture mode; the processor further includes outputting a message if the position of the filter and the imaging mode do not match.

16. A method for operating an autofluorescence imaging device according to claim 15.

17. generating an autofluorescence fundus image based on the output signal of the image sensor; and the processor further includes adding image type information indicating image capture based on the filter to the autofluorescence fundus image.

16. A method for operating an autofluorescence imaging device according to claim 15.

18. receiving at least a portion of an autofluorescence image of the subject's eye from the processor; and the processor analyzes the autofluorescence image to determine information related to the opacity or cataract grade of the subject's eye; The autofluorescence image is an image generated based on an output of the image sensor, in which autofluorescence of the subject's eye, generated by illumination from a light source, is incident upon the image sensor after passing through a filter disposed between the image sensor and the subject's eye and including a plurality of portions having different light transmittances. Evaluation method for an autofluorescence imaging evaluation device.

19. The step of determining the information comprises: determining information relating to the opacity or cataract grade based on a result of comparing gray levels of a plurality of image portions corresponding to a plurality of portions in the autofluorescence image where the light transmittance of the filter is different from each other; A method for evaluating the autofluorescence image evaluation device according to claim 18.

Images