Systems and methods for enhancing visualization of eye images

Abstract

A system and method for visually augmenting an original image of an eye includes a visualization module. A controller is configured to convert an output of the visualization module into a first cloud of pixels in a first color space and map the first cloud of pixels to a second cloud of pixels in a second color space. The method includes identifying at least one selected region in the second color space. The controller is configured to move the selected region from an original location to a modified location in the second color space. The second cloud of pixels is updated to obtain a modified second cloud of pixels, which is transformed into a third cloud of pixels in the first color space. An augmented image is formed based in part on the modified second cloud of pixels, and the augmented image provides selective visual augmentation of the selected region without affecting contrast of a remainder of the original image.

Description

Background Technology

[0001] This disclosure generally relates to a system and method for guiding surgeons in ophthalmic surgery. More specifically, this disclosure relates to enhancing the visualization of images of the eye. Various parts of the eye, such as the retina, macula, lens, and vitreous humor, can be affected by various diseases and conditions leading to vision loss, thus potentially requiring the attention of surgeons. Surgery is a challenging field requiring both knowledge and skill to perform. This challenge is amplified when the surgical procedure involves small, delicate structures that are difficult to see with the naked eye. The eye is an example of such a structure. To assist the surgical team, various imaging modalities can be used to acquire images of the eye in real time before and during ophthalmic surgery. However, in some clinical scenarios, the acquired images may not provide sufficient visibility or contrast. Furthermore, increasing the contrast of one part of the image may result in decreased contrast in other parts of the image. Summary of the Invention

[0002] This document discloses a system for visually enhancing an original image of the eye. The system includes a visualization module configured to acquire the original image, the visualization module including a photoelectric sensor. A controller communicates with the visualization module. The controller has a processor and a tangible, non-transitory memory storing instructions. Execution of these instructions causes the controller to convert the output of the visualization module into a first pixel cloud in a first color space.

[0003] The controller is configured to map a first pixel cloud to a second pixel cloud in a second color space. The method includes identifying at least one selected region (hereinafter referred to as "at least one") within the second pixel cloud. The selected region is the part of the eye from which visual enhancement is desired. The controller is configured to move the selected region from its original position to a modified position in the second color space. The second pixel cloud in the second color space is updated to obtain a modified second pixel cloud. The modified second pixel cloud is then transformed into a third pixel cloud in the first color space. An enhanced image is formed, in part, based on the modified second pixel cloud, providing selective visual enhancement of the at least one selected region.

[0004] The first color space can be the RGB color space. The second color space is the CIELAB color space (Lab), which has a first axis (L) representing the luminance factor, a second axis (a) representing the green-to-red continuum, and a third axis (b) representing the blue-to-yellow continuum. The controller can be adapted to continuously update the original image in real time via a data structure having multiple data libraries. Each of the multiple data libraries has a first list and a second list, the first list representing the original pixel colors in the first color space, and the second list representing the enhanced pixel colors in the first color space.

[0005] In one example, the photoelectric sensor includes multiple sensors, and the conversion of the output from the visualization module is performed in part based on the respective spectral sensitivities of the multiple sensors in the photoelectric sensor. The second color space may include multiple axes. The modified position may be a translation of the original position along at least one of the multiple axes in the second color space. The modified position may be a mirror image of the original position along a corresponding axis in the second color space. In another example, the original image exhibits a first color shift caused by an input illuminator, and the controller is adapted to apply a color adaptation transformation to convert the first color shift to a second color shift, such that the enhanced image exhibits the second color shift.

[0006] In some embodiments, the selected area corresponds to one or more blood vessels within the eye, and the original image of the eye was captured during gas-fluid exchange. The enhanced image of the eye is adapted to compensate for the contrast loss of these one or more blood vessels during gas-fluid exchange. In some embodiments, the selected area corresponds to a relatively pale region of the eye, and the enhanced image of the eye provides a virtual dye by digitally staining this region with a predetermined color. In some embodiments, the selected area corresponds to particles suspended in the eye that become relatively pale over time, and the enhanced image of the eye provides a virtual dye by digitally staining these particles with a predetermined color.

[0007] The eye can be exposed to the dye for selective absorption, with at least one selected area corresponding to the staining of the dye absorbed by a region of the eye. An enhanced image of the eye provides color enhancement of the selected area. The dye is partially absorbed at a first time and completely absorbed at a second time, which is longer than the first time. The original image of the eye can be enhanced at the first time to minimize dye contact with the eye. The original image can be obtained during the removal of the epiretinal membrane within the eye. The dye can be indocyanine green. The dye is completely absorbed at a second time and begins to fade at a third time, which is longer than the second time. The original image of the eye can be enhanced at the third time to prolong the useful duration of the dye. In some embodiments, the original image is obtained during cataract surgery, and the dye is absorbed by the capsule of the eye; the enhanced image provides enhanced visualization of that capsule.

[0008] A method is disclosed for visually enhancing an original image of an eye in a system having a visualization module and a controller having a processor and tangible non-transitory memory. The method includes converting the output of the visualization module into a first pixel cloud in a first color space via the controller, and mapping the first pixel cloud to a second pixel cloud in a second color space. The method includes identifying at least one selected region in the second pixel cloud via the controller, the selected region being the portion of the eye for which visual enhancement is desired. The selected region is moved from its original position to a modified position in the second color space via the controller. The method includes updating the second pixel cloud in the second color space via the controller to obtain a modified second pixel cloud, and transforming the modified second pixel cloud in the second color space into a third pixel cloud in the first color space. An enhanced image of the eye is formed, in part, based on the third pixel cloud, providing selective visual enhancement of the at least one selected region.

[0009] The above-described features and advantages, as well as other features and advantages, of this disclosure will become apparent from the following detailed description of the best mode for carrying out this disclosure, taken in conjunction with the accompanying drawings. Attached Figure Description

[0010] Figure 1 This is a schematic fragment perspective view of a system for enhancing the visualization of raw images for the eye, which includes a visualization module and a controller;

[0011] Figure 2 It is possible to be Figure 1 A flowchart of the method executed by the controller;

[0012] Figure 3 It shows that it can be generated by Figure 1 The visualization module uses a schematic diagram of the spectral sensitivity of multiple sensors in the example photoelectric sensor, where the wavelength is located on the horizontal axis;

[0013] Figure 4 It demonstrates that it can be generated by Figure 1 A schematic diagram illustrating an example of the second color space used by the system;

[0014] Figure 5 It is a demonstration Figure 4 A schematic diagram of the selected area in the second color space;

[0015] Figure 6 This is a schematic fragment of an example enhanced image of an eye, where the selected area is one or more blood vessels;

[0016] Figure 7 This is a schematic diagram showing the absorption of an example dye in a part of the eye, where the percentage of dye absorption is on the vertical axis and time is on the horizontal axis;

[0017] Figure 8 This is a schematic fragment of another example enhanced image of the eye, where the selected area is the epiretinal membrane; and

[0018] Figure 9 This is a schematic fragment of another example enhanced image of the eye, where the selected area is the capsule of the lens. Detailed Implementation

[0019] Referring to the accompanying drawings, where the same reference numerals refer to the same parts, Figure 1 A system 10 for providing enhanced visualization of eye 12 is illustrated schematically. System 10 can be implemented in visualization module 14. (Reference) Figure 1 System 10 includes a controller C having at least one processor P and at least one memory M (or a non-transitory tangible computer-readable storage medium) on which instructions for performing method 100, which is referred to below, can be recorded. Figure 2 The diagram illustrates and describes that memory M can store a set of controller-executable instructions, and processor P can execute the set of controller-executable instructions stored in memory M.

[0020] refer to Figure 1The visualization module 14 is adapted to generate an original image 16 of the eye 12. As described below, the system 10 (via the execution method 100) is able to visually enhance a selected region (referred to herein as selected region Z) without affecting or reducing the contrast of the rest of the original image 16. In other words, the system 10 is able to amplify the intensity of selected region Z in a manner that does not alter other colors present in the original image 16. The visual enhancement is adjustable to match the enhancement needs of various clinical scenarios. The system 10 improves the visualization of structural features and pathology in retinal, corneal, cataract, and other ophthalmic surgeries. The system 10 can be implemented as part of a diagnostic imaging system and / or an ophthalmic surgical system.

[0021] refer to Figure 1 The original image 16 is multidimensional and can be divided into multiple pixels 18. (Reference) Figure 1 The visualization module 14 may employ a photoelectric sensor 20, which is an electromagnetic sensor that captures light and converts it into an electrical signal. The electrical signal can be converted into digital data by the image processor 24 and / or the controller C. In one example, the photoelectric sensor 20 is a camera. Other examples of photoelectric sensors include, but are not limited to, complementary metal-oxide-semiconductor (CMOS) sensors or charge-coupled device (CCD) sensors.

[0022] The original image 16 can be a captured still image or a real-time image. As used herein, "real-time" generally means updating information at the same rate as the received data. More specifically, "real-time" means acquiring, processing, and transmitting image data from the photoelectric sensor at a sufficiently high data rate and sufficiently low latency, such that when the data is displayed, objects move smoothly without any jitter or delay perceptible to the user. This typically occurs when new images are acquired, processed, and transmitted at a rate of at least about 30 frames per second (fps) and displayed at about 60 fps, and when the latency of combined processing of the video signals does not exceed about one-thirtieth of a second.

[0023] refer to Figure 1 The visualization module 14 may include a stereomicroscope 22 that directs multiple optical views of the eye 12 onto a photoelectric sensor 20. The controller C may be configured to process the output from the visualization module 14 for eventual playback on a display 26. The output may be transmitted as a real-time high-resolution video signal for recording or presented for display and viewing. When the output from the visualization module 14 includes multiple views of the eye 12, the display 26 may be made three-dimensional, allowing depth of field to be presented to an ophthalmic surgeon. The display 26 may include, but is not limited to, high-definition televisions, ultra-high-definition televisions, smart glasses, projectors, one or more computer screens, laptop computers, tablet computers, and may include a touchscreen.

[0024] Examples of digital microscopy systems that utilize a monitor 26 for visualization during ophthalmic surgery include Alcon Laboratories. 3D visualization system (Alcon AG, Fribourg, Switzerland), module for digitally assisted vitreoretinal surgery (DAVS). The 3D visualization system includes a high dynamic range (HDR) camera, a 3D stereoscopic high-definition digital camera configured to provide magnified stereoscopic images of objects during microsurgery. The HDR camera serves as a supplement to the surgical microscope during surgery and is used to display either the original image or the recorded image.

[0025] Now for reference Figure 3 The diagram illustrates an example implementation of system 10 or a flowchart of method 100. It should be understood that method 100 does not need to be applied in the specific order listed herein, and some boxes may be omitted. The memory M may store a set of controller-executable instructions, and the processor P may execute the set of controller-executable instructions stored in the memory M.

[0026] according to Figure 2 In box 102, controller C is configured to convert the output of visualization module 14 (e.g., photoelectric sensor) into a form such as Figure 1 The first pixel cloud 30 is shown in the first color space 32. The first color space 32 can be the RGB color space, which uses combinations of red (R), green (G), and blue (B) to produce a variety of colors. Some RGB color spaces used in digital cameras include standard RGB (sRGB) and Adobe RGB.

[0027] The output can be converted based on the spectral intensity and properties of multiple sensors 40 in the photoelectric sensor 20. Figure 1 The photoelectric sensor 20 includes multiple sensors 40, which are sensitive to different parts of the spectrum; for example, one sensor is particularly sensitive to blue, another to green, and yet another to red. (Reference) Figure 3 The diagram shows a set of trajectories 200, where spectral intensity I is located on the vertical axis and wavelength W is located on the horizontal axis. Trajectories 208, 210, and 212 represent the spectral sensitivity curves of multiple sensors 40 for red, green, and blue light, respectively. Figure 3 Trajectories 202, 204, and 206 in the diagram represent the standard RGB spectral sensitivity distributions used to convert the output from a general-purpose camera into red, green, and blue, respectively. Because the color conversion is based on the corresponding spectral properties of multiple sensors 40 (represented by trajectories 208, 210, and 212), the color conversion is more manageable and stable.

[0028] according to Figure 2In box 104, controller C is configured to map or convert the first pixel cloud 30 in the first color space 32 to or into the second pixel cloud 34 in the second color space 36 (see box 104). Figure 1 The first pixel cloud 30 is rearranged into the second color space 36 (as the second pixel cloud 34) according to the individual colors (i.e., 3D coordinates) in the first color space 32. In one example, the second color space 36 is the CIELAB color space, which is referred to herein as Lab color space 300 and... Figure 4 As shown in the diagram. In other words, the second pixel cloud 34 is a rearrangement of these corresponding pixels in the original image 16 based on the L, a, and b values ​​of the corresponding pixel 50. The change in color perception of the original image 16 is performed quantitatively in the second color space 36.

[0029] refer to Figure 4 The Lab color space 300 has a first axis 302 (L), which represents the luminance factor, located between a first end 304 (white) and a second end 306 (black). The Lab color space 300 has a second axis 310 (a), which represents a green-to-red continuum, where green is in the negative direction (at end 314) and red is in the positive direction (at end 312). The Lab color space 300 has a third axis 320 (b), which represents a blue-to-yellow continuum, where blue is in the negative direction (at end 324) and yellow is in the positive direction (at end 326). The second color space 36 can also be the CIE XYZ color space created by the International Commission on Illumination (CIE) in 1931.

[0030] according to Figure 2 Box 106 and reference Figure 1 The controller C is configured to select or identify at least one selected region Z (hereinafter referred to as "at least one") in the second color space 36. The selected region Z is a set of pixels or a subset of pixels chosen based on its position or coordinates (L value, a value, b value) in the second color space 36 (e.g., Lab color space 300) and aimed at achieving enhancement. This selection can be based on individual L values, a values, b values, or combinations of these values. For example, if the region of interest in the eye E has been exposed to green dye, the selected region Z will be a subset of selected pixels, i.e., bright green pixels (e.g., using a standard such as L greater than 10 and a in the range of negative infinity to 35). For example, the a value here can be increased according to: [(a-a0)*gain factor+a0], where a0 is the initial a value of the selected region Z (e.g., 35 as listed above). If the region of interest in the eye E has been exposed to blue dye, the selected region Z will be a subset of blue pixels. For example, the b value here can be increased by a factor (gain).

[0031] Once selected, the position of the selected area Z in the second color space 36 (e.g., Lab color space 300) is changed to either enhance the color of the selected area Z (by moving it to a darker hue in the second color space 36) or increase its contrast (by moving it to a contrasting hue in the second color space 36). Now refer to Figure 5 In the two-dimensional view, the selected area Z is shown at its original position 330 in the Lab color space 300. As described above, the Lab color space 300 has a second axis 310(a) and a third axis 320(b), the second axis representing a green-to-red continuum and the third axis representing a blue-to-yellow continuum. Figure 4 and Figure 5 As indicated by arrows A1 and A2, the selected area Z can be moved or translated along the second axis 310(a) and / or the third axis 320(b) to the modified position L1 or modified position L2 to enhance the color of the selected area Z. Arrows A1 and A2 do not need to be parallel to the second axis 310(a) and the third axis 320(b). Alternatively, the modified position L2 can be obtained by rotating the original position 330 along one of the second axis 310(a) and the third axis 320(b). The modified position L2 can be a mirror image of the original position 330 relative to one of the corresponding axes in the second color space 36.

[0032] Box 106 further includes updating the L, a, and b values ​​of a selected subset of pixels in the selected region Z with the modified positions to obtain the modified second pixel cloud 37 in the second color space 36 (see...). Figure 1 The system can update any one of the L, a, or b values ​​of the selected region Z. System 10 can use parametric formulas to change the position of the selected region Z.

[0033] according to Figure 2 In box 108, controller C is configured to convert the modified second pixel cloud 37 in the second color space 36 into a third pixel cloud 38 in the first color space 32. The third pixel cloud 38 is used to form an enhanced image of the eye 12. (See below for reference.) Figures 6 to 9 Some clinical scenarios for applying system 10 are described. While system 10 follows the general implementation described above in each case, each example can have specific representations to match the enhanced needs of the corresponding clinical scenario.

[0034] Figure 6A schematic illustration of an enhanced image 400 of eye E is shown. During an external retinal surgery, air can be injected into eye E to remove intraocular fluid from the posterior segment of eye 12. During this gas-fluid exchange, intraocular pressure is maintained for various reasons, such as temporarily holding the retina in place. During this gas-fluid exchange, blood vessels 402 experience a loss of contrast. By selecting a subset of pixels in region Z1 that matches the red hue of one or more blood vessels 402 in eye E, the red of blood vessels 402 is enhanced, compensating for the loss of contrast during the gas-fluid exchange.

[0035] In some embodiments, reference Figure 6 Selected area Z2 ( Figure 6 The shaded area (Z2) corresponds to the naturally relatively pale region 404 of the eye E, including but not limited to areas of white, ivory, and cream tones. In other embodiments, the selected region Z2 corresponds to particles 406 suspended in the eye E that become pale or turn white over time. Method 100 can be used to digitally color the selected region Z2 with a predetermined color, thereby providing a “virtual” dye in the enhanced image 400. Thus, the enhanced image 400 provides selective enhancement of the selected region Z2 without affecting the contrast of the rest of the original image 16 (see [link to image 16]). Figure 1 ).

[0036] Figure 1 System 10 can be used to provide target color enhancement in real time via data structure 42 having multiple data repositories 44. (Reference) Figure 1 Each data store 44 has a first list 46 and a second list 48, the first list representing the original pixel colors in the first color space 32, and the second list representing the enhanced pixel colors in the first color space 32. Each data store 44 represents a corresponding pixel 50 among a plurality of pixels 18. The first list 46 may be a set of pixel colors (original RGB triples) sampled from an RGB 3D cube at uniformly spaced grid points. The first list 46 can be used to index the original pixel colors. The second list 48 is a set of updated or enhanced pixel RGB colors (modified RGB triples), which is filled after enhancement according to box 106. The color enhancement of each pixel among the plurality of pixels 18 can be pre-computed and encoded in the data structure 42. In other words, the enhanced pixel colors can be stored separately in the second list 48 of each data store 44. The controller C can be adapted to use the data structure 42 to continuously update the original image 16 in real time.

[0037] Figure 1System 10 can be used to provide dye-marked enhancement during ophthalmic surgery. Various dyes—such as indocyanine green, brilliant blue, or trypan blue—are used during ophthalmic surgery to enhance visualization. For each dye being used, controller C is configured to identify the position of that particular dye color in a second color space 36 and amplify its intensity in a manner that does not alter other colors present in the surgical scene.

[0038] in addition, Figure 1 System 10 can be used to minimize the use of dyes and reduce staining waiting time. Some dyes may cause unpleasant side effects or be toxic to certain cells. Therefore, surgeons may not want the dye to remain in the eye longer than is required to achieve the desired effect on color and membrane hardening. Figure 7 An example trajectory 450 of the dye concentration (in the region of eye 12) of an example dye is shown. The vertical axis Y shows the percentage of dye saturation, and the horizontal axis shows the contact time t. The dye is partially absorbed at the first time T1, completely absorbed at the second time T2 (saturation time), and begins to fade or lose concentration at the third time T3. To minimize the contact of the dye with eye 12, the original image 16 is enhanced at the first time T1 (via the execution of method 100) without waiting for a deeper color to be applied at the second time T2.

[0039] Furthermore, system 10 can be used to extend the useful duration of each dye injection / staining by enhancing the fading dye. For example, the original image 16 can be enhanced at a third time T3 to reflect the deeper staining that would have occurred at the second time T2.

[0040] refer to Figure 8 An enhanced image 500 of eye E is shown. Here, the selected area Z3 ( Figure 8 The spotted area corresponds to the epiretinal membrane 502 of the eye E. The epiretinal membrane 502 involves the growth of a membrane similar to scar tissue. Because its growth can interfere with central vision, the epiretinal membrane 502 is typically removed during external retinal surgery. As part of the peeling procedure, the ophthalmic surgeon uses a high-magnification instrument 504 (e.g., forceps) to grasp and gently peel away the epiretinal membrane 502. As the epiretinal membrane 502 is peeled away, the blood vessels 506 become visible on the underlying retinal surface 508. The epiretinal membrane 502 is stained with a dye (e.g., indocyanine green) to aid visualization during this delicate procedure. Selected area Z3 (according to...) Figure 2 The box 106 is selected to correspond to the staining of the dye and selectively enhances the visualization of the preretinal membrane 502 without changing the color of other features.

[0041] System 10 can be used for cataract surgery, in which the natural lens of the eye 12 is removed and replaced with an artificial lens. Figure 9 This is a schematic illustration of enhanced image 600, showing the capsule 602 of the eye E, surgical instruments 604, and blood vessels 606. During cataract surgery, a dye can be applied for selective absorption by the capsule 602. Here, a selected area Z4 is chosen to match the dye staining absorbed by the capsule 602. Targeted color enhancement of the capsule 602 can be implemented in real time using data structure 42. System 10 can also be used to strengthen or enhance the "red reflection effect." In cataract surgery, surgeons sometimes rely on the "red reflection effect," in which the patient's pupil is backlit to provide greater contrast for visualizing the eye's capsule and lens. In other words, light passing through the pupil is reflected from the retina to the viewing aperture, producing a red glow. Here, a selected area Z is chosen to correspond to the red glow in order to selectively enhance that selected area.

[0042] The exact parameters used to implement the enhancement may depend on the white balance settings in the original image, due to factors such as the patient's ocular pathology and the surgeon's use of different illuminators with different color temperatures and color settings. In some embodiments, after transformation to Lab space 300, the pixel selection criteria are based on L, a, b values, and the (a,b) component and / or L are modified, i.e., only the (a,b) component is modified, or only the L component is modified, or both. For red reflectance enhancement, a new luminance value (new L) can be obtained using a combination of R, G, and B according to the following formula: R * weight + (G * 0.8374 + B * 0.1626) * (1 - weight), where the weight can range from 0.2989 (no change) to 1.0 (maximum red reflectance enhancement).

[0043] For vascular enhancement, each pixel can be updated by enhancing red and attenuating green based on its redness (e.g., if a > 0, then a = a * gain 1; if a < 0, then a = a * gain 2, where gain 1 can be 2.0 and gain 2 can be 0.5). To reduce glare, the pixel intensity of L can be reduced by a factor using the following formula: new L = L * factor, and factor = 1 – a0 * exp((L - 100) / a1). Example values ​​could be: a0 = 0.25 and a1 = 25, where higher L values ​​result in greater reduction. For white dye enhancement, a measurement called color distance can be defined, which describes how the pixel's chromaticity differs from a reference (white) point, as follows:

[0044]

[0045] Here, x and y are normalized X and Y, and the intensity of each pixel varies based on its color distance to the white point, using the example formula as follows: Factor = (1 + a0 * exp(-(color_distance / a1)) 2 ) / (1+a0). Here, for example, a0=9 and a1=0.1, where the intensity reduction becomes more pronounced as the color distance between the pixel and the white point increases. The color distance can also be calculated based on other reference chromaticity coordinates. Other formulas describing the change in intensity reduction with respect to color distance can be used.

[0046] For a virtual dye, the color of each pixel can be determined as:

[0047]

[0048] Here, x and y are the normalized X and Y values; and x_white and y_white are the predetermined white dye colors (white). When the virtual dye is blue (x_blue, y_blue), the new coordinates can be obtained using the following example formulas based on its distance to the reference color: new x = factor * x_blue + (1 - factor) * x; and new y = factor * y_blue + (1 - factor) * y. Here, factor = a0 * exp(-(color_distance / a1)). 2 ), where a0 = 0.25 and a1 = 0.05.

[0049] Figure 1 The original image 16 may exhibit a first color shift, which depends on the illumination conditions of the eye 12 at the time of imaging; that is, the first color shift is caused by the input illuminator (e.g., D50). In the art, the characteristics of various illuminators are spectrally defined. For example, the illuminator series D represents natural daylight, with adjacent numbers indicating the correlated color temperature (CCT) of the light source; for example, the CCT of illuminator D50 is 5000K, and the CCT of illuminator D65 is 6500K. The illuminator series F represents various types of fluorescent illumination; for example, illuminator F2 represents cool white fluorescence, while illuminator F11 represents narrowband fluorescence. Optionally, the controller C can be adapted to employ a color adaptation transformation (CAT) to change the first color shift to a second color shift caused by the output illuminator (e.g., D65) for image enhancement. Any color adaptation transformation (CAT) matrix available to those skilled in the art can be used to perform transformations between various illuminators, including but not limited to the Bradford transform, Bartleson transform, and Sharp transform.

[0050] like Figure 1As shown, various components of system 10 can be physically linked via network 52 or configured to communicate via this network. Network 52 can be a bidirectional bus implemented in various ways, such as a serial communication bus in the form of a local area network (LAN). The LAN can include, but is not limited to, a control area network (CAN), a control area network with flexible data rates (CAN-FD), Ethernet, Bluetooth, Wi-Fi, and other forms of data. Network 52 can be a wireless local area network (LAN) that uses a wireless distribution method to link multiple devices, a wireless metropolitan area network (MAN) that connects several wireless LANs, or a wireless wide area network (WAN) that covers a large area such as adjacent towns and cities.

[0051] Figure 1 The controller C may be an integral part of the visualization module 14 or a separate module operatively connected to the visualization module. The controller C includes a computer-readable medium (also called a processor-readable medium) that includes a non-transitory (e.g., tangible) medium involved in providing data (e.g., instructions) that can be read by a computer (e.g., by the computer's processor). Such a medium can take many forms, including, but not limited to, non-volatile and volatile media. Non-volatile media may include, for example, optical discs or magnetic disks and other persistent storage. Volatile media may include, for example, dynamic random access memory (DRAM), which may constitute main memory. Such instructions can be transmitted via one or more transmission media, including coaxial cables, copper wires, and optical fibers, including lines containing a system bus coupled to the computer's processor. Some forms of computer-readable media include, for example, floppy disks, floppy disks, hard disks, magnetic tapes, other magnetic media, CD-ROMs, DVDs, other optical media, punched cards, paper tapes, other physical media with perforated patterns, RAM, PROMs, EPROMs, FLASH-EEPROMs, other memory chips or cartridges, or other media that can be read by a computer.

[0052] The lookup tables, databases, data repositories, or other data storage described herein can include various mechanisms for storing, accessing, and retrieving various types of data, including hierarchical databases, a set of files in a file system, application databases in proprietary formats, relational database management systems (RDBMS), etc. Each such data storage device can be included within a computing device employing one of the aforementioned computer operating systems and can be accessed via a network in one or more of various ways. File systems can be accessed from the computer operating system and can include files stored in various formats. RDBMS can employ Structured Query Language (SQL) and languages ​​for creating, storing, editing, and executing stored procedures, such as the PL / SQL language mentioned above.

[0053] The detailed descriptions and accompanying drawings are supportive and descriptive of this disclosure, but the scope of this disclosure is defined only by the claims. While some best modes and other embodiments for implementing the claimed disclosure have been described in detail, various alternative designs and embodiments exist to practice the disclosure as defined in the appended claims. Furthermore, the features of the embodiments shown in the drawings or the various embodiments mentioned in this specification are not necessarily to be construed as embodiments independent of each other. Rather, each feature described in one of these examples of embodiments may be combined with one or more other desired features from other embodiments to produce other embodiments not described in words or with reference to the drawings. Therefore, such other embodiments fall within the scope of the appended claims.

Claims

1. A system for enhancing the visualization of an original image of the eye, the system comprising: A visualization module, wherein the visualization module has a photoelectric sensor; A controller that communicates with the visualization module and has a processor and a tangible, non-transitory memory on which instructions are recorded; The execution of the instruction causes the controller to: The output of the visualization module is converted into a first pixel cloud in a first color space; Map the first pixel cloud onto the second pixel cloud in the second color space; Identify at least one selected region in the second pixel cloud, the at least one selected region being the portion of the eye from which visual enhancement is desired; Move the at least one selected area from its original position to a modified position in the second color space, the modified position being a mirror image of the original position along a corresponding axis in the second color space; Update the second pixel cloud in the second color space to obtain the modified second pixel cloud; Transform the modified second pixel cloud in the second color space into a third pixel cloud in the first color space; and An enhanced image of the eye is formed in part based on the modified second pixel cloud, the enhanced image providing selective visual enhancement of the at least one selected region.

2. The system as claimed in claim 1, wherein: The first color space is the RGB color space; and The second color space is the CIELAB color space (Lab), which has a first axis (L) representing the brightness factor, a second axis (a) representing the green to red continuum, and a third axis (b) representing the blue to yellow continuum.

3. The system as claimed in claim 1, wherein: The controller is adapted to continuously update the original image in real time via a data structure having multiple data repositories; and Each of the plurality of data repositories has a first list and a second list, wherein the first list represents the original pixel colors in the first color space and the second list represents the enhanced pixel colors in the first color space.

4. The system as claimed in claim 1, wherein: The photoelectric sensor includes multiple sensors; and The conversion of the output from the visualization module is based in part on the corresponding spectral sensitivities of the plurality of sensors in the photoelectric sensor.

5. The system as claimed in claim 1, wherein: The original image exhibits a first color cast caused by the input illuminator; and The controller is adapted to apply a color adaptation transformation to convert the first color cast into a second color cast, such that the enhanced image exhibits the second color cast.

6. The system of claim 1, wherein: The controller is adapted to select the at least one selected area as corresponding to one or more blood vessels within the eye, the original image of the eye being captured during gas-fluid exchange; and The controller is adapted to enhance the original image to compensate for the contrast loss of the one or more blood vessels during the gas-liquid exchange.

7. The system of claim 1, wherein: The at least one selected area corresponds to a relatively pale region of the eye, and the enhanced image of the eye provides a virtual dye by digitally coloring the region with a predetermined color.

8. The system of claim 1, wherein: The at least one selected area corresponds to particles suspended in the eye that become relatively pale over time, and the enhanced image of the eye provides a virtual dye by digitally staining the particles with a predetermined color.

9. The system of claim 1, wherein: The controller is adapted to select the at least one selected area as corresponding to staining of a dye absorbed by a region of the eye via selective absorption; and The enhanced image of the eye provides color enhancement for the at least one selected area.

10. The system of claim 9, wherein, The controller is adapted to enhance the original image of the eye at the first moment when the dye is only partially absorbed.

11. The system of claim 10, wherein, The original image was obtained during the removal of the epiretinal membrane within the eye.

12. The system of claim 11, wherein, The dye is indocyanine green.

13. The system of claim 9, wherein: The controller is adapted to enhance the original image of the eye at a third time when the dye begins to fade, the dye being fully absorbed at a second time less than the third time.

14. The system of claim 9, wherein: The dye is absorbed by the capsule of the eye, and the enhanced image provides enhanced visualization of the capsule.

15. A method for visually enhancing an original image of the eye in a system, the system having a visualization module and a controller, the controller having a processor and tangible non-transitory memory, the method comprising: The controller converts the output of the visualization module into a first pixel cloud in a first color space. The controller maps the first pixel cloud to a second pixel cloud in the second color space. The controller identifies at least one selected region in the second pixel cloud, the at least one selected region being the portion of the eye from which visual enhancement is desired; The controller moves at least one selected area from its original position to a modified position in the second color space, the modified position being a mirror image of the original position along a corresponding axis in the second color space; The second pixel cloud in the second color space is updated via the controller to obtain a modified second pixel cloud; The controller transforms the modified second pixel cloud in the second color space into a third pixel cloud in the first color space. as well as An enhanced image of the eye is formed in part based on the third pixel cloud, the enhanced image providing selective visual enhancement of the at least one selected area.

16. The method of claim 15, further comprising: Select the RGB color space as the first color space; as well as The second color space is selected as the CIELAB color space (Lab), which has a first axis (L) representing the brightness factor, a second axis (a) representing the green to red continuum, and a third axis (b) representing the blue to yellow continuum.

17. The method of claim 15, further comprising: The at least one selected area is selected for staining corresponding to a dye absorbed by a region of the eye, wherein the dye is only partially absorbed at the first moment; as well as The original image of the eye is enhanced at the first moment.

Images