Systems and methods for utilizing one or more images of an eye in a medical procedure
The system uses image sensors and graphic overlays to enhance precision in ophthalmic surgery by guiding the alignment of the suction ring and incision sites, addressing the challenges of precise positioning in ophthalmic surgery.
Patent Information
- Application Number
- JP2024129877
- Authority / Receiving Office
- JP · JP
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2019-03-27
- Filing Date
- 2024-08-06
- Publication Date
- 2026-01-20
- Estimated Expiration
- 2040-03-10
AI Technical Summary
Ophthalmic surgery is challenging due to the sensitivity of the eye and the need for precise positioning of surgical instruments, particularly the suction ring, which affects the success of procedures like refractive surgery.
A system utilizing image sensors to determine the position of the iris and suction ring, providing graphic overlays to guide precise alignment and incision sites, integrated with a display for real-time guidance during surgical procedures.
Enhances the precision of surgical procedures by ensuring accurate positioning of the suction ring and incision sites, improving the effectiveness and safety of ophthalmic surgeries.
Smart Images

Figure 0007802876000001 
Figure 0007802876000002 
Figure 0007802876000003
Abstract
Description
[Technical Field]
[0001] FIELD OF THE DISCLOSURE The present disclosure relates to ophthalmic surgery and surgical equipment, and more particularly to systems and methods associated with utilizing one or more images of an eye in a medical procedure. [Background technology]
[0002] Eye surgery protects and improves the vision of tens of thousands of patients each year. However, due to the sensitivity of vision to even slight changes in the eye and the delicate and delicate characteristics of many ocular structures, eye surgery is difficult to perform, and even reducing minor or rare surgical errors or improving surgical skill precision can make a noticeable difference in a patient's vision after surgery.
[0003] Ophthalmic surgery is surgery performed on the eye or any part of the eye. Eye surgery is typically performed to repair retinal defects, repair eye muscles, remove cataracts or cancer, or maintain or improve vision. For example, refractive eye surgery is a type of eye surgery used to improve the refractive status of the eye with the goal of reducing or eliminating dependence on glasses or contact lenses. Refractive surgery procedures may include surgical remodeling of the cornea and / or cataract surgery, both of which may be performed with one or more lasers.
[0004] In various ophthalmic surgical procedures, lasers can make incisions using photodisruption. When performing eye surgery using a laser, the surgical procedure typically includes docking, imaging, analysis, and laser treatment. During docking, the patient's eye is docked with a suction cone to apply pressure to flatten the patient's cornea (known as applanation) and hold it in place for laser treatment. Docking is a sensitive process, and proper positioning of the suction ring in the Z direction as well as the X and Y directions is critical to the success of the eye surgery. Summary of the Invention [Means for solving the problem]
[0005] The present disclosure provides a system capable of acquiring an image of at least an eye of a person via at least one image sensor. In one example, the at least one image sensor may include at least one camera. In a second example, the at least one image sensor may include multiple image sensors. In another example, the at least one image of the eye may include multiple images of the eye. The system may further determine a position of an iris of the eye from at least the image of the eye, and may further determine a position of a suction ring from at least the image of the eye. For example, the system may determine a position of a suction ring from at least the image of the eye before docking the suction ring with the eye. The suction ring may be docked with the eye for a medical procedure. The system may further display at least the image of the eye via a display. For example, the display may be integrated with a microscope. The system may include a display integrated with the microscope. The system may further display a first graphic overlay on at least the image of the eye via the display indicating a position of the iris of the eye, and may further display a second graphic overlay on at least the image of the eye via the display indicating a position of the suction ring. For example, the second graphic overlay can guide the physician or surgeon in docking the suction ring with the eye. The system can further determine a plurality of iris structures from at least the image of the eye. In one example, the plurality of iris structures can be one or more bases for which the eye points in one or more directions. In another example, the plurality of iris structures can be one or more bases for which the eye has one or more measurements. The system can further determine an orientation of the eye based on at least the plurality of iris structures from at least the image of the eye, and can further display information indicative of the orientation of the eye via the display. For example, the information indicative of the orientation of the eye can include a graphic overlay depicting a reticle associated with the orientation of the eye.
[0006] The system may further display, via the display, a graphic overlay representing a reticle associated with the orientation of the suction ring. For example, the reticle associated with the orientation of the suction ring may guide a physician or surgeon in docking the suction ring with the eye. The system may further determine at least one incision site based on at least a plurality of iris structures from at least the image of the eye, and may further display, via the display, a graphic overlay indicating the at least one incision site. Determining the at least one incision site may include determining a plurality of incision sites. The system may further display, via the display, a plurality of graphic overlays indicating respective ones of the plurality of incision sites. For example, the system may simultaneously display, via the display, a plurality of graphic overlays indicating respective ones of the plurality of incision sites. The system may further determine an angular measurement from an iris structure of the plurality of iris structures relative to the center of the pupil of the eye. For example, the system may display, via the display, a graphic overlay indicating the at least one incision site based at least on the angular measurement.
[0007] The present disclosure further includes a non-transitory computer-readable memory device having instructions thereon that, when executed by a processor of the system, cause the system to perform the steps set forth above. The present disclosure further includes a system or non-transitory computer-readable memory device as described above, having one or more of the following features, which may be used in combination with each other unless clearly mutually exclusive: i) acquiring an image of at least an eye of a person via at least one image sensor, ii) determining a position of an iris of the eye from the at least eye image, iii) determining a position of a suction ring from the at least eye image, iv) displaying the at least eye image via a display, vi) displaying a first graphic overlay on the at least eye image via the display indicating the position of the iris of the eye, vii) displaying a second graphic overlay on the at least eye image via the display indicating the position of the suction ring, viii) determining a plurality of iris structures from the at least eye image, ix) determining an eye orientation based on the at least plurality of iris structures from the at least eye image, x) displaying information indicative of the eye orientation via the display, xi ) displaying, via the display, a graphic overlay representing a reticle associated with an orientation of the eye; xii) displaying, via the display, a graphic overlay representing a reticle associated with an orientation of the suction ring; xiii) determining a position of a pupil of the eye from at least the image of the eye; xiv) displaying, via the display, a graphic overlay indicating the position of the pupil of the eye on at least the image of the eye; xv) determining, from at least the image of the eye, at least one incision site based on at least a plurality of iris structures; xvi) displaying, via the display, a graphic overlay indicating the at least one incision site; and xvii) determining an angle measurement from an iris structure of the plurality of iris structures relative to a center of the pupil of the eye.
[0008] Any of the above-described systems may be capable of performing any of the above-described methods, and any of the above-described non-transitory computer-readable memory devices may be capable of causing a system to perform any of the above-described methods. Any of the above-described methods may be performed in any of the above-described systems or using any of the above-described non-transitory computer-readable memory devices.
[0009] It is to be understood that both the foregoing general description and the following detailed description are exemplary and exemplary in nature and are intended to provide an understanding of the present disclosure without limiting the scope thereof. In this regard, further aspects, features, and advantages of the present disclosure will become apparent to those skilled in the art from the following detailed description.
[0010] For a more complete understanding of the contents, features, and advantages of the present disclosure, reference is now made to the following description taken in conjunction with the accompanying drawings, which are not necessarily drawn to scale. [Brief explanation of the drawings]
[0011] [Figure 1A] FIG. 1A illustrates an example of a medical system. [Figure 1B] FIG. 1B shows an example of a biometric device. [Figure 1C] FIG. 1C shows an example of an eye tilted in the x direction. [Figure 1D] FIG. 1D shows an example of an eye tilted in the y direction. [Figure 1E] FIG. 1E shows an example of a suction ring that is off-center in the x-direction. [Figure 1F] FIG. 1F shows an example of a suction ring that is off-center in the y-direction. [Figure 1G] FIG. 1G shows an example of a properly positioned suction ring. [Figure 1H] FIG. 1H shows another example of a properly positioned suction ring. [Figure 1I] FIG. 1I shows a second example of a medical system. [Figure 1J]FIG. 1J shows an example of a tilted and properly positioned suction ring and suction cone. [Figure 2A] FIG. 2A shows another example of a medical system. [Figure 2B] FIG. 2B shows an example of a display integrated with a microscope. [Figure 3A-3B] FIG. 3A shows an example of an eye iris overlay, and FIG. 3B shows a second example of an eye overlay. [Figure 3C-3D] FIG. 3C shows a third example of an eye overlay, and FIG. 3D shows a fourth example of an eye overlay. [Figures 3E-3F] FIG. 3E shows a fifth example of an eye overlay, and FIG. 3F shows a sixth example of an eye overlay. [Figure 3G] FIG. 3G shows another example of an eye overlay. [Figure 4A] FIG. 4A shows an example of multiple iris structures. [Figure 4B] FIG. 4B shows an example of multiple iris structures. [Figure 4C] FIG. 4C shows an example of displaying the incision site. [Figure 4D] FIG. 4D shows an example of displaying the incision site. [Figure 4E] FIG. 4E shows an example of displaying the incision site. [Figure 4F] FIG. 4F shows an example of a display of multiple overlays showing multiple respective incision sites. [Figure 5] FIG. 5 shows an example of a computer system. [Figure 6A] FIG. 6A shows an example of how the system may be operated. [Figure 6B] FIG. 6B shows another example of how the system may be operated. DETAILED DESCRIPTION OF THE INVENTION
[0012] In the following description, details are provided as examples to facilitate discussion of the disclosed subject matter, but it should be apparent to those skilled in the art that the disclosed embodiments are examples only and do not encompass all possible embodiments.
[0013] As used herein, reference numbers designate a class or type of object, and letters appended to such reference numbers designate a particular instance of a particular object of that class or type. Thus, for example, a hypothetical object referenced by "12A" designates a particular instance of a particular class / type, and the reference "12" may designate a population of instances belonging to a particular class / type or any one instance of that class / type generally.
[0014] At the start of a medical procedure (e.g., an eye surgery procedure), a patient may be placed on a support platform facing up. For example, the support platform may be or may include, among other things, a couch, a table, or a bed. Prior to the medical procedure, one or more components of a docking device may be docked with the patient's eye. For example, the one or more components of the docking device may include, among other things, one or more of a suction ring, a suction cone, and a lens. The laser eye surgery system may include, among other things, a suction cone and a lens. For example, the laser eye surgery system may include a femtosecond laser, and the laser may include, among other things, a suction cone and a lens.
[0015] The surgeon can manually align the suction ring with the eye. For example, the surgeon can place the suction ring on the eye without assistance from a guidance system. If the suction ring is placed incorrectly, the eye may be tilted. For example, if the eye is tilted, the center of the suction ring is offset from the optical axis of the eye, and the medical procedure (e.g., surgical procedure) may not be fully effective. If the medical procedure involves one or more refractive incisions, a tilted eye may prevent the medical procedure from being fully effective.
[0016] A physician can use a guidance system to position the suction ring on the eye. For example, the guidance system can assist the physician in positioning the suction ring on the eye so that the suction ring is aligned or approximately aligned with the optical axis of the eye. The optical axis of the eye can be related to the center of the pupil of the eye. For example, using a guidance system to position the suction ring on the eye can provide one or more advantages, which can include, among other things, guiding the physician in positioning the suction ring in alignment or approximately aligned with the optical axis of the eye and in positioning the suction ring in rotational alignment or approximately rotational alignment with the eye.
[0017] The patient's eye may not be stationary. For example, the patient's eye may move during the docking process. The patient's eye may move left and / or right during the docking process, move up and / or down during the docking process, and / or rotate clockwise and / or counterclockwise during the docking process. The guidance system may determine one or more movements of the patient's eye during the docking process. For example, the guidance system may track the patient's eye. Tracking the patient's eye may include determining one or more positions of the patient's eye during and / or after the one or more movements of the patient's eye. For example, the guidance system may display information indicative of one or more positions of the patient's eye during and / or after the one or more movements of the patient's eye. The information indicative of the one or more positions of the patient's eye during and / or after the one or more movements of the patient's eye may assist and / or guide the physician in docking the suction ring to the patient's eye. For example, information indicative of the one or more positions of the patient's eye during and / or after the one or more movements of the patient's eye may be displayed over one or more images of the patient's eye. The guidance system can augment one or more images of the patient's eye with information indicative of one or more positions of the patient's eye during and / or after one or more movements of the patient's eye. For example, the guidance system can include one or more structures and / or one or more functions of an augmented reality (AR) system, an AR method, and / or an AR process. As described in more detail below, the medical system can include one or more structures and / or functions of a guidance system. For example, the medical system can assist and / or guide a physician in docking a suction ring with the patient's eye.
[0018] Referring now to FIG. 1A , a first example of a medical system is shown. As shown, the medical system 110 may include a computer system 112. As shown, the medical system 110 may include a biometric device 114. As shown, the biometric device 114 may be communicatively connected to the computer system 112. As shown, the medical system 110 may include a vacuum system 130. As shown, the vacuum system 130 may be communicatively connected to the computer system 112. For example, the computer system may control the vacuum system 130. The vacuum system 130 may generate one or more low pressures via one or more electrical leads 132 and 134. For example, the vacuum system 130 may generate one or more low pressures via the electrical leads 134 to adhere and / or seal a suction ring 140 to the patient's eye 122. As shown, the medical system 110 may include the electrical leads 132 and 134 and the suction ring 140.
[0019] Referring now to FIG. 1B , an example of a biometric device is shown. As shown, the biometric device 114 may include image sensors 160A-160C. For example, the image sensor 160 may include a camera. As shown, the biometric device 114 may include light projectors 162A-162C. In one example, the light projector 162 may project visible light. In another example, the light projector 162 may project infrared light. The light projector 162 may project a circle and / or a dot onto the patient's eye. The image sensor 160 may receive a reflection of the circle and / or the dot projected onto the patient's eye. The computer system may determine one or more locations and / or one or more templates associated with the patient's eye based on at least the reflection of the circle and / or the dot projected onto the patient's eye. As shown, the biometric device 114 may include depth sensors 164A-164C. The depth sensor 164 may include a light projector 162. The depth sensor 164 may include an optical sensor. As shown, the biometric device 114 may include an optical low coherence reflectometer (OLCR) device 166. As shown, the biometric device 114 may include a wavefront device 168.
[0020] The wavefront device 168 may include, among other things, one or more light sources and a wavefront sensor. The light source may transmit a first light wave to the eye 122. The wavefront sensor may receive a first perturbed light wave from the eye 122 based on at least the first light wave. In one example, the wavefront device 168 may determine a first optical correction based on at least the first perturbed light. In another example, a computer system may determine the first optical correction based on at least the first perturbed light. The wavefront device 168 may provide data to the computer system based on at least the first perturbed light wave. For example, the computer system may determine the first optical correction based on at least data from the wavefront device 168.
[0021] Any two or more of the image sensor 160, the light projector 162, the depth sensor 164, the OLCR device 166, and the wavefront device 168 may be combined. In particular, one or more of the image sensors 160A-160C, one or more of the light projectors 162A-162C, one or more of the depth sensors 164A-164C, the OLCR device 166, and / or the wavefront device 168 may generate data usable by a computer system.
[0022] 1C, an example of an eye tilted in the x-direction is shown. As shown, the eye 122 may be tilted relative to the x-direction. For example, if the suction ring 140 were lowered directly in the z-direction, the suction ring 140 may not be properly positioned on the eye 122.
[0023] 1D, an example of an eye tilted in the y direction is shown. As shown, the eye 122 may be tilted relative to the y direction. For example, if the suction ring 140 were lowered directly in the z direction, the suction ring 140 may not be properly positioned on the eye 122.
[0024] 1E, an example of a suction ring that is off-center in the x-direction is shown. As shown, the suction ring 140 may be off-center in the x-direction from the optical axis 150 of the eye 122. For example, if the suction ring 140 were lowered directly in the z-direction, the suction ring 140 may not be properly positioned on the eye 122.
[0025] 1F, an example of a suction ring that is off-center in the y-direction is shown. As shown, the suction ring 140 may be off-center in the y-direction from the optical axis 150 of the eye 122. For example, if the suction ring 140 were lowered directly in the z-direction, the suction ring 140 may not be properly positioned on the eye 122.
[0026] 1G, an example of a properly positioned suction ring is shown. As shown, the suction ring 140 can be properly positioned on the eye 122. For example, the suction ring 140 can be properly positioned on the eye 122 relative to the optical axis 150. The suction ring 140 can be docked with the eye 122 as shown.
[0027] 1H, another example of a properly positioned suction ring is shown. As shown, the suction ring 140 can be properly positioned on the eye 122. In one example, the eye 122 may be tilted in the x direction. In another example, the eye 122 may be tilted in the y direction. The suction ring 140 can be properly positioned on the eye 122 even if the eye 122 is tilted in the x direction and / or the y direction. For example, as shown, when the suction ring 140 is positioned relative to the optical axis 150, the suction ring 140 can be properly positioned on the eye 122. The suction ring 140 can be docked with the eye 122 as shown.
[0028] Referring now to FIG. 1I, a second example of a medical system is shown. As shown, the medical system 110 may include a suction cone 170. For example, the suction cone 170 may be or may include an applanation cone. As shown, the computer system 112 may be coupled to a controller 174 of the suction cone 170. For example, the computer system 112 may control the suction cone 170 via the controller 174. The suction cone 170 may be docked with the suction ring 140 after the suction ring 140 is docked with the eye 122. As shown, the suction cone 170 may include a lens 172. Although the lens 172 is depicted as being flat or planar, the lens 172 may include a concave and / or convex shape.
[0029] Referring now to FIG. 1J, an example of a tilted and properly positioned suction ring and suction cone is shown. As shown, the suction ring 140 can be properly positioned on the eye 122. In one example, the eye 122 may be tilted in the x direction. In another example, the eye 122 may be tilted in the y direction. The suction ring 140 can be properly positioned on the eye 122 even if the eye 122 is tilted in the x direction and / or the y direction. For example, as shown, the suction ring 140 can be properly positioned on the eye 122 when positioned relative to the optical axis 150. The suction ring 140 can be docked with the eye 122 as shown. The suction cone 170 can be docked with the suction ring 140 such that both the suction ring 140 and the suction cone 170 are aligned with the optical axis 150 as shown.
[0030] 2A , another example of a medical system is shown. As shown, a surgeon 210 may use the medical system 110. For example, the surgeon 210 may use the system 110 in a procedure involving an eye 122 of a patient 120. The system 110 may include multiple systems. As shown, the system 110 may include an incision system 215A. For example, the surgeon 210 may use the system 215A to incise the eye 122. The eye 122 may include a flap in the cornea of the eye of the patient 120. As shown, the system 110 may include a shaping system 215B. For example, the surgeon 210 may use the shaping system 215B in performing a resection of an inner portion of the cornea of the patient 120.
[0031] As shown, system 215A may include display 116A. As shown, system 215A may include microscope display 250A. For example, microscope display 250A may include a microscope integrated display (MID). System 215A may include, among other things, one or more image sensors 160A-160C, one or more light projectors 162A-162C, one or more depth sensors 164A-164C, an OLCR device 166, and / or a wavefront device 168. System 215A may include, among other things, one or more suction ring 150, suction cone 170, and vacuum system 130. As shown, system 215B may include display 116B. As shown, system 215B may include microscope display 250B. For example, microscope display 250B may include an MID. System 215B may include one or more image sensors 160A-160C, one or more light projectors 162A-162C, one or more depth sensors 164A-164C, an OLCR device 166, and / or a wavefront device 168, among others.
[0032] System 215A may include a laser, such as a femtosecond laser, that uses short laser pulses to ablate a series of small portions of corneal tissue to form a flap that can be lifted to expose an inner portion of the cornea. The flap may be planned and cut using one or both of cutting device displays 116A and 250A in conjunction with a controller and computer system 112A. As shown, system 215A may include computer system 112A. For example, computer system 112A may be coupled to, among other things, one or more image sensors 160A-160C, one or more optical projectors 162A-162C, one or more depth sensors 164A-164C, OLCR device 166, and / or wavefront device 168 of system 215A. As shown, system 215B may include computer system 112B. For example, computer system 112B may be coupled to one or more image sensors 160A-160C, one or more light projectors 162A-162C, one or more depth sensors 164A-164C, OLCR device 166, and / or wavefront device 168 of system 215B, among others.
[0033] Systems 215A and 215B may be physically separated as shown in FIG. 2B. Patient 120 may move between systems 215A and 215B. Alternatively, patient 120 may remain stationary and systems 215A and 215B may be moved toward patient 120. Systems 215A and 215B may be physically combined into a single, integrated device such that neither the device nor patient 120 changes position when switching between systems 215A and 215B.
[0034] System 110 may include one or more control devices for controlling systems 215A and 215B. For example, the one or more control devices may include one or more interactive displays, such as a touchscreen display, a keyboard, a mouse, a touchpad, buttons, a joystick, foot pedals, a heads-up display, and virtual reality glasses or other devices capable of interacting with a user, such as a healthcare professional.
[0035] System 110 may include at least one computer system configured to generate images presented on at least one display 116A, 250A, 116B, and 250B, among other things. For example, the at least one computer system may include one or more computer systems 112A and 112B. One or more computer systems 112A and 112B may be coupled to a viewing device, such as a microscope, a camera, an optical coherence tomography (OCT) device, or a display, or another device capable of measuring the position of the eye during surgery. One or more computer systems 112A and 112B may be coupled to one or more control devices.
[0036] In one example, cutting device computer system 112A may i) be coupled to a viewing device that views eye 122 when patient 120 is positioned with system 215A, ii) be capable of providing graphical information regarding the planned flap position and planned resection area on one or more displays 116A and 250A, and iii) be coupled to one or more controllers of system 215A. In a second example, molding device computer 112B may i) be coupled to a viewing device that views eye 122 when patient 120 is positioned with the molding device, ii) be capable of providing graphical information regarding the planned flap position and planned resection area on one or more displays 1160B and 250B, and iii) be coupled to one or more controllers of system 215B. In another example, the computer systems may include the features and / or attributes described above with respect to computer systems 112A and 112B.
[0037] A computer system of system 110 may be coupled to another portion of system 110 by wire or wirelessly. Data of one or more computer systems of system 110 may be stored in a database, local device, remote computer system, and / or remote data center that stores patient data, treatment plans, and / or medical procedures and / or other information associated with system 110. In one example, the database may include a relational database. In a second example, the database may include a graph database. In another example, the database may include a "Not Only SQL" (NoSQL) database.
[0038] The system 110 may allow a user to input information about a patient and treatments to be or have been administered to the patient. The system 110 may allow a user to input and view information about a patient and treatments to be administered to the patient. Such data may include, among other things, information about the patient, such as identifying information, the patient's medical history, and / or information about the eye 122 being treated. Such data may include, among other things, information about the treatment plan, such as the shape and location of a corneal incision, the shape and / or location of an ablation.
[0039] Referring now to FIG. 2B , an example of a display integrated with a microscope is shown. As shown, MID 250 may include displays 262A and 262B. For example, surgeon 210 may look through multiple eyepieces, and displays 262A and 262B may display information to surgeon 210. While MID 250 is shown with multiple displays, MID 250 may include a single display 262. For example, MID 250 may be implemented with one or more displays 262. Display 262 may display any image and / or any information that display 116 may display. As shown, MID 250 may include image sensors 272A and 272B. In one example, image sensors 272A and 272B may acquire images. In a second example, image sensors 272A and 272B may include cameras. In another example, image sensor 272 can capture images via one or more of visible light, infrared light, and ultraviolet light, among others. One or more image sensors 272A and 272B can provide image data to computer system 112. Although MID 250 is shown with multiple image sensors, MID 250 can include a single image sensor 272. For example, MID 250 can be implemented with one or more image sensors 272.
[0040] As shown, MID 250 may include distance sensors 274A and 274B. For example, distance sensor 274 may determine a distance to surgical tooling equipment 220. Distance sensor 274 may determine a distance associated with the z-axis. While MID 250 is shown with multiple image sensors, MID 250 may include a single distance sensor 274. In one example, MID 250 may be implemented with one or more distance sensors 274. In another example, MID 250 may not be implemented with a distance sensor. As shown, MID 250 may include lenses 276A and 276B. While MID 250 is shown with multiple lenses 276A and 276B, MID 250 may include a single lens 276. For example, MID 250 may be implemented with one or more lenses 276. As shown, MID 250 may include illuminators 278A and 278B. For example, illuminator 278 may provide and / or generate one or more of visible light, infrared light, and ultraviolet light, among others. Although MID 250 is shown with multiple illuminators, MID 250 may include a single illuminator 278. For example, MID 250 may be implemented with one or more illuminators 278.
[0041] The illuminator 278 can provide infrared light. The computer system 112 can receive image data based at least on the reflected infrared light. For example, the image sensor 272 can receive the reflected infrared light and provide data to the computer system 112 based at least on the reflected infrared light. The illuminator 278 can provide white light. The computer system 112 can receive image data based at least on the reflected white light. For example, the image sensor 272 can receive the reflected white light and provide data to the computer system 112 based at least on the reflected white light. The illuminator 278 can provide ultraviolet light. The computer system 112 can receive image data based at least on the reflected ultraviolet light. For example, the image sensor 272 can receive the reflected ultraviolet light and provide data to the computer system 112 based at least on the reflected ultraviolet light. The MID 250 can include one or more structures and / or one or more functions similar to those described with respect to the biometric device 114. In one example, the MID 250 can include an OLCR device 166. In another example, the MID 250 can include a wavefront device 168.
[0042] As one example, the surgical tooling equipment may be marked with one or more patterns. The one or more patterns may be used to identify the surgical tooling equipment. The one or more patterns may include one or more of a hash pattern, a stripe pattern, and a fractal pattern, among others. As another example, the surgical tooling equipment may be marked with a dye and / or paint. The dye and / or paint may reflect one or more of visible light, infrared light, and ultraviolet light, among others. In one example, the illuminator 278 may provide ultraviolet light, and the image sensor 272 may receive the ultraviolet light reflected from the surgical tooling equipment. The computer system 112 may receive image data from the image sensor 272 based at least on the ultraviolet light reflected from the surgical tooling equipment, and may use the image data based at least on the ultraviolet light reflected from the surgical tooling equipment to identify the surgical tooling equipment from other image data provided by the image sensor 272. In another example, the illuminator 278 may provide infrared light, and the image sensor 272 may receive the infrared light reflected from the surgical tooling equipment. The computer system 112 receives image data from the image sensor 272 based at least on infrared light reflected from the surgical tooling equipment, and can use the image data based at least on infrared light reflected from the surgical tooling equipment to identify the surgical tooling equipment from other image data provided by the image sensor 272.
[0043] 3A , an example of an overlay of an iris of an eye is shown. As shown, the display 116 may display an image 310 of the eye 122. The system 110 may determine an image 314 of the iris of the eye 122. As shown, the display 116 may display an overlay 320. For example, the overlay 320 may mark the outer boundary of the image 314 of the iris of the eye 122. The overlay 320 may be centered on the image 312 of the pupil of the eye 122. The system 110 may determine the overlay 320 via one or more of computer vision methods, computer vision processing, and computer vision systems, among others. One or more positions of the overlay 320 may be changed and / or updated based on at least one or more movements of the eye 122.
[0044] 3B, a second example of an eye overlay is shown. As shown, overlay 322 may surround overlay 320. For example, overlay 322 may augment overlay 320. One or more positions of overlay 322 may be changed and / or updated based on one or more movements of at least eye 122.
[0045] Referring now to FIG. 3C, a third example of an eye overlay is shown. As shown, the display 116 can display an overlay 330A. For example, the overlay 330A can represent the alignment of the suction ring 140. The overlay 330A can represent the alignment of the suction ring 140 when the suction ring 140 moves in the z-direction relative to the eye 122. As shown, the overlay 330A indicates that the suction ring 140 may not be properly aligned. In one example, as shown in FIG. 1C, the eye 122 may be tilted in the x-direction. In another example, as shown in FIG. 1E, the suction ring 140 may be offset from the optical axis 150 of the eye 122 in the x-direction. One or more positions of the overlay 330A can be changed and / or updated based on at least one or more movements of the suction ring 140.
[0046] Referring now to FIG. 3D , a fourth example of an eye overlay is shown. As shown, the display 116 can display an overlay 330B. For example, the overlay 330B can represent the alignment of the suction ring 140. The overlay 330B can represent the alignment of the suction ring 140 when the suction ring 140 moves in the z-direction relative to the eye 122. As shown, the overlay 330B indicates that the suction ring 140 may not be properly aligned. In one example, as shown in FIG. 1D , the eye 122 may be tilted in the y-direction. In another example, as shown in FIG. 1F , the suction ring 140 may be offset from the optical axis 150 of the eye 122 in the y-direction. One or more positions of the overlay 330B can be changed and / or updated based on at least one or more movements of the suction ring 140.
[0047] 3E, a fifth example of an eye overlay is shown. As shown, the display 116 can display an overlay 324A. For example, the overlay 324A can be aligned with one or more of the image 312 of the pupil of the eye 122 and the image 314 of the iris of the eye 122, among other things. The overlay 324A can be aligned with the center of the image 312 of the pupil of the eye 122. The overlay 324A can be aligned with one or more structures of the image 314 of the iris of the eye 122. The overlay 324A can communicate and / or guide the placement and / or position of the suction ring 140.
[0048] As shown, the display 116 can display an overlay 334A. For example, the overlay 334A can represent the alignment of the suction ring 140. The overlay 334A can represent the alignment of the suction ring 140 when the suction ring 140 is moved in the z-direction relative to the eye 122. For example, the overlay 334A can represent a reticle (e.g., crosshairs). As shown, the overlay 334A indicates that the suction ring 140 may not be properly aligned. In one example, the eye 122 may be tilted in the x-direction, as shown in FIG. 1C. In a second example, the eye 122 may be tilted in the y-direction, as shown in FIG. 1D. In a third example, the suction ring 140 may be offset from the optical axis 150 of the eye 122 in the x-direction, as shown in FIG. 1E. In another example, the suction ring 140 may be offset from the optical axis 150 of the eye 122 in the y-direction, as shown in FIG. 1F. One or more positions of overlay 324A can be changed and / or updated based on at least one or more movements of eye 122. One or more positions of overlay 334A can be changed and / or updated based on at least one or more movements of suction ring 140.
[0049] 3F, a sixth example of an eye overlay is shown. As shown, the display 116 may display an overlay 324A. For example, the overlay 324A may be aligned with one or more of the image 312 of the pupil of the eye 122 and the image 314 of the iris of the eye 122, among other things. The overlay 324A may be aligned with the center of the image 312 of the pupil of the eye 122. The overlay 324A may be aligned with one or more structures of the image 314 of the iris of the eye 122. The overlay 324A may communicate and / or guide the placement and / or position of the suction ring 140.
[0050] As shown, the display 116 can display an overlay 334B. For example, the overlay 334B can represent the alignment of the suction ring 140. The overlay 334B can represent the alignment of the suction ring 140 when the suction ring 140 is moved in the z-direction relative to the eye 122. For example, the overlay 334B can represent a reticle (e.g., crosshairs). As shown, the overlay 334B indicates that the suction ring 140 may not be properly aligned. In one example, the eye 122 may be tilted in the x-direction, as shown in FIG. 1C. In a second example, the eye 122 may be tilted in the y-direction, as shown in FIG. 1D. In a third example, the suction ring 140 may be offset from the optical axis 150 of the eye 122 in the x-direction, as shown in FIG. 1E. In a fourth example, the suction ring 140 may be offset from the optical axis 150 of the eye 122 in the y-direction, as shown in FIG. 1F. In another example, the suction ring 140 can be rotated. One or more positions of overlay 324A can be changed and / or updated based on at least one or more movements of eye 122. One or more positions of overlay 334B can be changed and / or updated based on at least one or more movements of suction ring 140.
[0051] 3G, another example of an eye overlay is shown. As shown, the display 116 can display an overlay 324B. For example, the overlay 324B can be aligned with one or more of the image 312 of the pupil of the eye 122 and the image 314 of the iris of the eye 122, among other things. The overlay 324B can be aligned with the center of the image 312 of the pupil of the eye 122. The overlay 324B can be aligned with one or more structures of the image 314 of the iris of the eye 122. The overlay 324B can communicate and / or guide the placement and / or position of the suction ring 140.
[0052] The eye 122 can rotate about the optical axis 150. In one example, the eye 122 can perform a torsional motion. In another example, the eye 122 can perform a circular rotation. The overlay 324B can indicate one or more rotations of the eye 122. For example, the overlay 324B can indicate one or more rotations of the eye 122 about the optical axis 150. The overlay 324B can indicate, in particular, one or more of the rotation of the eye 122 about the optical axis 150, the tilt of the eye 122 in the x-direction, and the tilt of the eye 122 in the y-direction.
[0053] As shown, the display 116 can display an overlay 334A. For example, the overlay 334A can represent the alignment of the suction ring 140. The overlay 334A can represent the alignment of the suction ring 140 when the suction ring 140 is moved in the z-direction relative to the eye 122. For example, the overlay 334A can represent a reticle (e.g., crosshairs). As shown, the overlay 334A indicates that the suction ring 140 may not be properly aligned. In one example, the eye 122 may be tilted in the x-direction, as shown in FIG. 1C. In a second example, the eye 122 may be tilted in the y-direction, as shown in FIG. 1D. In a third example, the suction ring 140 may be offset from the optical axis 150 of the eye 122 in the x-direction, as shown in FIG. 1E. In a fourth example, the suction ring 140 may be offset from the optical axis 150 of the eye 122 in the y-direction, as shown in FIG. 1F. In another example, the suction ring 140 can be rotated. One or more positions of overlay 324B can be changed and / or updated based on at least one or more movements of eye 122. One or more positions of overlay 334A can be changed and / or updated based on at least one or more movements of suction ring 140.
[0054] 4A and 4B, examples of multiple iris structures are shown. As shown, an iris 400 of an eye 122 can include iris structures 434A-434C. For example, the system 110 can determine the iris structures 434A-434C. One or more measurements associated with the iris structures 434A-434C can be determined. In one example, one or more measurements 410-414 can be determined. In another example, one or more measurements θ1, θ2 can be determined. The system 110 can specifically determine one or more measurements 410-414 and / or one or more measurements θ1, θ2. For example, the system 110 can specifically determine one or more measurements 410-414 and / or one or more measurements θ1, θ2 for a pupil 405 of the eye 122. In particular, the system 110 can determine one or more measurements 410-414 and / or one or more measurements θ1, θ2 relative to the center of the pupil 405 of the eye 122, as shown.
[0055] One or more iris structures 434A-434C can be used to determine, among other things, one or more positions of one or more of the overlays 320, 322, 324A, 324B, 330A, 330B, 334A, and 334B. In one example, the system 110 can use one or more iris structures 434A-434C to determine, among other things, one or more positions of one or more of the overlays 320, 322, 324A, 324B, 330A, 330B, 334A, and 334B. In another example, the system 110 can use one or more iris structures 434A-434C to determine, among other things, one or more measurements 410-414 and / or one or more measurements θ1, θ2. One or more positions of each of the one or more iris structures 434A-434C may be used as one or more reference positions, respectively, in particular when determining one or more positions of one or more of the overlays 320, 322, 324A, 324B, 330A, 330B, 334A, and 334B.
[0056] As shown, measurement 410 may include a distance measurement from the center of pupil 405 to iris structure 434A. As shown, measurement 412 may include a distance measurement from the center of pupil 405 to iris structure 434B. As shown, measurement 414 may include a distance measurement from the center of pupil 405 to iris structure 434C. As shown, θ1 may include an angular measurement from iris structure 434A and iris structure 434B relative to the center of pupil 405. For example, θ1 may include an angular measurement between iris structure 434A and iris structure 434B relative to the center of pupil 405. As shown, θ2 may include an angular measurement from iris structure 434A and iris structure 434C relative to the center of pupil 405. For example, θ2 may include an angular measurement between iris structure 434A and iris structure 434C relative to the center of pupil 405. The system 110 can determine, among other things, the position of one or more of the one or more overlays 320, 322, 324A, 324B, 330A, 330B, 334A, and 334B using, among other things, one or more measurements 410-414 and / or one or more measurements θ1, θ2.
[0057] 4C-4E, examples of incision site representations are shown. As shown in FIG. 4C, the display 116 can display an overlay 440 that can indicate the site of a first incision. In one example, the overlay 440 can be located at an angle measurement θ3 from the iris structure 434A to the center of the pupil 405 of the eye 122. In another example, the overlay 440 can be located at a distance measurement 450 from the center of the pupil 405 of the eye 122. As shown in FIG. 4D, the display 116 can display an overlay 442 that can indicate the site of a second incision. In one example, the overlay 442 can be located at an angle measurement θ4 from the iris structure 434A to the center of the pupil 405 of the eye 122. In another example, the overlay 442 can be located at a distance measurement 452 from the center of the pupil 405 of the eye 122.
[0058] System 110 can determine one or more positions of one or more of overlays 440 and 442 using, among other things, one or more iris structures 434A-434C. In one example, system 110 can use angle measurement θ3 from iris structure 434A to display overlay 440. In another example, system 110 can use angle measurement θ4 from iris structure 434A to display overlay 442.
[0059] Overlay 440 may be associated with one or more of angle measurement θ5 and distance measurement 450, as shown in FIG. 4E . For example, overlay 440 may be or include a circular arc. Overlay 442 may be associated with one or more of angle measurement θ6 and distance measurement 452, as shown in FIG. 4E . For example, overlay 442 may be or include a circular arc. Display 416 may display overlays 440 and 442, as shown in FIG. 4F . For example, display 416 may display overlays 440 and 442 simultaneously. One or more overlays 440 and 442 may assist a physician and / or surgeon in locating one or more respective incision sites.
[0060] 5, an example of a computer system is shown. As shown, computer system 500 may include a processor 510, a volatile memory medium 520, a non-volatile memory medium 530, and an input / output (I / O) device 540. As shown, volatile memory medium 520, non-volatile memory medium 530, and I / O device 540 may be communicatively coupled to processor 510.
[0061] The term “memory medium” may refer to “memory,” “storage device,” “memory device,” “computer-readable medium,” and / or “tangible computer-readable storage medium.” For example, memory medium may include, without limitation, direct access storage devices including hard disk drives, sequential access storage devices such as tape disk drives, compact discs (CDs), random access memory (RAM), read-only memory (ROM), CD-ROMs, digital versatile discs (DVDs), electrically erasable programmable read-only memory (EEPROM), flash memory, non-transitory media, and / or one or more combinations thereof. As shown, non-volatile memory medium 530 may include processor instructions 532. Processor instructions 532 may be executed by processor 510. In one example, one or more portions of processor instructions 532 may be executed via non-volatile memory medium 530. In another example, one or more portions of processor instructions 532 may be executed via volatile memory medium 520. One or more portions of processor instructions 532 may be transferred to volatile memory medium 520.
[0062] The processor 510 may execute the processor instructions 532 in implementing at least a portion of one or more systems, one or more flowcharts, one or more processes, and / or one or more methods described herein. For example, the processor instructions 532 may comprise, encode, and / or encode instructions according to at least a portion of one or more systems, one or more flowcharts, one or more methods, and / or one or more processes described herein. While the processor 510 is shown as a single processor, the processor 510 may be or include multiple processors. One or more of the storage medium and memory medium may be a software product, program product, and / or article of manufacture. For example, the software product, program product, and / or article of manufacture may be comprised of, encoded, and / or encoded instructions executable by the processor according to at least a portion of one or more systems, one or more flowcharts, one or more methods, and / or one or more processes described herein.
[0063] Processor 510 may include any suitable system, apparatus, or device operable to interpret and execute program instructions, process data, or both stored on a memory medium and / or received over a network. Processor 510 may also include one or more microprocessors, microcontrollers, digital signal processors (DSPs), application specific integrated circuits (ASICs), or other circuitry configured to interpret and execute program instructions, process data, or both.
[0064] I / O device(s) 540 may include any one or more functions that permit, authorize, and / or enable a user to interact with computer system 500 and its associated components by facilitating input from and output to a user. Facilitating input from a user allows the user to operate and / or control computer system 500, and facilitating output to a user allows computer system 500 to display the effects of the user's operations and / or controls. For example, I / O device(s) 540 may enable a user to input data, instructions, or both into computer system 500 and otherwise operate and / or control computer system 500 and its associated components. I / O device(s) may include user interface devices such as a keyboard, mouse, touchscreen, joystick, handheld lens, tool tracking device, coordinate input device, or any other I / O device suitable for use with the system.
[0065] The I / O devices 540 may include, among other things, one or more buses, one or more serial devices, and / or one or more network interfaces that can facilitate and / or allow the processor 510 to implement at least a portion of one or more systems, processes, and / or methods described herein. In one example, the I / O devices 540 may include a storage interface that can facilitate and / or allow the processor 510 to communicate with external storage devices. The storage interface may include, among other things, one or more of a Universal Serial Bus (USB) interface, a Serial ATA (SATA) interface, a Parallel ATA (PATA) interface, and a Small Computer System Interface (SCSI). In a second example, the I / O devices 540 may include a network interface that can facilitate and / or allow the processor 510 to communicate with a network. The I / O devices 540 may include one or more of a wireless network interface and a wired network interface. In a third example, the I / O device 540 may be a peripheral component interconnect (PCI) interface, a PCI Express (PCIe) interface, a serial peripheral interconnect (SPI) interface, and an inter-integrated circuit (IIC) interface, among others. 2 C) interfaces. In a fourth example, I / O device 540 may include circuitry that may allow processor 510 to communicate data with one or more sensors. In a fifth example, I / O device 540 may facilitate and / or allow processor 510 to communicate data with one or more of display 550 and MID 560, among others. In another example, I / O device 540 may facilitate and / or allow processor 510 to communicate data with imager 570. As shown, I / O device 540 may be coupled to network 570. For example, I / O device 540 may include a network interface.
[0066] Network 570 may include, among other things, a wired network, a wireless network, an optical network, or a combination of the above. Network 570 may include and / or be coupled to various communication networks. For example, network 570 may include and / or be coupled to, among other things, a local area network (LAN), a wide area network (WAN), the Internet, a public switched telephone network (PSTN), a cellular telephone network, a satellite telephone network, or a combination of the above. WANs may include, among other things, a private WAN, a corporate WAN, a public WAN, or a combination of the above.
[0067] The computer systems described herein may include one or more structures and / or one or more functions similar to those described with respect to computer system 500. In one example, computer system 112 may include one or more structures and / or one or more functions similar to those described with respect to computer system 500. In another example, the computer system of MID 250 may include one or more structures and / or one or more functions similar to those described with respect to computer system 500.
[0068] 6A, an example of a method of operating the system is shown. At 610, an image of at least an eye of a person may be acquired via at least one image sensor. In one example, the at least one image of the eye may include multiple images of the eye. In another example, the at least one image sensor may include multiple image sensors. The image sensor may be or may include a camera.
[0069] At 615, a location of the iris of the eye can be determined from at least the image of the eye. The location of the iris of the eye can include the boundary with the pupil of the eye. At 620, a location of a suction ring can be determined from at least the image of the eye. At 625, at least the image of the eye can be displayed via a display. For example, at least the image 310 of the eye 122 can be displayed via display 116. Although these examples and figures use display 116, any image and / or graphic that display 116 is capable of displaying can be displayed by one or more displays 262A and 262B of MID 250 in addition to or instead of display 116.
[0070] At 630, a first graphic overlay indicating the location of the iris of the eye may be displayed over at least the image of the eye. For example, graphic overlay 320 indicating the location of the iris of the eye may be displayed over image 310. The first graphic overlay may include a circular shape.
[0071] At 635, a second graphic overlay indicating the location of the suction ring may be displayed over at least the image of the eye. In one example, as shown in FIG. 3C, a graphic overlay 330A indicating the location of the suction ring 140 may be displayed over the image 310. In a second example, as shown in FIG. 3D, a graphic overlay 330B indicating the location of the suction ring 140 may be displayed over the image 310. In a third example, as shown in FIG. 3E, a graphic overlay 334A indicating the location of the suction ring 140 may be displayed over the image 310. In a fourth example, as shown in FIG. 3F, a graphic overlay 334B indicating the location of the suction ring 140 may be displayed over the image 310. In another example, as shown in FIG. 3G, a graphic overlay 334B indicating the location of the suction ring 140 may be displayed over the image 310. The second graphic overlay may include a circular shape.
[0072] At 640, a plurality of iris structures may be determined from at least the image of the eye. For example, a plurality of iris structures 434A-434C may be determined from image 310. At 645, an orientation of the eye may be determined from at least the image of the eye based on at least the plurality of iris structures. For example, an orientation of the eye 122 may be determined based on at least the plurality of iris structures 434A-434C. The orientation of the eye 122 may include tilt. For example, the tilt may be in the x direction and / or the y direction. The orientation of the eye 122 may include a rotation of the eye 122. For example, the eye 122 may undergo a circular rotation.
[0073] Information indicative of the orientation of the eye can be displayed at 650. In one example, as shown in Figures 3E and 3F, the information indicative of the orientation of the eye 122 can include graphic overlay 324A. In another example, as shown in Figure 3G, the information indicative of the orientation of the eye 122 can include graphic overlay 324B.
[0074] The information indicative of the eye orientation may include a third graphic overlay representing a first reticle associated with the eye orientation. In one example, the information indicative of the eye orientation may include a graphic overlay 324A representing a first reticle associated with the eye orientation, as shown in Figures 3E and 3F. In another example, the information indicative of the eye orientation may include a graphic overlay 324B representing a first reticle associated with the eye orientation, as shown in Figure 3G.
[0075] At 655, information indicating the orientation of the suction ring can be displayed. The information indicating the orientation of the suction ring can include a fourth graphic overlay. In one example, the information indicating the orientation of the suction ring 140 can include graphic overlay 334A, as shown in FIGS. 3E and 3G. In another example, the information indicating the orientation of the suction ring 140 can include graphic overlay 334B.
[0076] The example method described with respect to FIG. 6A may be repeated. For example, the eye 122 may not be stationary or remain stationary. The eye 122 may move during the docking process. The eye 122 may move left and / or right during the docking process, may move up and / or down during the docking process, and / or may rotate clockwise and / or counterclockwise during the docking process. A system using the example method described with respect to FIG. 6A may determine one or more movements of the eye 122 during the docking process. A system using the example method described with respect to FIG. 6A may determine one or more movements of the suction ring 140 during the docking process. For example, the system may track the eye 122 and / or the suction ring 140.
[0077] Referring now to FIG. 6B, another example of a method of operating the system is shown. Method elements 610-650 of FIG. 6B may be performed in accordance with method elements 610-650 of FIG. 6A. At 660, at least one incision site may be determined from at least an image of the eye based on at least a plurality of iris structures. For example, the at least one incision site may be determined based on at least a plurality of iris structures 434A-434C. One or more locations of the one or more incision sites may be stored via a memory device. For example, the one or more locations of the one or more incision sites may be based on at least a plurality of iris structures 434A-434C.
[0078] At 665, an angular measurement from an iris structure of the plurality of iris structures relative to the center of the pupil of the eye can be determined. In one example, θ can be determined from iris structure 434A, as shown in FIG. 4C. In another example, θ can be determined from iris structure 434A, as shown in FIG. 4D.
[0079] At 670, a third graphic overlay indicating the at least one incision site can be displayed via the display. In one example, as shown in FIG. 4C, a graphic overlay 440 indicating the at least one incision site can be displayed via the display 116. In another example, as shown in FIG. 4D, a graphic overlay 442 indicating the at least one incision site can be displayed via the display 116. The graphic overlays 440 and 442 can be displayed via the display 116 as shown in FIG. 4F. For example, the graphic overlays 440 and 442 can be displayed simultaneously via the display 116 as shown in FIG. 4F. The display of the third graphic overlay indicating the at least one incision site can be based at least on angular measurements. In one example, the display of the graphic overlay 440 can be based at least on θ3 as shown in FIG. 4C. In another example, the display of the graphic overlay 442 can be based at least on θ4 as shown in FIG. 4D.
[0080] The display of the third graphic overlay indicating the at least one incision site may include a display of at least one arc, each indicating the at least one incision site. In one example, graphic overlay 440 may include at least one arc, each indicating the at least one incision site. In a second example, graphic overlay 442 may include at least one arc, each indicating the at least one incision site. In another example, graphic overlays 440 and 442 may include multiple arcs, each indicating an incision site.
[0081] The example method described with respect to FIG. 6B may be repeated. For example, the eye 122 may not be stationary or remain stationary. The eye 122 may move. The eye 122 may move left and / or right, move up and / or down, and / or rotate clockwise and / or counterclockwise. A system using the example method described with respect to FIG. 6B may determine one or more movements of the eye 122. For example, the system may track the eye 122 and / or the suction ring 140.
[0082] One or more of the methods and / or processing elements and / or one or more portions of the methods and / or processor elements may be performed in various orders, repeated, or omitted. Furthermore, additional, supplementary, and / or redundant method and / or processing elements may be implemented, instantiated, and / or performed as desired. Furthermore, one or more system elements may be omitted and / or additional system elements may be added as desired.
[0083] The memory medium may be and / or include an article of manufacture. For example, the article of manufacture may include and / or be a software product and / or program product. The memory medium may be encoded and / or encrypted with processor-executable instructions according to one or more of the flowcharts, systems, methods and / or processes described herein.
[0084] The subject matter disclosed above is illustrative and not limiting, and the appended claims are intended to cover all such modifications, improvements, and other implementations that fall within the true spirit and scope of the present disclosure. Accordingly, to the extent permitted by law, the scope of the present disclosure shall be determined by the broadest possible interpretation of the following claims and equivalents, and shall not be limited or restricted by the above detailed description. According to aspect (1), there is provided a medical system, at least one processor; a display coupled to the at least one processor; and at least one image sensor coupled to the at least one processor; a memory medium coupled to the at least one processor, the memory medium, when executed by the at least one processor, providing the medical system with: acquiring an image of the eye including a pupil having a pupil center via the at least one image sensor; displaying an image of the eye via the display; and determining at least one iris structure from the eye image; determining a position of a suction ring graphic overlay on the image of the eye according to at least one iris structure, the suction ring graphic overlay representing an alignment of the suction ring with respect to the eye as the suction ring moves in a Z direction relative to the eye, the alignment being given as an X position, a Y position and a rotational orientation relative to an optical axis of the suction ring; displaying, via the display, a graphical overlay of the suction ring over the image of the eye as the suction ring moves in a Z direction relative to the eye; determining an incision site for an incision, the incision site having a distance measurement from the center of the pupil; displaying, via the display, a graphic incision overlay indicating the incision site according to the distance measurements, the graphic incision overlay including an arc, a first line, and a second line, the arc representing the incision, the arc comprising a portion of a circle, the first line representing the distance measurement, the first line extending from a center of the pupil to a first end of the first line located at the distance measurement, the second line representing the distance measurement, the second line extending from the center of the pupil to a second end of the second line located at the distance measurement, the first line located at an angle measurement from at least one iris structure relative to the center of the pupil, and the arc connecting the first end of the first line and the second end of the second line; a memory medium storing instructions for causing the It is a healthcare system that includes According to aspect (2), the instruction is to the medical system: determining a position of the iris of the eye from the image of the eye; displaying, via the display, a graphical overlay of the iris on the image of the eye indicating the location of the iris of the eye; Further carry out the following. According to aspect (3), the instruction is to the medical system: determining an orientation of the eye according to at least one structure of the iris, the orientation of the eye including an x-tilt, a y-tilt, and a rotation of the eye relative to an optical axis of the eye; displaying, via the display, orientation information indicating an orientation of the eye to assist in docking the suction ring to the eye; Further carry out the following. According to aspect (4), the instruction is to the medical system: determining a position of the pupil of the eye from the image of the eye; displaying, via the display, a graphical overlay of the pupil on the image of the eye indicating the position of the pupil of the eye; Further carry out the following. According to aspect (5), there is provided a method, acquiring, via at least one image sensor, an image of the eye including a pupil having a pupil center; displaying an image of the eye via a display; determining, via a processor, at least one iris structure from the eye image; determining a position of a suction ring graphic overlay on the image of the eye according to at least one iris structure, the suction ring graphic overlay representing an alignment of the suction ring with respect to the eye when the suction ring is moved in a Z direction relative to the eye, the alignment being given as an X position, a Y position and a rotational orientation relative to an optical axis of the suction ring; displaying, via the display, a graphical overlay of the suction ring over the image of the eye as the suction ring moves in a Z direction relative to the eye; determining, via the processor, an incision site for making an incision, the incision site having an angle measurement from at least one iris structure relative to a center of the pupil and a distance measurement from the center of the pupil; displaying, via the display, a graphic incision overlay indicating the incision site according to the angle measurements and the distance measurements, the graphic incision overlay including an arc, a first line, and a second line, the arc representing the incision, the arc comprising a portion of a circle, the first line representing the distance measurement, the first line extending from a center of the pupil to a first end of the first line located at the distance measurement, the second line representing the distance measurement, the second line extending from a center of the pupil to a second end of the second line located at the distance measurement, the first line located at the angle measurement from at least one iris structure relative to the center of the pupil, and the arc connecting the first end of the first line and the second end of the second line; The method includes: According to aspect (6), determining a position of the iris of the eye from the image of the eye via the processor; displaying, via the display, a graphical overlay of the iris on the image of the eye indicating the location of the iris of the eye; Further includes: According to aspect (7), the method includes: determining, via the processor, an orientation of the eye according to at least one structure of the iris, the orientation of the eye including a tilt in an x direction, a tilt in a y direction, and a rotation of the eye relative to an optical axis of the eye; displaying, via the display, orientation information indicating an orientation of the eye to assist in docking the suction ring to the eye; Further includes: According to aspect (8), the method includes determining, via the processor, a position of the pupil of the eye from the image of the eye; displaying, via the display, a graphical overlay of the pupil on the image of the eye indicating the position of the pupil of the eye; Further includes:
Claims
1. 1. A health care system comprising: at least one processor; a display coupled to the at least one processor; at least one image sensor coupled to the at least one processor; a memory medium coupled to the at least one processor, the memory medium, when executed by the at least one processor, providing the medical system with: acquiring an image of the eye including a pupil having a pupil center via the at least one image sensor; displaying an image of the eye via the display; and determining at least one iris structure from the eye image; determining a position of a suction ring graphic overlay on the image of the eye according to at least one iris structure, the suction ring graphic overlay representing an alignment of the suction ring with respect to the eye as the suction ring moves in a Z direction relative to the eye, the alignment being given as an X position, a Y position and a rotational orientation of the suction ring relative to an optical axis; displaying, via the display, a graphical overlay of the suction ring over the image of the eye as the suction ring moves in a Z direction relative to the eye; determining an incision site for an incision, the incision site having a distance measurement from the center of the pupil; displaying, via the display, a graphic incision overlay indicating the incision site according to the distance measurements, the graphic incision overlay including an arc, a first line, and a second line, the arc representing the incision, the arc comprising a portion of a circle, the first line representing the distance measurement, the first line extending from a center of the pupil to a first end of the first line located at the distance measurement, the second line representing the distance measurement, the second line extending from the center of the pupil to a second end of the second line located at the distance measurement, the first line located at an angle measurement from at least one iris structure relative to the center of the pupil, and the arc connecting the first end of the first line and the second end of the second line; a memory medium storing instructions for causing the Healthcare systems, including:
2. The instructions may include: determining a position of the iris of the eye from the image of the eye; displaying, via the display, a graphical overlay of the iris on the image of the eye indicating the location of the iris of the eye; The medical system of claim 1 , further comprising:
3. The instructions may include: determining an orientation of the eye according to at least one iris structure, the orientation of the eye including an x-tilt, a y-tilt, and a rotation of the eye relative to an optical axis of the eye; displaying, via the display, orientation information indicating an orientation of the eye to assist in docking the suction ring to the eye; The medical system of claim 1 , further comprising:
4. The instructions may include: determining a position of the pupil of the eye from the image of the eye; displaying, via the display, a graphical overlay of the pupil on the image of the eye indicating the position of the pupil of the eye; The medical system of claim 1 , further comprising:
5. A method for operating a medical system, comprising: acquiring, by at least one image sensor of the medical system, an image of the eye including a pupil having a pupil center; a display of the medical system displaying an image of the eye; a processor of the medical system determining at least one iris structure from the eye image; determining, by the processor, a position of a suction ring graphic overlay on the image of the eye according to at least one iris structure, the suction ring graphic overlay representing an alignment of the suction ring with respect to the eye as the suction ring moves in a Z direction relative to the eye, the alignment being given as an X position, a Y position and a rotational orientation of the suction ring relative to an optical axis; the display displaying a graphical overlay of the suction ring over the image of the eye as the suction ring moves in a Z direction relative to the eye; determining an incision site for an incision, the incision site having an angle measurement from at least one iris structure relative to a center of the pupil and a distance measurement from the center of the pupil; displaying, on the display, a graphic incision overlay indicating the incision site according to the angle measurement and the distance measurement, the graphic incision overlay including an arc, a first line, and a second line, the arc representing the incision, the arc comprising a portion of a circle, the first line representing the distance measurement, the first line extending from a center of the pupil to a first end of the first line located at the distance measurement, the second line representing the distance measurement, the second line extending from a center of the pupil to a second end of the second line located at the distance measurement, the first line located at the angle measurement from at least one iris structure relative to the center of the pupil, and the arc connecting the first end of the first line and the second end of the second line; A method comprising:
6. The method of claim 1, further comprising: determining a position of the iris of the eye from the image of the eye; the display displaying a graphical overlay of the iris on the image of the eye indicating the location of the iris of the eye; The method of claim 5 further comprising:
7. The processor determining an orientation of the eye according to at least one structure of the iris, the orientation of the eye including an x-tilt, a y-tilt and a rotation of the eye relative to an optical axis of the eye; the display displays orientation information indicating an orientation of the eye to assist in docking the suction ring to the eye; The method of claim 5 further comprising:
8. The method of claim 7, further comprising: determining a position of the pupil of the eye from the image of the eye; the display displaying a graphical overlay of the pupil on the image of the eye indicating the position of the pupil of the eye; The method of claim 5 further comprising:
Citation Information
Patent Citations
Method and apparatus for superimposing multiple levels of eyeballs
JP2014504177A
Image-based guidance system for eye docking using position and orientation analysis
JP2014525286A
Ophthalmic laser surgical equipment
JP2015195921A
Surgery system, image processing device, and method
JP2016214781A
Corneal Topography Measurement and Alignment for Corneal Surgical Procedures
JP2016520362A