Testing and Calibrating Automated Ophthalmic Surgery Systems
A card-based calibration method for automated ophthalmic surgical systems addresses accuracy issues by simulating eye patterns and intensities, ensuring precise beam targeting and verification, thereby improving the reliability of these systems.
Patent Information
- Application Number
- JP2024532701
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-12-05
- Filing Date
- 2022-12-01
- Publication Date
- 2024-12-03
AI Technical Summary
Existing automated ophthalmic surgical systems face challenges in accurately identifying and directing radiation beams to target points on the eye, necessitating a calibration method that can accommodate typical beam patterns and intensities while simulating the eye's appearance.
A card configured to undergo transformation at the point of radiation impact, such as color change or hole formation, is used for testing and calibration, along with a controller to direct beams to target points on the card, simulating an eye's pattern and intensity, and a jig for moving the card during image acquisition.
The system ensures accurate calibration of beam directing elements and image processing, allowing for precise targeting and verification of beam placement, enhancing the reliability of automated ophthalmic surgical systems.
Smart Images

Figure 2024544657000001_ABST
Abstract
Description
[Technical field]
[0001] [CROSS-REFERENCE TO RELATED APPLICATIONS] This application claims the benefit of U.S. Provisional Application No. 63 / 286,048, filed December 5, 2021, the disclosure of which is incorporated herein by reference.
[0002] The present invention relates to automated laser eye surgery, such as automated trabeculoplasty, iridotomy, and capsulotomy procedures. [Background technology]
[0003] Co-assigned U.S. Patent 11,382,794 to Sacks et al. describes a system that includes a radiation source and a controller. The controller is configured to display a live sequence of images of the patient's eye and, while displaying the sequence of images, cause the radiation source to illuminate the eye with one or more aiming beams visible in the images. The controller is further configured to receive a confirmation input from the user following causing the radiation source to emit the aiming beam at the eye, and in response to receiving the confirmation input, treat the eye by causing the radiation source to emit a plurality of treatment beams at each of the target regions of the eye.
[0004] Co-assigned joint U.S. application publication 2022 / 0125641 with Sacks and Belkin describes a system that includes a laser configured to irradiate a target site within the iris of an eye, and a system that includes a controller. The controller is configured to identify, within the one or more images of at least a portion of the iris, an indication of fluid flow through the target region, and in response to identifying the indication, prevent the laser from further irradiating the target region.
[0005] Co-assigned, joint international patent application publication WO / 2022 / 018525 with Sacks and Belkin describes a system that includes a radiation source and a controller. The controller is configured to define a treatment zone on the object's eye capsule by irradiating a plurality of target areas within the treatment zone in an iterative procedure that includes acquiring images of at least a portion of the capsule during each one of a plurality of iterative procedures, designating one of the target areas based on the acquired images, and causing the radiation source to irradiate the designated target area, forming an opening in the capsule, and thereafter defining the treatment zone.
[0006] U.S. Patent 7,456,949 describes a method, system, and apparatus for a laser ablation system, such as an excimer laser system, for selectively ablating the cornea of a patient's eye and facilitating alignment of an eye-tracking camera that measures eye position during laser eye surgery. A calibration and alignment fixture for a scanning laser beam delivery system with an eye-tracking camera can include structures positionable within the treatment plane. The structure has features for directing laser energy incident thereon to a calibrated energy sensor, at least one reference end for determining characteristics (shape, dimensions, etc.) of the laser beam, and an artificial pupil for determining the alignment of the eye-tracking camera and laser system. Summary of the Invention [Means for solving the problem]
[0007] According to some embodiments of the invention, there is provided a system including a radiation source configured to emit a beam of radiation, one or more beam directing elements configured to direct the beam, a card configured to undergo a transformation at a site on the card where the beam impinges, a camera configured to capture one or more images of the card, and a controller. The controller is configured to process the image and control the beam directing element to direct the beam to one or more target points within the field of view (FOV) of the camera in response to processing of the image, thereby causing the appearance of the card to change at one or more illumination positions on the card.
[0008] In some embodiments, the card comprises a polymer.
[0009] In some embodiments, the card comprises transparent glass.
[0010] In some embodiments, the card includes luminescent material configured to undergo a transformation by emitting light in response to a radiation beam.
[0011] In some embodiments, the transformation comprises a change in color.
[0012] In some embodiments, the card includes a photosensitive dye configured to change color in response to a radiation beam.
[0013] In some embodiments, the card includes a temperature sensitive material configured to undergo a color change in response to being heated with the radiation beam.
[0014] In some embodiments, the card is configured to undergo force-induced transformations at the sites where the beams form their respective holes.
[0015] In some embodiments, the controller is further configured to move the camera between capture of the images relative to the card.
[0016] In some embodiments, the system further includes a jig configured to move the camera between captures of the images relative to the card.
[0017] In some embodiments, the system further comprises: An optical unit; An XYZ stage unit having a control mechanism, The optical unit contains the camera and is fixed on an XYZ stage unit during image acquisition, with the aid of a control mechanism so that it can be moved by the user.
[0018] In some embodiments, the card includes one or more markings, and for each image, the controller: Identifying at least one marking in the image; In response to identifying the at least one, the beam steering element is configured to control.
[0019] In some embodiments, for each image, the controller is configured to control the beam directing element to direct one of the respective beams at one of the identified markings.
[0020] In some embodiments, the markings include iris-shaped markings that simulate a human iris in shape, and for each image, the controller: Identify iris-shaped markings in the image, Calculating a respective one of the target points with reference to the iris shape markings; The beam steering elements are configured to control the beam steering elements to direct one of the respective beams at one of the calculated target points.
[0021] In some embodiments, the background of the card surrounding the iris shaped marking has the appearance of a background; At at least one location along the circumference of the iris-shaped marking, the transition between the appearance of the background and the appearance of the iris-shaped marking occurs by at least 0.1 mm.
[0022] In some embodiments, the background of the card surrounding the iris shaped marking has the appearance of a background; At at least one location along the circumference of the iris-shaped marking, the transition between the appearance of the background and the appearance of the iris-shaped marking occurs by less than 0.1 mm.
[0023] In some embodiments, the controller further comprises: Identifying the location of the illumination in another image of the card; Calculating a distance between one of the irradiation locations and a target point at which the beam impinging on the irradiation location is detected in response to identifying the irradiation locations; Communicate output according to distance It is configured as follows.
[0024] In some embodiments, the controller further comprises: displaying another image of the card with one or more superimposed target markers prior to controlling the beam steering element; receiving, from a user, position-specific adjustments of the overlaid target markers; Define the target point according to the position to be adjusted It is configured as follows.
[0025] In some embodiments, the controller is further configured to display another image of the card showing the illumination location, with one or more superimposed target markers at the target points.
[0026] In some embodiments, the card comprises an iris-shaped marking that simulates a human iris in terms of shape; The superimposed target markers include an arc-shaped target marker that surrounds the iris-shaped marking and passes through the target point.
[0027] According to some embodiments of the present invention, coupling a card to a jig configured to undergo a transformation at a site on the card where the beam of radiation impinges; inputting commands into the controller, the controller initiating a test process while processing one or more images of the card acquired by the camera while the card was docked to the jig, and, in response to processing of the images, controlling one or more beam directing elements to direct a beam to one or more target points within a field of view (FOV) of the camera, thereby causing an appearance of the card to change at one or more illumination locations on the card. Further provided is a method comprising:
[0028] The present invention will become more fully understood from the detailed description of the embodiments taken in conjunction with the drawings, in which: [Brief description of the drawings]
[0029] [Figure 1] FIG. 1 is a schematic diagram of an ophthalmic surgical system, according to some embodiments of the present invention. [Diagram 2] FIG. 2 is a schematic diagram of a card according to some embodiments of the present invention. [Diagram 3] FIG. 3 is a schematic diagram of a card-holding jig according to some embodiments of the present invention. [Figure 4] FIG. 4 is a schematic diagram of an image for use in target point definition according to some embodiments of the present invention. [Diagram 5] FIG. 5 is a schematic diagram of an image showing illumination positions on a card, according to some embodiments of the present invention. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0030] [overview]
[0031] Some automated ophthalmic surgery systems, such as those described in the co-assigned patents and publications cited in the Background section, include a controller configured to process an image of the eye to identify a target point on the eye and to direct a radiation beam to the identified target point. For such systems, it can sometimes be important to test the accuracy with which the target point is identified and the radiation beam is detected. If the accuracy is insufficient, the system may require calibration.
[0032] Hypothetically, the beam profiler can be used for testing and calibrating the system. However, the beam profiler may be too small to accommodate the typical patterns of target points that are illuminated during a surgical procedure. Alternatively or additionally, the beam profiler may not be able to accommodate the typical intensity of the radiation beam. Furthermore, the appearance of a beam profiler can be very different from the appearance of the eye, such that a beam profiler may not facilitate adequate testing of the image processing functionality of the controller.
[0033] Thus, an embodiment of the present invention provides a card for use in testing and calibrating an automated ophthalmic surgical system. The card is configured to undergo a transformation of a site on the card where it is impinged by the beam of radiation; for example the beam can change the color of the card or create a hole in the card. Hence, after illumination of one or more sites on the card, it can be verified (automatically or manually) whether these sites coincide with the intended target points. If not, the system can be calibrated by iteratively adjusting the system and repeating the test (using one or more additional cards, if necessary) until the desired accuracy is achieved.
[0034] Advantageously, the card can contain typical patterns of target points and typical beam intensities. Additionally, the card may include a simulated iris and, optionally, a simulated eyelid, so that the image on the card may appear similar to an image of an eye. Thus, in testing the accuracy of the system, a simulated surgical procedure can be performed on the card, with the card being the eye.
[0035] [System Description]
[0036] Reference is initially made to FIG. 1, which is a schematic illustration of an ophthalmic surgical system 20, in accordance with some embodiments of the present invention.
[0037] The system 20 includes a radiation source 48 configured to emit a radiation beam 52 . For example, radiation source 48 may include a laser configured to emit a beam of laser radiation, such as a frequency-doubled passively or actively Q-switched Nd:YAG laser. Alternatively or in addition to a laser, the radiation source may include an array of light emitting diodes (LEDs), an array of laser diodes, and / or an electric flash lamp.
[0038] In some embodiments, beam 52 comprises visible light. Alternatively or additionally, the beam may comprise invisible electromagnetic radiation, such as microwave radiation, infrared radiation, x-ray radiation, gamma radiation, or ultraviolet radiation. In some embodiments, the wavelength of the beam is between 200 and 11000 nm, such as 500 to 850 nm, such as 520 to 540 nm, for example 532 nm. Typically, the energy of each beam is between 0.1 and 4 mJ, such as between 0.3 and 2.6 mJ. The spatial profile of each beam can be elliptical (eg, circular), rectangular, or any other suitable shape. The intensity profile of each beam can be Gaussian, super-Gaussian, or top-hat along any one or more beam cross sections.
[0039] System 20 further includes one or more beam directing elements 49 configured to direct the radiation beam. Beam directing element 49 may include, for example, one or more galvo mirrors 50 and / or a beam combiner 56, which may be collectively referred to as a "galvo scanner." Each beam may be deflected from galvo mirror 50 towards beam combiner 56 and then from the beam combiner along beam path 92 .
[0040] The system 20 further includes a controller 44 and a camera 54 . Controller 44 is configured to process images acquired by camera 54 and control beam directing element 49 accordingly to direct beam 52 towards any desired target point within the camera's field of view (FOV). In particular, before and / or while each beam 52 is emitted from the radiation source 48, the controller 44 may adjust the position, orientation, size, and / or shape of one or more beam directing elements such that the beam directing elements direct the beam to a desired target point.
[0041] Generally, the camera 54 may include one or more image sensors of any suitable type(s), such as a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor, an optical coherence tomography (OCT), and / or a hyperspectral image sensor. Using the sensor, the camera can acquire any suitable type of two-dimensional or three-dimensional image, such as a monochrome image, a color image (e.g., based on a three-color frame), a multispectral image, a hyperspectral image, an optical coherence tomography (OCT), or an image generated by combining multiple images of different types.
[0042] In some embodiments, the camera is positioned behind the beam combiner 56 such that the camera receives light through the beam combiner. In another embodiment, the camera is offset from the beam combiner.
[0043] Typically, the system 20 comprises a radiation source 48 , a camera 54 , and an optical unit 30 having a beam directing element 49 . Typically, the optical unit 30 includes an optical bench, with the radiation source and the beam directing elements being coupled to the optical bench. The optical unit 30 further includes a front surface 33 that is shaped to define an aperture 58, or output window, through which the beam 52 is directed. For example, the optical unit 30 may have a housing 31 that encases at least a portion of the optical bench and includes a front surface 33 . Alternatively, the front surface 33 can be attached to or be an integral part of the optical bench.
[0044] Typically, the optical unit 30 is mounted on an XYZ stage unit 32 that includes a control mechanism 36, such as a joystick, that allows a user of the system 20 to adjust the position and orientation of the optical unit.
[0045] For example, the XYZ stage unit 32 can include one or more motors 34 and a control mechanism 36 can be connected to interface circuitry 46 . When a user operates the controls, interface circuitry 46 can convert this action into appropriate signals and output these signals to controller 44 . In response to the signal, the controller can control the motor 34 . Alternatively, the XYZ stage unit 32 can be manually controlled by manipulation of a control mechanism; in such an embodiment, the XYZ stage unit can include a set of gears and rollers instead of the motors 34 .
[0046] In some embodiments, the optical unit 30 further includes a light source 66 configured to function as a fixed target 64 by transmitting visible fixed light 68 . The light source 66 may include a light emitter, such as a light emitting diode (LED), or a reflector configured to reflect light emitted from the light emitter.
[0047] In some embodiments, the optical unit 30 can further include one or more illumination sources 60, including, for example, one or more LEDs, such as white light or infrared LEDs. In such an embodiment, controller 44 can cause illumination source 60 to flash while camera 54 is capturing images, thereby facilitating image capture. (In FIG. 1, for simplicity of illustration, electrical connections between controller 44 and illumination source 60 are not explicitly shown.) As shown in FIG. 1, illumination source 60 can be disposed, for example, in a ring surrounding aperture 58 and can be coupled to front surface 33 .
[0048] To facilitate positioning of the optical unit, the optical unit may further include multiple beam emitters 62 (e.g., including respective laser diodes) configured to emit multiple triangulation distance beams, for example, as described in U.S. Patent No. 11,382,794 to Sacks et al., the disclosure of which is incorporated herein by reference. As shown in FIG. 1, the beam emitter 62 can be coupled to the front surface 33 .
[0049] Typically, the system 20 further includes a display 42 configured to display images acquired by the camera and / or other output. The display 42 may be attached to the optical unit 30 or reside in a separate device, such as a computer monitor, and may be located in any suitable location.
[0050] In some embodiments, the display 42 includes a touch screen through which a user inputs commands to the system. Alternatively, or in addition, the system 20 may include any other suitable input device, such as a keyboard or a mouse.
[0051] In some embodiments, the display 42 is directly connected to the controller 44 through a wired or wireless communication interface. In other embodiments, display 42 connects to controller 44 through an external processor, such as a processor found in a standard desktop computer.
[0052] In some embodiments, as shown in FIG. 1, the controller 44 is located within the XYZ stage unit. In another embodiment, the controller 44 is located external to the XYZ stage unit. Alternatively or additionally, the controller may perform at least some of the functionality described herein in cooperation with another external processor.
[0053] The system 20 further includes a card 22 . At any suitable interval (e.g., once a day prior to the day any surgical procedure is performed), card 22 can be used for test procedures for calibration of beam directing element 49 and verification of image processing functionality of controller 44, as will be further described below with reference to the following drawings.
[0054] Prior to the test procedure, the user couples the card 22 to the jig 24 . The user then initiates a test process, for example by touching or clicking a button 43 displayed on the display 42, or by entering a command in any other manner into the controller 44, so that the controller 44 performs the test process while the card is held by the jig.
[0055] In some embodiments, as shown in FIG. 1, the jig 24 and the XYZ stage unit 32 are both fixed onto a surface 38 as a tray or top plate. In another embodiment, the XYZ stage unit is fixed to the surface 38 and the jig is attached to the XYZ stage unit.
[0056] In some embodiments, the jig 24 is stationary. For example, the jig 24 can have a head rest 25 that includes a forehead rest 26 and a chin rest 28 on which the patient rests his or her head during a surgical procedure. During the testing process, the card 22 can be secured to a head rest 25, for example a forehead rest 26, as shown in FIG.
[0057] In other embodiments, the jig 24 is not stationary, as will be further explained below with reference to FIG.
[0058] Typically, during the test procedure, the card is spaced from the radiation source such that the spot size dimension (eg diameter) of each beam 52 on the card is between 0.3 and 0.5 mm. As noted below with reference to FIG. 3, the distance from the radiation source to the card can be varied during the test process.
[0059] In some embodiments, at least some of the functionality of controller 44 as described herein is implemented in hardware, for example using one or more fixed function or general purpose integrated circuits, application specific integrated circuits (ASICs), and / or programmable gate arrays (FPGAs). Alternatively or additionally, the controller 44 may implement at least some of the functionality described herein by executing software and / or firmware code. For example, the controller 44 may be embodied as a programmed processor, including, for example, a central processing unit (CPU) and / or a graphics processing unit (GPU). Program code and / or data, including software programs, can be loaded for execution and processing by the CPU and / or GPU. Program code and / or data may be downloaded to the controller in electronic form, for example over a network. Alternatively or additionally, the program code and / or data may be provided on and / or stored on a non-transitory tangible medium, such as magnetic, optical or electrical memory. Such program code and / or data, when provided to a controller, is configured to cause a machine or special purpose computer to perform the tasks described herein.
[0060] In some embodiments, the controller includes a system-on-module (SOM), such as the Varisite® DART-MX8M.
[0061] [card]
[0062] Reference is now made to FIG. 2, which is a schematic diagram of a card 22, according to some embodiments of the present invention.
[0063] Card 22 is configured to undergo a temporary or permanent transformation at the site of the card where beam 52 (FIG. 1) impinges.
[0064] In some embodiments, the transformation comprises a change in color. For example, the card may change color by undergoing a chemical reaction or by any of the other mechanisms described below. Alternatively or additionally, the card may include a photosensitive dye configured to undergo a color change in response to the radiation beam. The pigments can be integrated into the material of the card or coated onto the material.
[0065] In another embodiment, the card is configured such that the beams at the sites undergo deformation due to a force that forms the respective holes.
[0066] In some embodiments, card 22 comprises transparent glass or a polymer such as acrylonitrile butadiene styrene (ABS), polyethylene, or polyvinyl chloride (PVC). In such embodiments, the transformation is typically due to a chemical reaction caused by the radiation beam. Chemical reactions can include, for example, pyrolysis, foaming, bleaching, carbonization, or the formation of microcavities by photoablation (for transparent glass or transparent polymers).
[0067] In other embodiments, the card includes a temperature sensitive material, such as liquid crystal or thermal paper, that is configured to change color in response to being heated with a radiation beam.
[0068] In yet other embodiments, the card includes a luminescent material configured to undergo a transformation by emitting light in response to a radiation beam (eg, via fluorescence or multiphoton absorption). For example, the card may be constructed of materials found in ultraviolet (UV) or infrared (IR) laser sensor cards.
[0069] The card may be rectangular or may have any other suitable shape. Typically, the surface area of the card is between 50 and 150 cm 2 It is between. For example, for a rectangular card, the length of the card can be between 8 and 10 cm and the width of the card can be between 6 and 9 cm. Typically the thickness of the cards is between 0.01 and 1 mm.
[0070] During the test process, the camera 54 (FIG. 1) is focused on the card so that the camera's FOV 72 includes at least a portion of the card. In response to processing images of the card captured by the camera, controller 44 (FIG. 1) identifies one or more target points 74 within FOV 72. For each target point 74, the controller controls the beam directing element 49 (FIG. 1) to direct the radiation beam to the target point, which causes the appearance of a change in the card at an illumination location 76 on the card. (Typically, the size of each illumination location 76 is within ±10% of the spot size of the beam on the card.) Typically, at any given time during the test process, the FOV 72 includes all illumination locations 76 created up to the given time.
[0071] As described above with reference to FIG. 1, the card 22 can be fixed onto the head rest 35 during the testing process. For example, the card 22 can be shaped to define one or more holes 40, and the forehead rests 26 can each include a knob 70 configured to fit through the holes 40 to retain the card in the headrest. Alternatively, the card can be coupled to the forehead rest, or any other portion of the head rest, by any other coupling mechanism, such as a clip, magnet, hook and loop fastener, etc.
[0072] Typically, the card 22 includes one or more markings 78 for testing the image processing functionality of the controller, for example by functioning as a target or as an iris simulator, as will be explained immediately below. In some embodiments, the markings 78 are printed on the background 86 . In other embodiments, the marking comprises a sticker that is applied onto the background.
[0073] For each image processed by the controller, the controller identifies at least one marking 78 within the image and controls the beam steering elements in response to the identification of the marking.
[0074] For example, for each processed image, the controller can control the beam directing element to direct the beam at one of the identified markings. In other words, the markings can act as targets for the controller. If the illumination location 76 coincides with a marking, the controller can be sure that it processes the image appropriately and the beam directing elements are properly calibrated. (Typically, in such an embodiment, the markings 78 are much smaller than those shown in FIG. 2; for example, the size of each marking can be approximately the same as the spot size of each beam on the card.)
[0075] Alternatively or additionally, as shown in FIG. 2, the markings 78 may include an iris and, optionally, an iris-shaped marking 80 that simulates the periphery of a human eye, as described further below. For each image processed, the controller can identify an iris-shaped marking 80 within the image and then calculate one of the target points 74 by reference to the iris-shaped marking (i.e., calculate the respective coordinates of one of the target points within the FOV 72). For example, the controller can identify an edge 82 of the iris-shaped marking using any suitable edge detection algorithm, can calculate the coordinates of a center point 84 at the center of the edge 82, and can then calculate the target point by adding a predetermined offset to point 84. The controller can then control the beam directing elements to direct the beam to the calculated target point. If the resulting illumination position 76 coincides with the target point, it can be confirmed that the beam directing element is correctly calibrated. Additionally, if the target point appears in the correct position relative to the iris-shaped markings, the controller can be sure to process the image appropriately.
[0076] The iris-shaped markings 80 simulate in shape the human iris. For example, the iris-shaped marking can be an ellipse (for such an embodiment, the lengths of the major and minor axes of the iris-shaped marking can be within 10% of each other, e.g., the lengths can be equal to each other such that the iris-shaped marking is circular). Alternatively, the shape of the iris-shaped markings may deviate from an ellipse, and the magnitude of the deviation may be within the range of deviations exhibited by human irises.
[0077] Additionally, the iris-shaped markings can simulate an iris in terms of size. For example, for an ellipse, the length of the major axis of the iris-shaped marking (or diameter, in the case of a circle) may be between 8 and 13 mm.
[0078] Alternatively or additionally, the iris-shaped marking 80 may simulate an iris in terms of color. Additionally, the background 86 of the card surrounding the iris-shaped markings can be colored white to simulate a sclera.
[0079] Alternatively, the color of the iris-shaped markings can be different from the iris and / or the color of the background 86 can be different from the sclera.
[0080] For example, in some embodiments, the controller processes only a single frame of an image, such as a red ("R") frame. In such an embodiment, even colors that are dissimilar to the iris and sclera can be selected and provided that the pixel values of the processed frame resemble those that appear in the processed frame of the image of the eye. For example, colors may be selected such that in a frame being processed, the background pixel value is between 105 and 145 (the maximum pixel value is 255) and / or the iris-shaped marking pixel value is between 40 and 60, regardless of the pixel values in other frames.
[0081] Alternatively, even the pixel values in the processed frame may not resemble those that appear in the processed frame of the eye image. For example, the iris shaped markings may be colored black, such that the pixel values of the iris shaped markings are approximately zero.
[0082] In some embodiments, to enhance testing of the image processing functionality of the controller, the iris-shaped markings 80 also simulate the edge of the eye. In particular, at at least one location along the circumference of the iris-shaped marking (e.g., along the entire circumference), the transition between the appearance of the background 86 and the appearance of the iris-shaped marking (e.g., the transition between the color and / or brightness of the background and the color and / or brightness of the iris-shaped marking) is relatively gradual. For example, the transition may occur over a distance d1 of at least 0.1 mm, such as between 0.1 and 4 mm. In some embodiments, the gradual transition is achieved by grayscale printing of the iris-shaped markings.
[0083] In some embodiments, typically the controller identifies a closed curve 88 that passes through the points of maximum gradient in the image and calculates the edges 82 by smoothing the curve 88 or by fitting a predefined shape (e.g., an ellipse, such as a circle) to the curve 88.
[0084] Alternatively or additionally, to help model extreme cases, the transition is relatively abrupt at least at one location along the circumference of the iris-shaped marking, for example the transition may occur by less than 0.1 mm.
[0085] Alternatively or in addition to a simulated periphery, other features of the iris-shaped marking 80 may enhance the similarity of the iris-shaped marking to the iris. Such features may include, for example, a simulated pupil at the center of the iris-shaped marking and / or a simulated blood vessel passing through the iris-shaped marking.
[0086] As mentioned above, the card 22 may include a number of markings 78 . For example, a card may include multiple iris-shaped markings 80 so that the card can be used for multiple test procedures.
[0087] In some embodiments, before firing each beam 52 at the target point, the controller causes the radiation source to fire an aiming beam at the target point. Due to the fact that the aiming beam differs from beam 52 in terms of wavelength and / or intensity, it does not cause a change in the appearance of the card; rather, it simply reflects off the card. By processing the image of the card into a reflective configuration, the controller verifies that the reflection is approximately the location of the target point. In response to this verification, the controller emits the beam 52 .
[0088] Alternatively or additionally, prior to firing each beam 52, the controller may process a feedback signal from at least one encoder of the beam directing element. In response to verifying, based on the feedback signal, the beam directing elements are properly positioned, oriented, sized and shaped, the controller can emit the beam 52 .
[0089] Reference is now made to FIG. 3, which is a schematic diagram of a jig 24 holding a card 22, according to some embodiments of the present invention.
[0090] In some embodiments, the jig 24 is not stationary, but is configured to move the card relative to the camera (eg, to simulate eye movement) between capture of images by the camera. This movement, which can have up to six degrees of freedom, causes the marking 78 (Figure 2) to move and / or change size within the FOV 72, thus further testing the image processing functionality of the controller by requiring the controller to track the movement of the marking. For example, the jig 24 may include a stage 90 configured to move along a stationary platform 91 while holding a card.
[0091] For embodiments in which the jig 24 is stationary (e.g., as in Figures 1 and 2), the controller can be configured to move the camera relative to the card - for example, by controlling the motor 34 (Figure 1) to move the optical unit 30 relative to the card - between capture of images by the camera. Alternatively, the control mechanism 36 allows the user to move the optical unit between image captures. In any case, movement of the camera with respect to the card, which can have up to six degrees of freedom, causes the markings to move and / or change size within the FOV 72, thereby testing the image processing functionality of the controller.
[0092] [Goal definition]
[0093] Typically, at the start of a test process, the controller calculates a number of target points. In some embodiments, the target points are positioned along an arcuate trajectory, such as an elliptical (eg, circular) trajectory.
[0094] As discussed above with reference to FIG. 2, in some embodiments, the card 22 includes markings 78 that function as targets. In some embodiments, each target point 74 (FIG. 2) is defined by the controller as a point within a certain FOV 72 at which a marking is placed.
[0095] In another embodiment, each target point is calculated by the controller by adding a predefined offset to a reference point, such as center point 84, which is located using image processing. By the method of the example, the controller calculates K target points placed along a circular trajectory, each kth coordinate (x0(t)+Rcosθ k ,y0(t)+Rsinθ k ) can be calculated. where x0(t) and y0(t) are the x and y coordinates of a reference point within the camera's FOV, R is the radius of the predefined circular orbit, θ k = 2πk / K (k = 0 K-1) It is. (The coordinates of the reference points are expressed as a function of time, and these given coordinates can change due to movement of the card or the camera.)
[0096] In such an embodiment, the offset may be predefined by the controller. For example, for a circular trajectory of the target point, the controller can define variables R and K that determine the offset.
[0097] Alternatively, the offset can be defined by the user prior to the test process. In this regard, reference is made to FIG. 4, which is a schematic illustration of an image 94 of a card 22 acquired by camera 54 (FIG. 1) for use in determining target points, in accordance with some embodiments of the present invention.
[0098] In some embodiments, prior to the test process, the controller displays (eg, on display 42 (FIG. 1)) an image 94 with one or more superimposed target markers 96 marking potential locations of target points. The controller then receives from the user any desired adjustments for each position of the superimposed target marker.
[0099] For example, the controller may overlay a single continuous target marker that marks along the possible trajectory where the aim point may be placed. As a particular example, for embodiments in which the card 22 includes an iris-shaped marking 80, the overlaid target marker 96 may include an arc-shaped (e.g., elliptical, such as circular) target marker 98 that surrounds the iris-shaped marking 80 at a predefined distance from an end of the iris-shaped marking. Using either a mouse or other suitable input device, a user can adjust this distance, for example, by dragging a corner 100 of a rectangle (eg, square) 102 to circumscribe the target marker 98 .
[0100] Optionally, the user can set multiple target points, for example K as described above.
[0101] After defining the offset (and, optionally, setting the number of target points), the user initiates the test process. The controller then defines target points according to the adjusted position of the target marker 96 (and, optionally, according to the desired number of target points). For example, based on the adjusted position of the circular target marker 98, the controller can calculate R as the distance from the target marker 98 to the center point 84, and use R to calculate the coordinates of each of the target points described above.
[0102] [Evaluation of test results]
[0103] Referring again to FIG.
[0104] In some embodiments, following firing of one or more beams at card 22, the controller identifies an illumination location 76 within an image of the card acquired by the camera. In response to identifying the hit locations, the controller calculates the distance d2 between one of the hit locations and the corresponding target point 74, ie, the detected target point of the beam impinging on the hit location.
[0105] For example, using a spot detection algorithm, the controller can detect the center of the illumination location. Alternatively, the controller can detect the edges of the illumination location and then calculate the center based on the edges. In addition, the controller can process the image to identify the current coordinates (x0', y0') of a reference point, such as center point 84. Then, based on the coordinates of the reference point, the controller can calculate the current coordinates of the target point where the beam is detected. For example, for a circular target trajectory, the controller calculates Rcosθ at x0'. k y0' to Rsinθ k can be added. The controller can then calculate the distance d2 between these latter coordinates and the center of the hit position.
[0106] In response to distance d2 (and, optionally, at least one such additional distance), the controller communicates with the output, for example, by displaying an appropriate message on display 42 (FIG. 1). For example, the controller may compare d2 (or a statistical value, such as the average or maximum, of multiple such distances for multiple illumination positions) to a predefined threshold. If d2 (or a statistical value) exceeds a threshold, the controller can communicate an output (eg, display a message) indicating that the beam directing elements should be calibrated before a surgical procedure is performed.
[0107] In other embodiments, a user manually evaluates the test results. In this regard, reference is made to FIG. 5, which is a schematic illustration of an image 104 showing an illumination location 76 on a card 22, in accordance with some embodiments of the present invention.
[0108] In some embodiments, the controller is configured to display (e.g., on display 42 (FIG. 1)) an image 104 captured by the camera at the target point and showing the illumination location 76, along with one or more overlaid target markers 96. (In other words, the target markers 96 are overlaid with the current coordinates of the target point within the camera's FOV.) For example, the controller may overlay a single continuous target marker 98 that passes through each of the aim points. As a particular example, for an embodiment in which the card 22 includes an iris-shaped marking 80, the superimposed target marker 96 may include an arc-shaped (e.g., circular) target marker 98 that surrounds the iris-shaped marking 80 and passes through the target point. In other words, the aim points may be placed along an arcuate (eg, circular) trajectory that surrounds the iris-shaped marking 80, and the target markers 98 may mark this trajectory.
[0109] Upon display of image 104, the user can ascertain whether corrections are required in the image processing of the controller by comparing the positions of the target markers 96 with the predicted positions of these target markers. For example, if all target points were supposed to be evenly spaced from the edges of the iris-shaped marking 80, but the target marker 98 is not evenly spaced from the edges (i.e., the center of the target marker 98 does not coincide with the center of the iris-shaped marking), the user can determine that corrections are needed in the image processing.
[0110] In response to displaying image 104, the user may also ascertain whether calibration of the beam steering elements is required. For example, if the illumination position 76 is offset from the target marker 98 as shown in FIG. 5, the user may determine that such calibration is necessary.
[0111] To calibrate the beam directing elements, the user can iteratively adjust one or more relevant parameters of the system (using any number of cards 22 as required) and repeat the test process until the irradiation position matches the target point within a given value of the tolerance.
[0112] For example, for an embodiment in which the beam steering element includes a galvo mirror 50 (FIG. 1), the controller may control a set of voltages, V x and V y , the galvo mirror can be controlled by inputting the following to the mirror, so that the mirror directs the beam to a coordinate (b x +m x *V x ,b y +m y *V y ) to cause where b x ,b y ,m x and m y is a parameter that can be adjusted. During calibration, the user can iteratively adjust any one or more of these adjustable parameters.
[0113] It will be appreciated by persons skilled in the art that the present invention is not limited to what has been particularly shown and described above. Rather, the scope of the present invention includes both combinations and subcombinations of the various features described above, as well as those variations and modifications not in the prior art that may occur to those skilled in the art upon reading the foregoing description.
Claims
1. a radiation source configured to emit a radiation beam; one or more beam steering elements configured to direct the beam; a card configured to undergo a permanent transformation at a site on the card where the beam impinges; a camera configured to capture one or more images of the card; A controller, Processing the image; the controller configured to control the beam directing element in response to processing of the image to direct the beam to one or more target points within a field of view (FOV) of the camera, thereby causing a change in appearance of the card at one or more illumination locations on the card; A system comprising:
2. The card comprises a polymer. The system of claim 1 .
3. The card comprises transparent glass. The system of claim 1 .
4. The transformation includes a change in color. The system of claim 1 .
5. The card includes a photosensitive dye configured to undergo the change in color in response to a radiation beam. The system of claim 4.
6. The card includes a temperature sensitive material configured to undergo the change in color in response to being heated by a radiation beam. The system of claim 4.
7. The card is configured to undergo the transformation by the force of the beam forming a respective hole at the portion. The system of claim 1 .
8. The controller is further configured to move the camera relative to the card between captures of the images. A system according to any one of claims 1 to 7.
9. and a jig configured to move the card relative to the camera between captures of the images. A system according to any one of claims 1 to 7.
10. An optical unit; an XYZ stage unit having a control mechanism, the optical unit including the camera and fixed on the XYZ stage unit so as to be movable between the acquisition of the images by a user using the control mechanism; Further equipped A system according to any one of claims 1 to 7.
11. the card includes one or more markings; For each of the images, the controller: Identifying at least one of the markings within the image; configured to control the beam steering element in response to an identification of the at least one of the markings. A system according to any one of claims 1 to 7.
12. For each of the images, the controller is configured to control the beam directing element to point a respective one of the beams at one of the identified markings. The system of claim 11.
13. the markings include iris-shaped markings that simulate a human iris in shape; For each of the images, the controller: Identifying the iris shaped marking within the image; calculating each one of said target points with reference to said iris-shaped markings; configured to control the beam directing element to direct the beam at a respective one of the calculated ones of the target points. The system of claim 11.
14. a background of the card surrounding the iris-shaped marking has the appearance of a background; At least one location along the circumference of the iris-shaped marking, a transition between the background appearance and the iris-shaped marking appearance occurs by at least 0.1 mm. The system of claim 13.
15. the background of the card surrounding the iris-shaped marking has an appearance background; At least one location along the circumference of the iris-shaped marking, a transition between the background of the feature and the feature in the iris-shaped marking occurs by less than 0.1 mm. The system of claim 13.
16. The controller: Identifying the illumination location in another image of the card; Calculating a distance between one of the irradiation positions and the target point of the beam that impinges on the target point where the irradiation position is detected in response to the identification of the irradiation position; and further configured to communicate an output according to the distance. A system according to any one of claims 1 to 7.
17. The controller: displaying another image of the card with one or more superimposed target markers prior to controlling the beam steering element; receiving from a user an adjustment of a position of each of the superimposed target markers; further configured to define the target point in response to the adjusted position. A system according to any one of claims 1 to 7.
18. The controller is further configured to display, at the target point, another image of the card indicating the illumination location, with one or more superimposed target markers. A system according to any one of claims 1 to 7.
19. The card is an iris-shaped marking that simulates a human iris in terms of shape; an arc-shaped target marker that surrounds the iris-shaped marking and passes through the target point; and a superimposed target marker including: have 20. The system of claim 18.
20. coupling the card to a jig configured to undergo a permanent transformation at a site on the card impinged by a radiation beam; initiating a test process by inputting a command to a controller; Equipped with During the test process, the controller processing one or more images of the card captured by a camera while the card is docked to the jig; In response to processing the image, controlling one or more beam directing elements to direct a beam to one or more target points within a field of view (FOV) of the camera, thereby causing a change in the appearance of the card at one or more illumination locations on the card. method.
21. The card comprises a polymer.
21. The method of claim 20.
22. The card comprises transparent glass.
21. The method of claim 20.
23. The transformation includes a change in color.
21. The method of claim 20.
24. The card includes a photosensitive dye configured to undergo the change in color in response to a radiation beam.
24. The method of claim 23.
25. The card includes a temperature sensitive material configured to undergo the change in color in response to being heated by a radiation beam.
25. The method of claim 24.
26. The card is configured to undergo the transformation by the force of the beam forming a respective hole at the portion.
21. The method of claim 20.
27. During the test process, the controller moves the camera relative to the card between image captures.
27. The method of any one of claims 20 to 26.
28. During the test process, move the card relative to the camera between image captures.
27. The method of any one of claims 20 to 26.
29. the optical unit includes the camera and is fixed on an XYZ stage having a control mechanism; and using the control mechanism to move the optical unit between captures of the images.
27. The method of any one of claims 20 to 26.
30. the card includes one or more markings; For each of the images, the controller: Identifying at least one of the markings within the image; controlling the beam steering element in response to an identification of the at least one of the markings.
27. The method of any one of claims 20 to 26.
31. For each of the images, the controller controls the beam directing element to direct the beam to a respective one of the identified markings.
31. The method of claim 30.
32. the markings include iris-shaped markings that simulate a human iris in shape; For each of the images, the controller: Identifying the iris shaped marking within the image; calculating each one of said target points with reference to said iris-shaped markings; Controlling the beam steering element to direct the beam at each one of the calculated ones of the target points.
31. The method of claim 30.
33. the background of the card surrounding the iris-shaped marking has an appearance background; At least one location along the circumference of the iris-shaped marking, a transition between the background of the feature and the feature in the iris-shaped marking occurs by at least 0.1 mm.
33. The method of claim 32.
34. the background of the card surrounding the iris-shaped marking has an appearance background; At least one location along the circumference of the iris-shaped marking, a transition between the background of the feature and the feature in the iris-shaped marking occurs by less than 0.1 mm.
33. The method of claim 32.
35. The controller: identifying said illumination location within another image of said card during said test process; Calculating a distance between one of the irradiation positions and the target point of the beam that impinges on the target point where the irradiation position is detected in response to the identification of the irradiation position; and communicating with an output according to said distance.
27. The method of any one of claims 20 to 26.
36. adjusting the position of each of the one or more superimposed target markers on another image of the card before starting the test process; During the test process, the controller further comprises defining the target point in response to the adjusted position.
27. The method of any one of claims 20 to 26.
37. During the test process, the controller displays another image of the card, with one or more superimposed target markers, at the target point, showing the illumination location.
27. The method of any one of claims 20 to 26.
38. The card is an iris-shaped marking that simulates a human iris in terms of shape; an arc-shaped target marker that surrounds the iris-shaped marking and passes through the target point; and a superimposed target marker including: have 38. The method of claim 37.
