Method of monitoring an intraocular lens implant and surgical microscope system

Abstract

This disclosure relates to the field of computer technology, and more particularly to a monitoring method and surgical microscope system for intraocular lens (IOL) implantation. The method includes: acquiring real-time eye images and / or OCT scan images of the eye; determining at least one relative positional information between the IOL and the eye based on the eye images and / or OCT scan images, wherein the at least one relative positional information includes the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the IOL, the minimum vertical distance between the lower boundary of the IOL and the upper boundary of the lens, and the angle between the long axis of the IOL and the horizontal line; and issuing an adjustment prompt when the relative positional information exceeds a preset parameter range. This disclosure, by monitoring the implantation position of the IOL during surgery and issuing adjustment prompts when the position is abnormal, can reduce the possibility of requiring a second surgery due to abnormal IOL position after surgery.

Description

Technical Field

[0001] This disclosure relates to the field of computer technology, and more particularly to a monitoring method for implantation of an artificial lens and a surgical microscope system. Background Technology

[0002] Injecting an intraocular lens (IOL) into the posterior chamber and unfolding it between the iris and the lens is a safe and effective method of refractive correction, especially suitable for patients with thin corneas who are not suitable for laser surgery. It offers advantages such as not cutting the cornea, not affecting corneal thickness, high reversibility, and the IOL being able to be removed or replaced at any time. The corrective effect of the surgery mainly depends on the correctness of the lens placement. Related techniques require determining the IOL's position in the posterior chamber before and after surgery and calculating relevant parameters to predict the corrective effect. If the corrective effect does not meet expectations, a second surgery is required, which can delay treatment. Summary of the Invention

[0003] This disclosure aims to at least partially address one of the technical problems in the related art.

[0004] Therefore, the first objective of this disclosure is to provide a monitoring method for the implantation of intraocular lenses to reduce the likelihood of needing a second surgery.

[0005] The second objective of this disclosure is to provide a surgical microscope system for intraocular lens implantation.

[0006] To achieve the above objectives, a first aspect of this disclosure provides a method for monitoring the implantation of an intraocular lens, comprising:

[0007] Acquire real-time images of the eye and / or OCT scan images of the eye;

[0008] Based on the eye image and / or the OCT scan image, at least one relative positional information between the artificial lens and the eye is determined, wherein the at least one relative positional information includes the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the artificial lens, the minimum vertical distance between the lower boundary of the artificial lens and the upper boundary of the lens, and the angle between the long axis of the artificial lens and the horizontal line.

[0009] When the relative position information exceeds the preset parameter range, an adjustment prompt message is issued.

[0010] Optionally, determining at least one relative positional information between the artificial lens and the eye based on the eye image and / or the OCT scan image includes:

[0011] Based on the eye images and / or the OCT scan images, determine the surgical stage information for the intraocular lens implantation surgery;

[0012] Based on the surgical stage information, the extraction and calculation of relevant information of the relative position information are initiated, and the relative position information is determined based on the relevant information.

[0013] Optionally, determining the surgical stage information of the intraocular lens implantation surgery based on the eye image and / or the OCT scan image includes:

[0014] The trained image classification model is used to classify the eye images and / or the OCT scan images to obtain surgical stage information of the intraocular lens implantation surgery. The trained image classification model is obtained by training an initial image classification model using an image sample set, which includes eye image samples and / or OCT scan image samples corresponding to various surgical stages.

[0015] Optionally, the step of extracting and calculating relevant information about the relative position information based on the surgical stage information includes:

[0016] When the surgical stage information indicates that the intraocular lens implantation surgery is in the implantation process stage, the extraction and calculation of relevant information regarding the relative position information are initiated; or,

[0017] When the surgical stage information indicates that the intraocular lens implantation surgery is in the non-adjustment stage of the implantation process, the extraction and calculation of relevant information of the relative position information are initiated.

[0018] Optionally, after determining the at least one relative position information based on the relevant information, the method further includes:

[0019] Based on the relative position information and the surgical stage information, relative position setting information is superimposed and displayed on the eye image and / or the OCT scan image, wherein the relative position setting information is the numerical information and / or indication information of the relative position information.

[0020] Optionally, the adjustment prompt message can be issued in at least one of the following ways:

[0021] The change in the relative position setting information displayed in superimposed form indicates that the relative position information exceeds the preset parameter range;

[0022] The intraocular lens is identified in the surgical microscope field of view by projection, and the intraocular lens is highlighted.

[0023] An audible warning is used to indicate that the relative position information has exceeded the preset parameter range.

[0024] Optionally, determining at least one relative positional information between the artificial lens and the eye includes:

[0025] The OCT scan images are segmented and identified to determine the tissue boundaries of the cornea, the artificial lens, and the lens.

[0026] Based on the tissue boundaries, determine the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the artificial lens, and the minimum vertical distance between the lower boundary of the artificial lens and the upper boundary of the lens.

[0027] Optionally, determining at least one relative positional information between the artificial lens and the eye includes:

[0028] Determine the imaging lens width of the artificial lens in the OCT scan image;

[0029] Determine the rotation angle of the scanning direction corresponding to the eye image relative to the horizontal line;

[0030] The deflection angle of the artificial lens relative to the scanning direction is determined based on the width of the imaging crystal and the actual crystal width of the artificial lens;

[0031] The angle between the long axis of the artificial lens and the horizontal line is determined based on the rotation angle and the deflection angle.

[0032] Optionally, the preset parameter range includes at least one of the following: the preset parameter range corresponding to the maximum vertical distance between the lower edge of the cornea and the upper edge of the artificial lens is greater than 2.8 mm; the preset parameter range corresponding to the minimum vertical distance between the lower edge of the artificial lens and the upper edge of the lens is 200 μm to 1000 μm; and the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line is 0° to 15°.

[0033] To achieve the above objectives, a second aspect of this disclosure provides a surgical microscope system for implanting an intraocular lens, comprising:

[0034] An eye image acquisition unit is used to acquire eye images during the surgical procedure;

[0035] The OCT unit is used to acquire OCT scan images of the eye.

[0036] One or more control and computing units are used to acquire and calculate at least one relative position information between the artificial lens and the eye according to the method described in any one of the first aspect embodiments, and / or to identify the eye tissue region and boundary, and / or to determine the surgical stage information based on eye images or videos during the surgical procedure.

[0037] In summary, the intraocular lens (IOL) implantation monitoring method and surgical microscope system provided in this disclosure acquire eye images and / or OCT scan images of the eye in real time during surgery. Based on the eye images and / or OCT scan images, at least one relative positional information is determined, including the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the IOL, the minimum vertical distance between the lower boundary of the IOL and the upper boundary of the lens, and the angle between the long axis of the IOL and the horizontal line. Therefore, the implantation position of the IOL can be monitored during surgery. By issuing adjustment prompts when the relative positional information exceeds the preset parameter range, adjustment prompts can be issued when the position is abnormal, reducing the possibility of postoperative IOL positional abnormalities requiring a second surgery.

[0038] Additional aspects and advantages of this disclosure will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of this disclosure. Attached Figure Description

[0039] The above and / or additional aspects and advantages of this disclosure will become apparent and readily understood from the following description of the embodiments taken in conjunction with the accompanying drawings, in which:

[0040] Figure 1 This is a schematic flowchart of a monitoring method for implantation of an intraocular lens provided in an embodiment of this disclosure;

[0041] Figure 2 This is a schematic diagram illustrating an image segmentation and recognition result provided in an embodiment of this disclosure;

[0042] Figure 3 This is a schematic diagram illustrating an eye image provided in an embodiment of the present disclosure;

[0043] Figure 4 This is a schematic flowchart illustrating an implantation process determination provided in an embodiment of this disclosure;

[0044] Figure 5 This is a flowchart illustrating a relative position information monitoring process provided in an embodiment of the present disclosure.

[0045] Figure 6 This is another flowchart for monitoring relative position information provided in an embodiment of this disclosure;

[0046] Figure 7 This is a schematic diagram of a surgical microscope system for implanting an artificial lens, provided in an embodiment of this disclosure. Detailed Implementation

[0047] Embodiments of this disclosure are described in detail below, with examples of embodiments illustrated in the accompanying drawings, wherein the same or similar reference numerals denote the same or similar elements or elements having the same or similar functions throughout. The embodiments described below with reference to the accompanying drawings are exemplary and intended to explain this disclosure, and should not be construed as limiting this disclosure.

[0048] The present disclosure will now be described in detail with reference to specific embodiments.

[0049] In the first embodiment, such as Figure 1 As shown, Figure 1 This is a flowchart illustrating a monitoring method for intraocular lens implantation provided in an embodiment of this disclosure. The method can be implemented using a computer program and can run on a surgical microscope system used for intraocular lens implantation. The computer program can be integrated into an application or run as a standalone utility application.

[0050] The monitoring method for the implantation of the intraocular lens can be performed by a surgical microscope system used for intraocular lens implantation.

[0051] For example, the monitoring method for implantation of this artificial lens includes the following steps:

[0052] S101, acquire real-time eye images and / or OCT scan images of the eye;

[0053] Among them, eye images refer to eye imaging images observed under a surgical microscope within the surgical field of view.

[0054] OCT scan images refer to images obtained through optical coherence tomography (OCT) technology. OCT is a non-invasive imaging technique that uses the coherence of light to acquire high-resolution cross-sectional images of biological tissues or other materials. It can be applied in the medical field, especially in ophthalmology, to examine subtle changes in eye structures such as the retina and optic nerve, providing real-time, high-resolution eye images.

[0055] S102, determine at least one relative positional information between the artificial lens and the eye based on the eye image and / or OCT scan image;

[0056] In this context, an artificial lens refers to a precision optical component surgically implanted into the eye to replace the removed, cloudy lens. For example, this artificial lens can be a posterior chamber fixed artificial lens, used for injection into the posterior chamber. For instance, this posterior chamber fixed artificial lens can be an implantable collamer lens (ICL) for phakic eyes.

[0057] The relative position information includes, but is not limited to, the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the artificial lens, the minimum vertical distance between the lower boundary of the artificial lens and the upper boundary of the lens, and the angle between the long axis of the artificial lens and the horizontal line.

[0058] The horizontal line refers to the horizontal line of the eyeball. For example, when describing the shape of the eyeball as an ellipse, the horizontal line is the line corresponding to the long axis of the eyeball.

[0059] S103: When the relative position information exceeds the preset parameter range, an adjustment prompt message is issued.

[0060] Each of the at least one relative position information has a corresponding preset parameter range. This preset parameter range does not refer to a specific fixed range, but can be adjusted according to the actual application scenario.

[0061] The adjustment prompt message is used to indicate whether the position of the artificial lens needs to be adjusted. This prompt message can be delivered in the form of voice, text, or image.

[0062] In summary, the method provided in this embodiment acquires ocular images and / or OCT scan images of the eye in real time during surgery; based on the ocular images and / or OCT scan images, it determines at least one relative positional information, including the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens, and the angle between the long axis of the intraocular lens and the horizontal line; therefore, it can achieve monitoring of the implantation position of the intraocular lens during surgery. By issuing adjustment prompts when the relative positional information exceeds the preset parameter range, adjustment prompts can be issued when the position is abnormal, reducing the possibility of requiring a second surgery due to abnormal intraocular lens position after surgery.

[0063] Another embodiment of this disclosure provides a method for monitoring the implantation of an intraocular lens. This method can be performed by a surgical microscope system used for intraocular lens implantation.

[0064] For example, the monitoring method for implantation of this artificial lens may include the following steps:

[0065] S201, acquire real-time eye images and / or OCT scan images of the eye.

[0066] One method is to determine the center position of the pupil on a surgical microscope image to obtain an image of the eye.

[0067] One method is to determine the center position of the pupil on a microscope image and then perform an OCT scan using a B-scan to obtain an OCT image.

[0068] It should be noted that intraoperative OCT can provide real-time scanning and imaging during intraocular lens implantation, helping doctors to accurately assess and adjust the procedure. Specifically, doctors can adjust the centering and relative angle of the intraocular lens based on the OCT scan images in real time, assessing the normality of the anterior chamber structure, greatly improving the safety and accuracy of intraocular lens implantation surgery. This is particularly important in complex cases or patients with anatomical abnormalities, and is crucial for assisting doctors in intraoperative decision-making. However, related technologies require doctors to manually adjust the scanning position and switch scanning modes, increasing the doctor's workload. Therefore, this embodiment, by acquiring real-time OCT scan images of the eye, eliminates the need for doctors to manually adjust the scanning position and switch scanning modes, reducing the doctor's workload and significantly improving surgical difficulty and safety.

[0069] S202, Determine the surgical stage information for intraocular lens implantation surgery based on eye images and / or OCT scan images.

[0070] The surgical stage information indicates the current stage of the intraocular lens implantation procedure. This stage could be the surgical preparation stage or the implantation process stage.

[0071] According to some embodiments, a trained image classification model can be used to classify eye images and / or OCT scan images to obtain surgical stage information for intraocular lens implantation surgery.

[0072] In some embodiments, an initial image classification model can be trained using an image sample set to obtain a trained image classification model. This image sample set includes eye image samples and / or OCT scan image samples corresponding to various surgical stages.

[0073] In some embodiments, supervised learning can be the primary method, where an initial image classification model is trained based on a set of image samples, and cross-entropy loss is used to measure the gap between the model's predictions and the true labels, thereby optimizing the model to more accurately identify surgical stages.

[0074] The initial classification model can be, for example, a convolutional neural network (CNN).

[0075] In some embodiments, the image sample set may also consist of multiple surgical video clips. Taking the general-domain Atomic Visual Actions (AVA) Actions dataset as an example, 200 to 400 video clips, each 15 minutes long, can be used as the eye image sample set. Then, for these multiple surgical video clips, the surgical stage to which each video clip belongs can be labeled frame-by-frame at a sampling rate of 1 FPS.

[0076] In some embodiments, the trained classification model can be deployed on a Graphics Processing Unit (GPU) to ensure real-time execution of the inference process. The GPU's sampling rate can be greater than a sampling rate threshold. This sampling rate threshold can be determined based on the specific application scenario. For example, the sampling rate threshold could be 30 FPS.

[0077] S203, based on the surgical stage information, initiate the extraction and calculation of relevant information on relative position information, and determine the relative position information based on the relevant information.

[0078] According to some embodiments, in the pre-operative preparation stage before intraocular lens implantation, activating the extraction and calculation of relative position information would result in unnecessary computational resource consumption, especially since obtaining relative position information is meaningless in the early pre-operative preparation work before intraocular lens implantation begins. Therefore, to avoid ineffective calculations during the pre-operative preparation stage, the extraction and calculation of relative position information can be activated only when the surgical stage information indicates that the intraocular lens implantation surgery is in the implantation process.

[0079] In some embodiments, the relevant information for relative position information includes information necessary for calculating the relative position information, including but not limited to identifying the corresponding tissue boundary information and obtaining the corresponding OCT scan information.

[0080] According to some embodiments, when determining at least one relative positional information between the intraocular lens and the eye, image segmentation and recognition can be performed on the OCT scan image to determine the tissue boundaries of the cornea, intraocular lens, and lens; based on the tissue boundaries, the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, and the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens can be determined. Therefore, image segmentation and recognition can improve the accuracy of obtaining the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, and the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens.

[0081] Astigmatism correction requires implantation strictly along the astigmatic axis. Since artificial lenses are transparent and colorless, they are difficult to identify precisely under a microscope. Identification through OCT scanning images can improve the accuracy of artificial lens identification.

[0082] In some embodiments, a trained semantic segmentation model can be used to identify and segment tissues and crystal region boundaries on OCT scan images.

[0083] Supervised learning can be the primary approach, using training data to train an initial semantic segmentation model. Class imbalance is addressed using the Dice / cross-entropy loss function, and the segmentation boundaries are optimized using a boundary loss function to obtain a well-trained semantic segmentation model. In this training data, each pixel is categorized into different types by accurately annotating the contour boundaries of tissue structures. For example, the cataract surgery segmentation dataset (CATARACTSDataset) contains 4.5k images from 35 surgical videos, annotated with 20 categories of tissue structures, including pupil, eye retractor, iris, skin, cornea, and other instruments.

[0084] The initial semantic segmentation model can, for example, employ a CNN. Deep learning-based CNN models automatically extract key features from data for prediction, classification, or generation. They can analyze OCT scan images to assist doctors in diagnosing diseases, planning surgical procedures, and monitoring postoperative recovery. They can also automatically segment and label structures such as the anterior chamber, iris, and lens in eye images and / or OCT scan images, offering advantages in efficiency, accuracy, and automation. They are also more robust to dynamic intraoperative scenarios, resulting in more accurate and effective image segmentation and recognition results.

[0085] In the deployment and use of the trained semantic segmentation model, a segmentation mask can be obtained based on the input image. Connectivity analysis and contour retrieval are then performed on the binary image to determine the boundaries of different tissues. Combined with a Compute Unified Device Architecture (CUDA) / TensorRuntime (TensorRT) deployment, a sampling rate of 60 FPS can be achieved, ensuring efficient computation in the surgical environment. This results in more accurate and effective parameter calculation and evaluation, avoiding delays in treatment due to postoperative assessment.

[0086] To give an example from a scenario, Figure 2 This is a schematic diagram illustrating an image segmentation and recognition result provided in an embodiment of this disclosure. Figure 2 As shown, a trained semantic segmentation model is used to segment and identify the cornea, iris, lens, and ICL in OCT scan images, and to determine the tissue boundaries of the cornea, iris, lens, and ICL.

[0087] Here, the lower boundary curve of the cornea is denoted as y1(x), representing the ordinate of the lower corneal surface as the x-axis changes. The upper boundary curve of the ICL is denoted as y2(x), representing the ordinate of the upper ICL surface as the x-axis changes. Therefore, the maximum vertical distance H1 = MAX(y1(x) - y2(x)) between the lower corneal boundary and the upper ICL boundary can be calculated. The maximum value of H1 represents the location of the maximum vertical distance between the lower corneal boundary and the upper ICL boundary in the coordinate system of the OCT image throughout the entire visual field.

[0088] In this diagram, the lower boundary curve of the ICL is denoted as y3(x), representing the ordinate of the lower surface of the ICL as the x-coordinate changes. The upper boundary curve of the lens is denoted as y4(x), representing the ordinate of the upper surface of the lens as the x-coordinate changes. Therefore, the minimum vertical distance H2 between the lower boundary of the ICL and the upper boundary of the lens can be calculated as H2 = MIN(y3(x) - y4(x)). The minimum value of H2 represents the location of the minimum vertical distance between the lower boundary of the ICL and the upper boundary of the lens within the coordinate system of the OCT image, within the field of view.

[0089] The vertical axis y can be positive downwards, meaning that the larger the y value, the closer it is to the fundus.

[0090] According to some embodiments, when determining at least one relative positional information between the intraocular lens (IOL) and the eye, the imaging lens width of the IOL in the OCT scan image can also be determined; the rotation angle of the scanning direction corresponding to the eye image relative to the horizontal line can be determined; the deflection angle of the IOL relative to the scanning direction can be determined based on the imaging lens width and the actual lens width of the IOL; and the angle between the long axis of the IOL and the horizontal line can be determined based on the rotation angle and the deflection angle. Therefore, by calculating the angle between the long axis of the IOL and the horizontal line based on imaging characteristics, the accuracy of determining the angle between the long axis of the IOL and the horizontal line can be improved.

[0091] In some embodiments, the imaging crystal width in the current scanning direction can be calculated by scanning the OCT image to obtain the imaging width. For example... Figure 2 As shown, when calculating the scanning imaging width, the imaging lens width W of the ICL can be calculated by segmenting and identifying the tissue boundary of the ICL.

[0092] To give an example from a scenario, Figure 3 This is a schematic diagram illustrating an eye image provided in an embodiment of this disclosure. Figure 3As shown, given the actual lens width w0 and the imaging lens width W of the ICL, the deflection angle b of the ICL relative to the scanning direction can be calculated using general trigonometric functions, where b = ARCSIN(w0 / W). Furthermore, the angle c between the major axis of the ICL and the horizontal line can be obtained using planar angle relationships, where c = 180° - ab, or c = ba, where a is the rotation angle of the scanning direction corresponding to the eye image relative to the horizontal line.

[0093] For example, when scanning an eye image at an angle perpendicular to the horizontal line, a = 90°, c = 180° - 90° - b = 90° - b.

[0094] S204, Based on relative position information and surgical stage information, overlay and display relative position setting information on eye images and / or OCT scan images.

[0095] According to some embodiments, the relative position setting information is numerical information and / or indication information of the relative position information.

[0096] In some embodiments, the indication information may include information showing whether the value of the relative position information is greater than or less than the standard value, so as to further adjust the position of the artificial lens; and / or displaying line segments, areas, etc. indicating the value of the relative position information.

[0097] It should be noted that the implantation process includes an adjustment phase and a non-adjustment phase, during which the extraction and calculation of relative position information can be enabled. The calculations in the non-adjustment phase are for preparation and reference, and the relative position setting information can be overlaid and displayed during this phase. However, during the adjustment phase, i.e., during the surgical procedure, the display of relative position setting information may affect the surgeon's work. Therefore, the overlay display of relative position setting information can be omitted during the adjustment phase, and consequently, the calculation of relative position information can be omitted. In other words, the extraction and calculation of relative position information can be enabled only when the surgical stage information indicates that the intraocular lens implantation surgery is in the non-adjustment phase of the implantation process. This further reduces the consumption of computational power and minimizes the impact on the surgeon's work.

[0098] The presence of instruments in the image can be used as the primary criterion for determining whether an adjustment phase or a non-adjustment phase is being performed. For example, the phase in which instruments are being used to adjust the intraocular lens is the adjustment phase, while the phase in which instruments are not being used to adjust the intraocular lens is the non-adjustment phase.

[0099] To give an example from a scenario, Figure 4 This is a schematic flowchart illustrating an implantation process determination method provided in an embodiment of this disclosure. Figure 4 As shown, during the intraocular lens implantation surgery, the surgical microscope is controlled to acquire images of the eye; then, the surgical stage is determined based on the eye images and an OCT scan is initiated; if the surgical stage determination result indicates that the intraocular lens is currently being adjusted, the eye image and / or OCT scan image are displayed; if the surgical stage determination result indicates that the intraocular lens is not currently being adjusted, relevant parameters are calculated based on the eye image and / or OCT scan image, and relative position setting information is overlaid on the eye image and / or OCT scan image while displaying the eye image and / or OCT scan image.

[0100] It should be noted that this embodiment controls the surgical microscope to acquire images and perform judgment steps in real time during the intraocular lens implantation surgery, thereby employing different scanning and processing operations accordingly. Specifically, when the intraocular lens is being adjusted, only OCT scanning is performed; when the intraocular lens is not being adjusted, relevant implantation parameters are calculated based on the OCT scanning results. Therefore, intraoperative OCT not only provides auxiliary observation but also helps doctors accurately assess and adjust the intraocular lens during surgery, eliminating the need for manual OCT scan adjustments by the doctor, thus improving the safety and accuracy of the surgery.

[0101] S205: When the relative position information exceeds the preset parameter range, an adjustment prompt message is issued.

[0102] It should be noted that relative position setting information can be displayed throughout the implantation process, or during the non-adjustment phase of the implantation process; however, adjustment prompts will only be issued when the relative position information exceeds the preset parameter range. For example, after the relative position information is calculated during the non-adjustment phase, the relative position setting information will be overlaid on the eye image and / or OCT scan image. Simultaneously, adjustment prompts will only be issued when the relative position information exceeds the preset parameter range, and not when the relative position information is within the preset parameter range.

[0103] The preset parameter range may include at least one of the following: the preset parameter range corresponding to the maximum vertical distance between the lower edge of the cornea and the upper edge of the artificial lens, the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line, and the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line.

[0104] According to some embodiments, maintaining a central anterior chamber depth greater than 2.8 mm can prevent the intraocular lens from getting too close to the corneal endothelium. Therefore, a preset parameter range corresponding to the maximum vertical distance between the lower corneal boundary and the upper boundary of the intraocular lens can be set to be greater than 2.8 mm.

[0105] In some embodiments, the normal range for the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens is 250 μm to 750 μm. A distance greater than 1000 μm may be too high, leading to angle closure and increased intraocular pressure, while a distance less than 200 μm may be too low, increasing the risk of lens contact and cataracts. Therefore, a preset parameter range for the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens can be set to 200 μm to 1000 μm. Further, a preset parameter range for the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens can be set to 250 μm to 750 μm.

[0106] To give an example from a scenario, Figure 5 This is a flowchart illustrating a relative position information monitoring process provided in an embodiment of this disclosure. Figure 5 As shown, during the non-adjustment phase of surgery, an eye image is acquired using a surgical microscope. Then, the pupil center position is determined based on the acquired eye image, and an OCT scan is initiated. Next, an OCT scan image is obtained using a B-scan method. Then, tissue boundaries in the OCT scan image are identified and segmented. Following this, distance parameters are calculated based on the identified and segmented tissue boundaries, determining the maximum vertical distance between the lower corneal boundary and the upper intraocular lens boundary, and the minimum vertical distance between the lower intraocular lens boundary and the upper lens boundary. If the distance parameters do not exceed the preset parameter range, image display is performed. If the distance parameters exceed the preset parameter range, an adjustment prompt is issued, and image display continues. During image display, the relative position setting information is overlaid on the eye image and / or OCT scan image.

[0107] According to some embodiments, an angle of less than 5° between the long axis of the intraocular lens (IOL) and the horizontal line indicates a slight rotational error, which can be observed and followed up, and usually does not significantly affect vision. An implantation angle between 5° and 15° indicates that the IOL may need to be rotated to align with the correct axis. An implantation angle greater than 15° indicates a serious rotational error, which usually requires a second surgery to adjust or replace the IOL. Therefore, a preset parameter range for the angle between the long axis of the IOL and the horizontal line can be set to 0° to 15°. Furthermore, a preset parameter range for the angle between the long axis of the IOL and the horizontal line can be set to 0° to 5°.

[0108] To give an example from a scenario, Figure 6 This is another flowchart illustrating the monitoring of relative position information provided in an embodiment of this disclosure. Figure 6As shown, during the non-adjustment phase of surgery, an eye image is acquired using a surgical microscope. Then, the pupil center position is determined based on the acquired eye image, and an OCT scan is initiated. Next, the imaging lens width of the ICL on the OCT scan image and the actual lens width of the ICL are determined. Then, angle parameters are calculated to obtain the angle between the long axis of the artificial lens and the horizontal line. Finally, it is determined whether the angle parameters exceed the preset parameter range. If the angle parameters are within the preset parameter range, only image display is performed; if the angle parameters exceed the preset parameter range, an adjustment prompt is issued, and image display is performed. During image display, the relative position setting information is overlaid on the eye image and / or OCT scan image.

[0109] According to some embodiments, the adjustment prompt message can be issued in at least one of the following ways:

[0110] The change in the relative position setting information displayed in superimposed form indicates that the relative position information exceeds the preset parameter range;

[0111] The intraocular lens is identified on the surgical microscope by projection and highlighted.

[0112] An audible warning is used to indicate that the relative position information has exceeded the preset parameter range.

[0113] Among them, the change of relative position setting information is indicated by superimposed display of the change of relative position information exceeding the preset parameter range. When the adjustment prompt information is issued, the change of relative position setting information can be displayed by the data change of the displayed relative position information, the font size change of the value, the color change of the value, the color change of the line segment mark, and the synchronous display of corresponding symbol information.

[0114] Among them, the intraocular lens is identified on the surgical microscope by projection and highlighted. When adjustment prompts are issued, the area where the intraocular lens is located can be covered with a preset color or pattern, or the area between the intraocular lens and other parts can be covered with a preset color or pattern to indicate the distance between the intraocular lens and other parts.

[0115] Among them, the system uses sound warnings to indicate that the relative position information exceeds the preset parameter range. When the adjustment prompt is issued, it can issue a voice broadcast that "the relative position information exceeds the preset parameter range and the specific value of the excess", or issue a specific prompt sound such as a beep to indicate that the relative position information exceeds the preset parameter range.

[0116] In summary, the effectiveness of current intraocular lens (IOL) implantation surgeries is typically assessed post-operatively via OCT scans. If the IOL is misaligned or the correction is ineffective, a second surgery may be necessary, potentially delaying treatment. Furthermore, intraoperative OCT scans often require manual adjustment, and OCT imaging only provides auxiliary observation, lacking the ability to precisely determine the IOL's position during surgery. The method provided in this embodiment automatically identifies and positions the IOL intraoperatively and guides the OCT scan in real-time, monitoring the relative position of the IOL and the eye. Based on this relative position information and preset parameter ranges, adjustment prompts are provided, effectively reducing intraoperative risks, the likelihood of a second surgery, and the risk of abnormal IOL placement or damage during surgery. This improves surgical efficiency and success rate.

[0117] To achieve the above embodiments, this disclosure also proposes a surgical microscope system for intraocular lens implantation.

[0118] For example, Figure 7 This is a schematic diagram of a surgical microscope system for intraocular lens implantation provided in an embodiment of this disclosure. Figure 7 As shown, the surgical microscope system 700 for intraocular lens implantation includes:

[0119] The eye image acquisition unit 701 is used to acquire eye images during the surgical procedure;

[0120] OCT unit 702 is used to acquire OCT scan images of the eye;

[0121] One or more control and calculation units 703 are used to acquire and calculate at least one relative position information between the artificial lens and the eye according to the method shown in the foregoing embodiments, and / or to identify the eye tissue region and boundary, and / or to determine the surgical stage information based on eye images or videos during the surgical process.

[0122] Optionally, the control calculation unit 703 can be used to determine at least one relative position information between the artificial lens and the eye based on the eye image and / or OCT scan image, wherein the at least one relative position information includes the maximum distance in the vertical direction between the lower boundary of the cornea and the upper boundary of the artificial lens, the minimum distance in the vertical direction between the lower boundary of the artificial lens and the upper boundary of the lens, and the angle between the long axis of the artificial lens and the horizontal line; when the relative position information exceeds the preset parameter range, an adjustment prompt message is issued.

[0123] Optionally, when the control calculation unit 703 determines at least one relative positional information between the artificial lens and the eye based on the eye image and / or OCT scan image, it is specifically used for:

[0124] Based on eye images and / or OCT scan images, determine the surgical stage information for intraocular lens implantation surgery;

[0125] Based on the information from the surgical stage, the relevant information on relative position is extracted and calculated, and the relative position information is determined based on the relevant information.

[0126] Optionally, when the control calculation unit 703 determines the surgical stage information of the intraocular lens implantation surgery based on the eye image and / or OCT scan image, it is specifically used for:

[0127] A trained image classification model is used to classify eye images and / or OCT scan images to obtain information on the surgical stages of intraocular lens implantation surgery. The trained image classification model is obtained by training an initial image classification model using an image sample set, which includes eye image samples and / or OCT scan image samples corresponding to various surgical stages.

[0128] Optionally, when the control calculation unit 703 is used to extract and calculate relevant information about relative position information based on the surgical stage information, it is specifically used for:

[0129] When the surgical procedure indicates that the intraocular lens implantation surgery is in the implantation phase, the extraction and calculation of relevant information regarding the relative position are initiated; or,

[0130] When the surgical procedure information indicates that the intraocular lens implantation surgery is in the non-adjustment phase of the implantation process, the extraction and calculation of relevant information on the relative position are initiated.

[0131] Optionally, the surgical microscope system 700 for implanting the intraocular lens may further include an image display unit, which, after determining at least one relative positional information based on relevant information, is used to:

[0132] Based on relative position information and surgical stage information, relative position setting information is overlaid on the eye image and / or OCT scan image, wherein the relative position setting information is numerical information and / or indication information of the relative position information.

[0133] Optionally, the surgical microscope system 700 for implanting the artificial lens may further include an information prompting unit, which issues adjustment prompts in at least one of the following ways:

[0134] The change in the relative position setting information displayed in superimposed form indicates that the relative position information exceeds the preset parameter range;

[0135] The intraocular lens is identified on the surgical microscope by projection and highlighted.

[0136] An audible warning is used to indicate that the relative position information has exceeded the preset parameter range.

[0137] Optionally, when the control calculation unit 703 is used to determine at least one relative positional information between the artificial lens and the eye, it is specifically used for:

[0138] Image segmentation and recognition are performed on OCT scan images to determine the tissue boundaries of the cornea, intraocular lens, and lens.

[0139] Based on the tissue boundaries, determine the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, and the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens.

[0140] Optionally, when the control calculation unit 703 is used to determine at least one relative positional information between the artificial lens and the eye, it is specifically used for:

[0141] Determine the imaging lens width of the artificial lens in the OCT scan image;

[0142] Determine the rotation angle of the scanning direction of the eye image relative to the horizontal line;

[0143] The deflection angle of the artificial lens relative to the scanning direction is determined based on the width of the imaging lens and the actual width of the artificial lens.

[0144] The angle between the long axis of the artificial lens and the horizontal line is determined based on the rotation angle and the deflection angle.

[0145] Optionally, the preset parameter range includes at least one of the following: the preset parameter range corresponding to the maximum vertical distance between the lower edge of the cornea and the upper edge of the artificial lens is greater than 2.8 mm; the preset parameter range corresponding to the minimum vertical distance between the lower edge of the artificial lens and the upper edge of the lens is 200 μm to 1000 μm; and the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line is 0° to 15°.

[0146] It should be noted that the explanation of the aforementioned monitoring method embodiment for intraocular lens implantation also applies to the surgical microscope system for intraocular lens implantation in this embodiment, and will not be repeated here.

[0147] In summary, the system provided in this disclosure acquires eye images and / or OCT scan images of the eye in real time during surgery; based on the eye images and / or OCT scan images, it determines at least one relative positional information, including the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens, and the angle between the long axis of the intraocular lens and the horizontal line; therefore, it can monitor the implantation position of the intraocular lens during surgery. By issuing adjustment prompts when the relative positional information exceeds the preset parameter range, it can issue adjustment prompts when the position is abnormal, reducing the possibility of requiring a second surgery due to abnormal intraocular lens position after surgery.

[0148] The collection, storage, use, processing, transmission, provision, and disclosure of user personal information involved in this disclosure all comply with the provisions of relevant laws and regulations and do not violate public order and good morals.

[0149] It should be noted that personal information collected from users should be used for legitimate and reasonable purposes and should not be shared or sold outside of these legitimate uses. Furthermore, such collection / sharing should only be conducted after receiving the user's informed consent, including but not limited to notifying the user to read the user agreement / user notice and sign an agreement / authorization that includes authorization of relevant user information before the user uses the function. In addition, any necessary steps must be taken to protect and safeguard access to such personal information data and ensure that others with access to personal information data comply with their privacy policies and procedures.

[0150] This disclosure is intended to provide implementation schemes for users to selectively prevent the use or access to their personal information data. Specifically, this disclosure is intended to provide hardware and / or software to prevent or block access to such personal information data. Once personal information data is no longer needed, risks can be minimized by restricting data collection and deleting data. Furthermore, where applicable, such personal information is de-identified to protect user privacy.

[0151] In the foregoing descriptions of the embodiments, the terms "one embodiment," "some embodiments," "example," "specific example," or "some examples," etc., refer to specific features, structures, materials, or characteristics described in connection with that embodiment or example, which are included in at least one embodiment or example of this disclosure. In this specification, the illustrative expressions of the above terms do not necessarily refer to the same embodiment or example. Furthermore, the specific features, structures, materials, or characteristics described may be combined in any suitable manner in one or more embodiments or examples. Moreover, without contradiction, those skilled in the art can combine and integrate the different embodiments or examples described in this specification, as well as the features of different embodiments or examples.

[0152] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one of that feature. In the description of this disclosure, "a plurality of" means at least two, such as two, three, etc., unless otherwise explicitly specified.

[0153] Any process or method description in the flowchart or otherwise herein can be understood as representing a module, segment, or portion of code comprising one or more executable instructions for implementing custom logic functions or processes, and the scope of preferred embodiments of this disclosure includes additional implementations in which functions may be performed not in the order shown or discussed, including substantially simultaneously or in reverse order depending on the functions involved, as will be understood by those skilled in the art to which embodiments of this disclosure pertain.

[0154] The logic and / or steps represented in the flowchart or otherwise described herein, for example, can be considered as a ordered list of executable instructions for implementing logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (such as a computer-based system, a processor-including system, or other system that can fetch and execute instructions from, an instruction execution system, apparatus, or device). For the purposes of this specification, "computer-readable medium" can be any means that can contain, store, communicate, propagate, or transmit programs for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples of computer-readable media (a non-exhaustive list) include: electrical connections (electronic devices) having one or more wires, portable computer disks (magnetic devices), random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM) or flash memory, fiber optic devices, and compact disc read-only memory (CDROM). Furthermore, computer-readable media can even be paper or other suitable media on which programs can be printed, because programs can be obtained electronically, for example, by optically scanning the paper or other media, followed by editing, interpreting, or otherwise processing as necessary, and then stored in computer memory.

[0155] It should be understood that various parts of this disclosure can be implemented in hardware, software, firmware, or a combination thereof. In the above embodiments, multiple steps or methods can be implemented in software or firmware stored in memory and executed by a suitable instruction execution system. For example, if implemented in hardware as in another embodiment, it can be implemented using any one or a combination of the following techniques known in the art: discrete logic circuits having logic gates for implementing logical functions on data signals, application-specific integrated circuits (ASICs) having suitable combinational logic gates, programmable gate arrays (PGAs), field-programmable gate arrays (FPGAs), etc.

[0156] Those skilled in the art will understand that all or part of the steps of the methods described in the above embodiments can be implemented by a program instructing related hardware, and the program can be stored in a computer-readable storage medium. When executed, the program includes one or a combination of the steps of the method embodiments.

[0157] Furthermore, the functional units in the various embodiments of this disclosure can be integrated into a processing module, or each unit can exist physically separately, or two or more units can be integrated into a module. The integrated module can be implemented in hardware or as a software functional module. If the integrated module is implemented as a software functional module and sold or used as an independent product, it can also be stored in a computer-readable storage medium.

[0158] The storage medium mentioned above may be a read-only memory, a disk, or an optical disk, etc. Although embodiments of the present disclosure have been shown and described above, it is to be understood that the above embodiments are exemplary and should not be construed as limiting the present disclosure. Those skilled in the art can make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present disclosure.

Claims

1. A method for monitoring the implantation of an artificial lens, characterized in that, include: Acquire real-time intraoperative images of the eye and OCT scan images of the eye; Based on the eye image and / or the OCT scan image, at least one relative positional information between the artificial lens and the eye is determined, wherein the at least one relative positional information includes the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the artificial lens, the minimum vertical distance between the lower boundary of the artificial lens and the upper boundary of the lens, and the angle between the long axis of the artificial lens and the horizontal line. Specifically, the surgical stage information of the intraocular lens implantation surgery is determined based on the eye image and / or the OCT scan image; Based on the surgical stage information, the extraction and calculation of relevant information regarding the relative position information are initiated, and the relative position information is determined based on the relevant information. When the relative position information exceeds the preset parameter range, an adjustment prompt message is issued; Determining at least one relative positional information between the artificial lens and the eye includes: Determine the imaging lens width of the artificial lens in the OCT scan image; Determine the rotation angle of the scanning direction corresponding to the eye image relative to the horizontal line; The deflection angle of the artificial lens relative to the scanning direction is determined based on the width of the imaging crystal and the actual crystal width of the artificial lens; The angle between the long axis of the artificial lens and the horizontal line is determined based on the rotation angle and the deflection angle.

2. The method according to claim 1, characterized in that, The step of determining the surgical stage information for intraocular lens implantation surgery based on the eye image and / or the OCT scan image includes: The trained image classification model is used to classify the eye images and / or the OCT scan images to obtain surgical stage information of the intraocular lens implantation surgery. The trained image classification model is obtained by training an initial image classification model using an image sample set, which includes eye image samples and / or OCT scan image samples corresponding to various surgical stages.

3. The method according to claim 1, characterized in that, The step of extracting and calculating relevant information about the relative position information based on the surgical stage information includes: When the surgical stage information indicates that the intraocular lens implantation surgery is in the implantation process stage, the extraction and calculation of relevant information regarding the relative position information are initiated; or, When the surgical stage information indicates that the intraocular lens implantation surgery is in the non-adjustment stage of the implantation process, the extraction and calculation of relevant information of the relative position information are initiated.

4. The method according to claim 1, characterized in that, After determining the at least one relative position information based on the relevant information, the method further includes: Based on the relative position information and the surgical stage information, relative position setting information is superimposed and displayed on the eye image and / or the OCT scan image, wherein the relative position setting information is the numerical information and / or indication information of the relative position information.

5. The method according to claim 4, characterized in that, The adjustment prompt message can be issued in at least one of the following ways: The change in the relative position setting information displayed in superimposed form indicates that the relative position information exceeds the preset parameter range; The intraocular lens is identified on a surgical microscope by projection, and the intraocular lens is highlighted. An audible warning is used to indicate that the relative position information has exceeded the preset parameter range.

6. The method according to any one of claims 1 to 5, characterized in that, Determining at least one relative positional information between the artificial lens and the eye includes: The OCT scan images are segmented and identified to determine the tissue boundaries of the cornea, the artificial lens, and the lens. Based on the tissue boundaries, determine the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the artificial lens, and the minimum vertical distance between the lower boundary of the artificial lens and the upper boundary of the lens.

7. The method according to any one of claims 1 to 5, characterized in that, The preset parameter range includes at least one of the following: the preset parameter range corresponding to the maximum vertical distance between the lower edge of the cornea and the upper edge of the artificial lens is greater than 2.8 mm; the preset parameter range corresponding to the minimum vertical distance between the lower edge of the artificial lens and the upper edge of the lens is 200 μm ~ 1000 μm; and the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line is 0° ~ 15°.

8. A surgical microscope system for intraocular lens implantation, characterized in that, include: An eye image acquisition unit is used to acquire eye images during the surgical procedure; The OCT unit is used to acquire OCT scan images of the eye. One or more control and computing units are used to acquire and calculate at least one relative position information between the artificial lens and the eye according to the method of any one of claims 1 to 7, and / or to identify the eye tissue region and boundary, and / or to determine the surgical stage information based on eye images or videos during the surgical procedure.

Images