Intraocular lens implantation monitoring method and operating microscope system

Abstract

The invention relates to the technical field of computers, in particular to an intraocular lens implantation monitoring method and an operation microscope system. The method comprises the following steps: acquiring a real-time eye image and / or an OCT (Optical Coherence Tomography) scanning image of an eye; according to the eye image and / or the OCT scanning image, at least one kind of relative position information of the intraocular lens and the eye is determined, the at least one kind of relative position information comprises the maximum distance between the cornea lower boundary and the intraocular lens upper boundary in the vertical direction, the minimum distance between the intraocular lens lower boundary and the crystalline lens upper boundary in the vertical direction and the degree of an included angle between the long axis of the intraocular lens and the horizontal line; and when the relative position information exceeds a preset parameter range, sending adjustment prompt information. By the adoption of the scheme, the implantation position of the intraocular lens is monitored in the operation, the adjustment prompt information is sent out when the position is abnormal, and the possibility that a secondary operation needs to be conducted due to the fact that the position of the intraocular lens is abnormal after the operation can be reduced.

Description

Technical Field

[0001] The present disclosure relates to the field of computer technology, and in particular to a monitoring method for implantation of an artificial lens and a surgical microscope system. Background Art

[0002] Injecting an intraocular lens into the posterior chamber and spreading it flat between the iris and lens is a safe and effective method of refractive correction, particularly suitable for patients with thin corneas who are not suitable for laser surgery. It does not require corneal ablation, does not affect corneal thickness, is highly reversible, and allows the intraocular lens to be removed or replaced at any time. The effectiveness of surgical correction depends primarily on the correct position of the lens. Related technologies require preoperative and postoperative determination of the intraocular lens's position in the posterior chamber and calculation of relevant parameters to estimate the effectiveness of the surgery. If the surgical correction does not meet expectations, a second surgery may be required, which can delay treatment. Summary of the Invention

[0003] The present disclosure aims to solve one of the technical problems in the related art at least to a certain extent.

[0004] To this end, a first object of the present disclosure is to provide a monitoring method for implantation of an intraocular lens to reduce the possibility of requiring a second surgery.

[0005] A second objective of the present disclosure is to provide a surgical microscope system for intraocular lens implantation.

[0006] To achieve the above-mentioned objectives, a first embodiment of the present disclosure provides a method for monitoring the implantation of an intraocular lens, comprising:

[0007] Acquiring real-time ocular images and / or OCT scan images of the eye;

[0008] determining at least one type of relative position information between the intraocular lens and the eye based on the eye image and / or the OCT scan image, wherein the at least one type of relative position information includes a maximum distance between a lower boundary of the cornea and an upper boundary of the intraocular lens in a vertical direction, a minimum distance between a lower boundary of the intraocular lens and an upper boundary of the lens in a vertical direction, and an angle between a long axis of the intraocular lens and a horizontal line;

[0009] When the relative position information exceeds the preset parameter range, an adjustment prompt message is issued.

[0010] Optionally, determining at least one relative position information between the intraocular lens and the eye based on the eye image and / or the OCT scan image includes:

[0011] determining surgical stage information of an intraocular lens implantation surgery based on the eye image and / or the OCT scan image;

[0012] According to the operation stage information, extraction and calculation of relevant information of the relative position information are started, and the relative position information is determined according to the relevant information.

[0013] Optionally, determining surgical stage information of an intraocular lens implantation surgery based on the eye image and / or the OCT scan image includes:

[0014] A trained image classification model is used to perform image classification on the eye image and / or the OCT scan image to obtain surgical stage information of the intraocular lens implantation surgery, wherein the trained image classification model is obtained by training an initial image classification model using an image sample set, and the image sample set includes eye image samples and / or OCT scan image samples corresponding to multiple surgical stages.

[0015] Optionally, starting the extraction and calculation of relevant information of the relative position information according to the surgical stage information includes:

[0016] When the operation stage information indicates that the intraocular lens implantation operation is in the implantation process stage, starting the extraction and calculation of the relevant information of the relative position information; or,

[0017] When the operation stage information indicates that the intraocular lens implantation operation is in a non-adjustment stage of the implantation process, the extraction and calculation of the relevant information of the relative position information is started.

[0018] Optionally, after determining the at least one relative position information according to the relevant information, the method further includes:

[0019] Based on the relative position information and the surgical stage information, relative position setting information is superimposed and displayed on the eye image and / or the OCT scan image, wherein the relative position setting information is numerical information and / or indication information of the relative position information.

[0020] Optionally, the sending of the adjustment prompt information is implemented by at least one of the following methods:

[0021] Indicating that the relative position information exceeds the preset parameter range by superimposing a change in the displayed relative position setting information;

[0022] Identifying the intraocular lens on the field of view of the surgical microscope by projection and indicating the intraocular lens in a highlighted manner;

[0023] The relative position information is indicated as exceeding the preset parameter range by means of a sound warning.

[0024] Optionally, determining at least one relative position information between the intraocular lens and the eye includes:

[0025] Performing image segmentation and recognition on the OCT scan image to determine the tissue boundaries of the cornea, the intraocular lens, and the lens;

[0026] According to the tissue boundary, the maximum distance between the lower boundary of the cornea and the upper boundary of the intraocular lens in the vertical direction and the minimum distance between the lower boundary of the intraocular lens and the upper boundary of the lens in the vertical direction are determined.

[0027] Optionally, determining at least one relative position information between the intraocular lens and the eye includes:

[0028] determining an imaged crystal width of the intraocular lens in the OCT scan image;

[0029] Determining a rotation angle of a scanning direction corresponding to the eye image relative to a horizontal line;

[0030] determining a deflection angle of the intraocular lens relative to the scanning direction according to the imaging lens width and the actual lens width of the intraocular lens;

[0031] The angle between the long axis of the intraocular lens and the horizontal line is determined according to the rotation angle and the deflection angle.

[0032] Optionally, the preset parameter range includes at least one of the following: the preset parameter range corresponding to the maximum distance between the lower boundary of the cornea and the upper boundary of the artificial lens in the vertical direction is greater than 2.8 mm, the preset parameter range corresponding to the minimum distance between the lower boundary of the artificial lens and the upper boundary of the lens in the vertical direction is 200 μm to 1000 μm, and the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line is 0° to 15°.

[0033] To achieve the above-mentioned objectives, a second embodiment of the present disclosure provides a surgical microscope system for implanting an intraocular lens, comprising:

[0034] An eye image acquisition unit, used for acquiring eye images during surgery;

[0035] An OCT unit, used for acquiring OCT scan images of the eye;

[0036] One or more control computing units, used to obtain and calculate at least one relative position information between the artificial lens and the eye according to any method described in any one of the embodiments of the first aspect, and / or for identifying eye tissue areas and boundaries, and / or for determining surgical stage information based on eye images or videos during the operation.

[0037] In summary, the intraocular lens implantation monitoring method and surgical microscope system provided by the present disclosure acquires an eye image and / or an OCT scan image of the eye in real time during surgery; based on the eye image and / or OCT scan image, determines at least one relative position information, including the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens, and the angle between the long axis of the intraocular lens and the horizontal line; thus, it is possible to monitor the implantation position of the intraocular lens during surgery. By issuing an adjustment prompt message when the relative position information exceeds a preset parameter range, an adjustment prompt message can be issued when the position is abnormal, thereby reducing the possibility of the abnormal position of the intraocular lens after surgery requiring a second surgery.

[0038] Additional aspects and advantages of the present disclosure will be given in part in the description below and in part will be obvious from the description below, or will be learned through practice of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The above and / or additional aspects and advantages of the present disclosure will become apparent and readily understood from the following description of the embodiments in conjunction with the accompanying drawings, in which:

[0040] Figure 1 A schematic flow chart of a method for monitoring the implantation of an intraocular lens provided in an embodiment of the present disclosure;

[0041] Figure 2 A schematic diagram showing an image segmentation and recognition result provided by an embodiment of the present disclosure;

[0042] Figure 3 A schematic diagram showing an eye image provided by an embodiment of the present disclosure;

[0043] Figure 4 A schematic diagram of a flow chart for determining an implantation process according to an embodiment of the present disclosure;

[0044] Figure 5 A flow chart for monitoring relative position information provided by an embodiment of the present disclosure;

[0045] Figure 6 Another flow chart for monitoring relative position information provided by an embodiment of the present disclosure;

[0046] Figure 7 A schematic structural diagram of a surgical microscope system for implanting an intraocular lens provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0047] The following describes in detail embodiments of the present disclosure, examples of which are shown in the accompanying drawings, wherein the same or similar reference numerals throughout represent the same or similar elements or elements having the same or similar functions. The embodiments described below with reference to the accompanying drawings are exemplary and are intended to be used to explain the present disclosure, and should not be construed as limiting the present disclosure.

[0048] The present disclosure is described in detail below with reference to specific embodiments.

[0049] In the first embodiment, if Figure 1 As shown, Figure 1 This is a flow chart of a method for monitoring intraocular lens implantation, provided by an embodiment of the present disclosure. This method can be implemented using a computer program and run on a surgical microscope system used for intraocular lens implantation. The computer program can be integrated into an application or run as a standalone tool application.

[0050] The method for monitoring the implantation of an intraocular lens can be performed by a surgical microscope system for intraocular lens implantation.

[0051] For example, the method for monitoring the implantation of an intraocular lens includes the following steps:

[0052] S101, acquiring a real-time eye image and / or an OCT scan image of the eye;

[0053] Among them, the eye image refers to the eye imaging image under the surgical field of view observed under a surgical microscope.

[0054] OCT scan images are those obtained using optical coherence tomography (OCT). OCT is a non-invasive imaging technology that uses the coherence of light to obtain high-resolution cross-sectional images of biological tissue or other materials. It can be used in medicine, particularly ophthalmology, to examine subtle changes in ocular structures such as the retina and optic nerve, providing real-time, high-resolution eye images.

[0055] S102, determining at least one relative position information between the intraocular lens and the eye based on the eye image and / or the OCT scan image;

[0056] An intraocular lens (IOL) is a precision optical component surgically implanted into the eye to replace the removed, naturally occurring, cloudy lens. For example, the IOL can be a posterior chamber fixed IOL, designed to be implanted into the posterior chamber. For example, the IOL can be an implantable collamer lens (ICL).

[0057] Among them, the at least one relative position information includes but is not limited to the maximum distance between the lower boundary of the cornea and the upper boundary of the artificial lens in the vertical direction, the minimum distance between the lower boundary of the artificial lens and the upper boundary of the lens in the vertical direction, the angle between the long axis of the artificial lens and the horizontal line and other relative position information.

[0058] The horizontal line refers to the horizontal line of the eyeball. For example, when the shape of the eyeball is described as an ellipse, the horizontal line is the line corresponding to the long axis of the eyeball.

[0059] S103: When the relative position information exceeds a preset parameter range, an adjustment prompt message is issued.

[0060] Wherein, each type of relative position information in the at least one relative position information has a corresponding preset parameter range. The preset parameter range does not specifically refer to a fixed range, and the preset parameter range can be adjusted according to actual application scenarios.

[0061] The adjustment prompt information is used to prompt the user to adjust the position of the intraocular lens. The adjustment prompt information can be sent in the form of voice, text, or images.

[0062] In summary, the method provided in this embodiment acquires an eye image and / or an OCT scan image of the eye in real time during surgery; based on the eye image and / or OCT scan image, determines at least one type of relative position information, including the maximum vertical distance between the lower border of the cornea and the upper border of the intraocular lens, the minimum vertical distance between the lower border of the intraocular lens and the upper border of the lens, and the angle between the long axis of the intraocular lens and the horizontal line; thus, it is possible to monitor the implant position of the intraocular lens during surgery. When the relative position information exceeds a preset parameter range, an adjustment prompt message is issued; therefore, an adjustment prompt message can be issued when the position is abnormal, thereby reducing the possibility of the abnormal position of the intraocular lens after surgery, resulting in the need for a second surgery.

[0063] Another embodiment of the present disclosure provides a method for monitoring the implantation of an intraocular lens, which can be performed by a surgical microscope system for intraocular lens implantation.

[0064] For example, the method for monitoring the implantation of an intraocular lens may include the following steps:

[0065] S201, acquiring a real-time eye image and / or an OCT scan image of the eye.

[0066] Among them, the eye image can be obtained by determining the center position of the pupil on the surgical microscope imaging.

[0067] The center position of the pupil can be determined on a microscope image, and an OCT scan can be performed in a B-scan manner to obtain an OCT scan image.

[0068] It should be noted that intraoperative OCT can perform real-time scanning and imaging during the intraocular lens implantation process, helping doctors to accurately evaluate and adjust during the operation. Specifically, doctors can adjust the centering and relative angle of the intraocular lens in real time based on the OCT scan image, and evaluate whether the anterior chamber structure is normal, which greatly improves the safety and accuracy of the intraocular lens implantation surgery. This is especially important in complex cases or patients with anatomical abnormalities, and is of great significance for assisting doctors in intraoperative decision-making analysis. However, in related technologies, doctors are required to manually adjust the scanning position and switch the scanning mode, which increases the doctor's operating burden. Therefore, this embodiment can obtain real-time OCT scanning images of the eye, which can reduce the doctor's operating burden without the need for the doctor to manually adjust the scanning position and switch the scanning mode. This is of great significance for reducing the difficulty of the doctor's surgical operation and improving the safety of the operation.

[0069] S202: Determine surgical stage information of the intraocular lens implantation surgery based on the eye image and / or the OCT scan image.

[0070] The operation stage information is used to indicate the operation stage of the intraocular lens implantation operation, which can be, for example, the operation preparation stage or the implantation process stage.

[0071] According to some embodiments, a trained image classification model may be used to perform image classification on eye images and / or OCT scan images to obtain surgical stage information of the intraocular lens implantation surgery.

[0072] In some embodiments, an initial image classification model may be trained using an image sample set including eye image samples and / or OCT scan image samples corresponding to various surgical stages to obtain a trained image classification model.

[0073] In some embodiments, supervised learning can be used as the main method to train the initial image classification model based on the image sample set, and the gap between the model prediction results and the true labels can be measured with cross entropy loss, so as to optimize the model to more accurately identify the surgical stage.

[0074] The initial classification model may be, for example, a convolutional neural network (CNN).

[0075] In some embodiments, the image sample set can also be composed of multiple surgical video clips. Taking the general field Atomic Visual Actions (AVA) Actions dataset as an example, 200 to 400 15-minute video clips can be used as the eye image sample set. Then, for these multiple surgical video clips, the surgical stage to which the surgical video clips belong can be annotated frame by frame at a sampling rate of 1 FPS.

[0076] In some embodiments, the trained classification model can be deployed on a graphics processing unit (GPU) to ensure real-time execution of the inference process. The sampling rate of the GPU can be greater than a sampling rate threshold. The sampling rate threshold can be determined based on the actual application scenario. For example, the sampling rate threshold can be 30 FPS.

[0077] S203 , starting extraction and calculation of relevant information of relative position information according to the operation stage information, and determining the relative position information according to the relevant information.

[0078] According to some embodiments, enabling the extraction and calculation of relative position information during the pre-operative preparation phase, before the IOL implantation process has even begun, would result in unnecessary consumption of computing power. This is particularly true in the early stages of IOL implantation, where obtaining relative position information is meaningless. Therefore, to avoid ineffective calculations during the pre-operative preparation phase, the extraction and calculation of relative position information may be enabled only when surgical stage information indicates that the IOL implantation procedure is in the implantation process.

[0079] In some embodiments, the relevant information of the relative position information includes information necessary for calculating the relative position information, including but not limited to identifying corresponding tissue boundary information, obtaining corresponding OCT scanning information, etc.

[0080] According to some embodiments, when determining at least one relative positional information between the intraocular lens and the eye, image segmentation and recognition can be performed on the OCT scan image to determine the tissue boundaries of the cornea, intraocular lens, and crystalline lens. Based on the tissue boundaries, the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, as well as the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the crystalline lens, can be determined. Therefore, image segmentation and recognition can improve the accuracy of obtaining the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, as well as the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the crystalline lens.

[0081] Among them, astigmatism correction needs to be implanted strictly according to the astigmatism axis. Since the artificial lens is transparent and colorless, it is difficult to accurately identify it under the microscope. Identification through OCT scanning images can improve the accuracy of artificial lens identification.

[0082] In some embodiments, a trained semantic segmentation model can be used to identify and segment tissue and crystal region boundaries on OCT scan images.

[0083] Among them, supervised learning can be mainly used to train the initial semantic segmentation model using training data, and the Dice / cross entropy loss function is used to deal with class imbalance. The boundary loss function is used to optimize the segmentation boundary to obtain a trained semantic segmentation model. In this training data, each pixel is classified into different types by accurately annotating the contour boundaries of the tissue structure. Taking the cataract surgery segmentation dataset (CATARACTSDataset) as an example, it contains 4.5k images from 35 surgical videos, annotated with 20 categories of tissue structures, including pupil, eye retractor, iris, skin, cornea, and other instruments.

[0084] The initial semantic segmentation model can be, for example, a CNN. Deep learning-based CNN models automatically extract key features from data for prediction, classification, or generation. They can analyze OCT scan images to assist doctors in diagnosing diseases, planning surgical procedures, and monitoring postoperative recovery. They can also automatically segment and annotate structures such as the anterior chamber, iris, and lens in ocular images and / or OCT scans. These models offer the advantages of high efficiency, precision, and automation, are more robust for dynamic intraoperative scenarios, and provide more accurate and effective image segmentation and recognition results.

[0085] During the deployment and use of the trained semantic segmentation model, a segmentation mask can be inferred from the input image, and connectivity analysis and contour retrieval can be performed on the binary image to determine the boundaries of different tissues. Combined with the Compute Unified Device Architecture (CUDA) / Tensor Runtime (TensorRT) deployment, the sampling rate can reach 60 FPS, ensuring efficient computing in the surgical environment. This makes parameter calculation and evaluation more accurate and effective, avoiding delays in postoperative evaluation and treatment.

[0086] Take a scenario as an example, Figure 2 This is a schematic diagram showing an image segmentation and recognition result provided by an embodiment of the present disclosure. Figure 2 As shown in the figure, the trained semantic segmentation model is used to segment and identify the cornea, iris, lens, and ICL in the OCT scan image, and the tissue boundaries of the cornea, iris, lens, and ICL are determined.

[0087] The lower boundary curve of the cornea is denoted as y1(x), which represents the vertical coordinate of the lower surface of the cornea as a function of the horizontal coordinate x. The upper boundary curve of the ICL is denoted as y2(x), which represents the vertical coordinate of the upper surface of the ICL as a function of the horizontal coordinate x. Therefore, the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens can be calculated as H1 = MAX(y1(x) - y2(x)). The maximum value of H1 indicates the location of the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the ICL within the entire field of view in the coordinate system of the OCT image.

[0088] The lower boundary curve of the ICL is denoted as y3(x), which represents the vertical coordinate of the lower surface of the ICL as a function of the horizontal coordinate x. The upper boundary curve of the lens is denoted as y4(x), which represents the vertical coordinate of the upper surface of the lens as a function of the horizontal coordinate x. Therefore, the minimum vertical distance between the lower boundary of the ICL and the upper boundary of the lens can be calculated as H2 = MIN(y3(x) - y4(x)). The minimum value of H2 indicates the location of the minimum vertical distance between the lower boundary of the ICL and the upper boundary of the lens within the field of view in the coordinate system of the OCT image.

[0089] The y-axis direction may be positive downward, that is, a larger y value indicates a closer proximity to the fundus.

[0090] According to some embodiments, when determining at least one relative positional information between the intraocular lens and the eye, the imaged lens width of the intraocular lens in the OCT scan image can also be determined; the rotation angle of the scanning direction corresponding to the eye image relative to the horizontal line can be determined; the deflection angle of the intraocular lens relative to the scanning direction can be determined based on the imaged lens width and the actual lens width of the intraocular lens; and the angle between the long axis of the intraocular lens and the horizontal line can be determined based on the rotation angle and the deflection angle. Therefore, by calculating the angle between the long axis of the intraocular lens and the horizontal line based on the imaging characteristics, the accuracy of the angle determination between the long axis of the intraocular lens and the horizontal line can be improved.

[0091] In some embodiments, the imaging crystal width in the current scanning direction can be obtained by performing scanning imaging width calculation on the OCT image. Figure 2 As shown, when performing scanning imaging width calculation, the imaging crystal width W of the ICL can be calculated by segmenting and identifying the tissue boundary of the ICL.

[0092] Take a scenario as an example, Figure 3 This is a schematic diagram showing an eye image provided by an embodiment of the present disclosure. Figure 3As shown, given the actual ICL lens width w0 and the imaging lens width W, the ICL deflection angle b relative to the scanning direction can be calculated using general trigonometric relationships, where b = ARCSIN(w0 / W). Furthermore, the angle c between the ICL lens's long axis and the horizontal line can be calculated using plane angle relationships, where c = 180° - ab, or c = ba, where a is the rotation angle of the scanning direction relative to the horizontal line corresponding to the eye image.

[0093] For example, when the eye image is scanned at an angle perpendicular to the horizontal line, a=90°, c=180°-90°-b=90°-b.

[0094] S204 , based on the relative position information and the surgical stage information, the relative position setting information is superimposed and displayed on the eye image and / or the OCT scan image.

[0095] According to some embodiments, the relative position setting information is numerical value information and / or indication information of the relative position information.

[0096] In some embodiments, the indication information may include information showing that the value of the relative position information is greater than or less than the standard value based on the standard value, so as to further adjust the position of the artificial lens; and / or displaying line segments, areas, etc. indicating the value of the relative position information.

[0097] It should be noted that the implantation process stage includes an adjustment stage and a non-adjustment stage, and the extraction and calculation of relevant information of the relative position information can be enabled in both stages of the implantation process. Among them, the calculation in the non-adjustment stage is preparatory and can be used for reference, and the relative position setting information can be superimposed and displayed in the non-adjustment stage. However, in the adjustment stage, that is, during the surgical operation, the display of the relative position setting information may affect the doctor's operation. Therefore, the superimposed display of the relative position setting information may not be performed in the adjustment stage, and the calculation of the relative position information may not be performed in the adjustment stage. In other words, the extraction and calculation of relevant information of the relative position information can be enabled only when the surgical stage information indicates that the intraocular lens implantation operation is in the non-adjustment stage of the implantation process stage, thereby further reducing the consumption of computing power while reducing the impact on the doctor's work.

[0098] The main criterion for determining whether an instrument is being used in the image is the adjustment phase or the non-adjustment phase. For example, the phase where an instrument is being used to adjust the intraocular lens is the adjustment phase, while the phase where an instrument is not being used to adjust the intraocular lens is the non-adjustment phase.

[0099] Take a scenario as an example, Figure 4 This is a flow chart of an implantation process judgment provided by an embodiment of the present disclosure. Figure 4 As shown, during the intraocular lens implantation surgery, the surgical microscope is controlled to capture an eye image; thereafter, the surgical stage is determined and identified based on the eye image and an OCT scan is started; if the surgical stage identification result is that the intraocular lens is currently being adjusted, the eye image and / or OCT scan image is displayed; if the surgical stage identification result is that the intraocular lens is not currently being adjusted, relevant parameters are calculated based on the eye image and / or OCT scan image, and relative position setting information is superimposed and displayed while displaying the eye image and / or OCT scan image.

[0100] It should be noted that this embodiment controls the surgical microscope to capture real-time images and perform identification steps during the IOL implantation procedure, thereby employing targeted scanning and processing operations. Specifically, only OCT scanning and imaging are performed when the IOL is being adjusted, while implantation parameters are calculated based on the OCT scanning results when the IOL is not being adjusted. Therefore, intraoperative OCT not only provides auxiliary observation but also helps the surgeon accurately assess and adjust the IOL during the procedure. This eliminates the need for the surgeon to manually adjust the OCT scan, thereby improving surgical safety and accuracy.

[0101] S205: When the relative position information exceeds a preset parameter range, an adjustment prompt message is issued.

[0102] It should be noted that the relative position setting information can be displayed throughout the implantation process, or during any non-adjustment phase within the implantation process. However, the adjustment prompt information is only issued when the relative position information exceeds a preset parameter range. For example, after the relative position information is calculated during the non-adjustment phase, the relative position setting information will be superimposed and displayed on the eye image and / or OCT scan image. Furthermore, the adjustment prompt information will only be issued when the relative position information exceeds the preset parameter range; otherwise, the adjustment prompt information will not be issued.

[0103] Among them, the preset parameter range can include at least one of the following: the preset parameter range corresponding to the maximum distance between the lower boundary of the cornea and the upper boundary of the artificial lens in the vertical direction, the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line, and the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line.

[0104] According to some embodiments, the central anterior chamber depth is maintained at greater than 2.8 mm to prevent the intraocular lens from being too close to the corneal endothelium. Therefore, the preset parameter range corresponding to the maximum vertical distance between the lower border of the cornea and the upper border of the intraocular lens can be set to be greater than 2.8 mm.

[0105] In some embodiments, the normal range of the minimum distance between the lower border of the intraocular lens and the upper border of the lens in the vertical direction is 250μm to 750μm. If it is greater than 1000um, it may be too high, resulting in angle closure and increased intraocular pressure. If it is less than 200um, it may be too low, increasing the risk of lens contact and cataracts. Therefore, the preset parameter range corresponding to the minimum distance between the lower border of the intraocular lens and the upper border of the lens in the vertical direction can be set to 200μm to 1000μm. Further, the preset parameter range corresponding to the minimum distance between the lower border of the intraocular lens and the upper border of the lens in the vertical direction can be set to 250μm to 750μm.

[0106] Take a scenario as an example, Figure 5 This is a flow chart of monitoring relative position information provided by the embodiment of the present disclosure. Figure 5 As shown, when the surgical stage is not an adjustment stage, an eye image can be collected through a surgical microscope; then, the pupil center position is determined based on the collected eye image and an OCT scan is started; then, an OCT scan is performed in the form of a B-scan to obtain an OCT scan image; then, tissue boundaries in the OCT scan image are identified and segmented; then, distance parameters are calculated based on the identified and segmented tissue boundaries to obtain the maximum vertical distance between the lower boundary of the cornea and the upper boundary of the intraocular lens, and the minimum vertical distance between the lower boundary of the intraocular lens and the upper boundary of the lens; if the distance parameters do not exceed the preset parameter range, imaging display is performed; if the distance parameters exceed the preset parameter range, an adjustment prompt message is issued and imaging display is performed. When the imaging display is performed, the eye image and / or OCT scan image are displayed while the relative position setting information is superimposed.

[0107] According to some embodiments, if the angle between the long axis of the intraocular lens and the horizontal line is less than 5°, it indicates a slight rotation error. In this case, observation and follow-up can be performed, and vision is usually not significantly affected. If the implantation angle is between 5° and 15°, it means that the intraocular lens may need to be re-rotated to align it with the correct axis. If the implantation angle is greater than 15°, it indicates a serious rotation error, and a secondary surgery is usually required to adjust or replace the intraocular lens. Therefore, the preset parameter range corresponding to the angle between the long axis of the intraocular lens and the horizontal line can be set to 0° to 15°. Furthermore, the preset parameter range corresponding to the angle between the long axis of the intraocular lens and the horizontal line can be set to 0° to 5°.

[0108] Take a scenario as an example, Figure 6 This is another flow chart for monitoring relative position information provided by the embodiment of the present disclosure. Figure 6As shown, when the surgical stage is not an adjustment stage, an eye image can be collected through a surgical microscope; then, the pupil center position is determined based on the collected eye image and an OCT scan is initiated; then, the imaged lens width of the ICL on the OCT scan image and the actual lens width of the ICL are determined; then, an angle parameter is calculated to obtain the angle between the long axis of the intraocular lens and the horizontal line; then, it is determined whether the angle parameter exceeds the preset parameter range; if the angle parameter does not exceed the preset parameter range, only imaging display is performed; if the angle parameter exceeds the preset parameter range, an adjustment prompt message is issued and imaging display is performed. When performing imaging display, the eye image and / or OCT scan image are displayed, and the relative position setting information is superimposed and displayed.

[0109] According to some embodiments, the sending of the adjustment prompt information may be implemented by at least one of the following methods:

[0110] Indicating that the relative position information exceeds the preset parameter range by superimposing the change of the relative position setting information displayed;

[0111] Identify the intraocular lens on the operating microscope by projection and highlight the intraocular lens;

[0112] An audible warning is used to indicate that the relative position information exceeds the preset parameter range.

[0113] Among them, the relative position information exceeds the preset parameter range by superimposing the change of the displayed relative position setting information to indicate that the relative position information exceeds the preset parameter range, so that when the adjustment prompt information is issued, the change of the relative position setting information can be displayed by changing the data of the numerical value of the displayed relative position information, changing the font size of the numerical value, changing the color of the numerical value, changing the color of the line segment mark, and synchronously displaying the corresponding symbol information.

[0114] Among them, the artificial lens is identified on the surgical microscope by projection and indicated in a highlighted manner to achieve the issuance of adjustment prompt information. A preset color or pattern can be used to cover the area where the artificial lens is located, or a preset color or pattern can be used to cover the area between the artificial lens and other parts to indicate the distance between the artificial lens and other parts.

[0115] Among them, a sound warning is used to indicate that the relative position information exceeds the preset parameter range, so that when the adjustment prompt information is issued, a voice broadcast of "the relative position information exceeds the preset parameter range and the specific exceeding value" can be issued, or a specific prompt sound such as a beep can be issued to prompt that the relative position information exceeds the preset parameter range.

[0116] In summary, the effect of current intraocular lens implantation surgery is usually evaluated by postoperative OCT system scanning. If the position is incorrect or the correction effect is not good, a second operation is required, which can easily delay the treatment time. At the same time, intraoperative OCT mostly requires manual adjustment. OCT imaging only provides auxiliary observation functions and lacks the ability to accurately determine the position during surgery. The method provided in this embodiment automatically identifies and locates the intraocular lens during surgery and guides the OCT to scan the implantation process in real time, monitors the relative position information of the intraocular lens and the eye in real time, and provides adjustment prompt information based on the relative position information and the preset parameter range. This can effectively reduce the risk of intraoperative operation, reduce the possibility of secondary surgery, and help reduce the risk of abnormal position or damage of the intraocular lens during surgery, thereby improving surgical efficiency and success rate.

[0117] In order to implement the above embodiments, the present disclosure also proposes a surgical microscope system for intraocular lens implantation.

[0118] For example, Figure 7 This is a schematic diagram of the structure of a surgical microscope system for intraocular lens implantation provided by an embodiment of the present disclosure. Figure 7 As shown, the surgical microscope system 700 for intraocular lens implantation includes:

[0119] Eye image acquisition unit 701, used to acquire eye images during surgery;

[0120] The OCT unit 702 is used to obtain an OCT scan image of the eye;

[0121] One or more control computing units 703 are used to obtain and calculate at least one relative position information between the intraocular lens and the eye according to the method shown in the aforementioned embodiment, and / or to identify the eye tissue area and boundaries, and / or to determine the surgical stage information based on the eye image or video during the operation.

[0122] Optionally, the control calculation unit 703 can be used to determine at least one relative position information between the artificial lens and the eye based on the eye image and / or the OCT scan image, wherein the at least one relative position information includes the maximum distance between the lower boundary of the cornea and the upper boundary of the artificial lens in the vertical direction, the minimum distance between the lower boundary of the artificial lens and the upper boundary of the lens in the vertical direction, and the angle between the long axis of the artificial lens and the horizontal line; when the relative position information exceeds the preset parameter range, an adjustment prompt message is issued.

[0123] Optionally, when the control calculation unit 703 is configured to determine at least one relative position information between the intraocular lens and the eye based on the eye image and / or the OCT scan image, it is specifically configured to:

[0124] Determining surgical stage information of intraocular lens implantation surgery based on eye images and / or OCT scan images;

[0125] According to the operation stage information, the extraction and calculation of the relevant information of the relative position information are started, and the relative position information is determined according to the relevant information.

[0126] Optionally, when the control calculation unit 703 is configured to determine the surgical stage information of the intraocular lens implantation surgery based on the eye image and / or the OCT scan image, it is specifically configured to:

[0127] A trained image classification model is used to perform image classification on eye images and / or OCT scan images to obtain surgical stage information of the intraocular lens implantation surgery, wherein the trained image classification model is obtained by training an initial image classification model using an image sample set, and the image sample set includes eye image samples and / or OCT scan image samples corresponding to multiple surgical stages.

[0128] Optionally, when the control calculation unit 703 is used to start extracting and calculating relevant information of the relative position information according to the surgical stage information, it is specifically used to:

[0129] When the surgical stage information indicates that the intraocular lens implantation surgery is in the implantation process stage, starting the extraction and calculation of the relevant information of the relative position information; or,

[0130] When the operation stage information indicates that the intraocular lens implantation operation is in a non-adjustment stage in the implantation process, the extraction and calculation of the relevant information of the relative position information is started.

[0131] Optionally, the intraocular lens implantation surgical microscope system 700 may further include an image display unit. After determining at least one relative position information based on the relevant information, the image display unit is configured to:

[0132] Based on the relative position information and the surgical stage information, the relative position setting information is superimposed and displayed on the eye image and / or the OCT scan image, wherein the relative position setting information is numerical information and / or indication information of the relative position information.

[0133] Optionally, the intraocular lens implantation surgical microscope system 700 may further include an information prompting unit, which adjusts the prompting information by at least one of the following methods:

[0134] Indicating that the relative position information exceeds the preset parameter range by superimposing the change of the relative position setting information displayed;

[0135] Identify the intraocular lens on the operating microscope by projection and highlight the intraocular lens;

[0136] An audible warning is used to indicate that the relative position information exceeds the preset parameter range.

[0137] Optionally, when the control calculation unit 703 is used to determine at least one relative position information between the intraocular lens and the eye, it is specifically used to:

[0138] Perform image segmentation and recognition on OCT scan images to determine the tissue boundaries of the cornea, intraocular lens, and lens;

[0139] According to the tissue boundaries, the maximum vertical distance between the lower border of the cornea and the upper border of the intraocular lens and the minimum vertical distance between the lower border of the intraocular lens and the upper border of the lens were determined.

[0140] Optionally, when the control calculation unit 703 is used to determine at least one relative position information between the intraocular lens and the eye, it is specifically used to:

[0141] Determine the imaging lens width of the intraocular lens in OCT scan images;

[0142] Determine the rotation angle of the scanning direction corresponding to the eye image relative to the horizontal line;

[0143] Determine the deflection angle of the intraocular lens relative to the scanning direction according to the imaging lens width and the actual lens width of the intraocular lens;

[0144] According to the rotation angle and deflection angle, the angle between the long axis of the intraocular lens and the horizontal line is determined.

[0145] Optionally, the preset parameter range includes at least one of the following: the preset parameter range corresponding to the maximum distance between the lower boundary of the cornea and the upper boundary of the artificial lens in the vertical direction is greater than 2.8 mm, the preset parameter range corresponding to the minimum distance between the lower boundary of the artificial lens and the upper boundary of the lens in the vertical direction is 200 μm to 1000 μm, and the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line is 0° to 15°.

[0146] It should be noted that the above explanation of the embodiment of the monitoring method for intraocular lens implantation is also applicable to the surgical microscope system for intraocular lens implantation of this embodiment, and will not be repeated here.

[0147] In summary, the system provided by the embodiments of the present disclosure acquires an eye image and / or an OCT scan image of the eye in real time during surgery; based on the eye image and / or OCT scan image, determines at least one relative position information, including the maximum vertical distance between the lower border of the cornea and the upper border of the intraocular lens, the minimum vertical distance between the lower border of the intraocular lens and the upper border of the lens, and the angle between the long axis of the intraocular lens and the horizontal line; thus, it is possible to monitor the implant position of the intraocular lens during surgery. By issuing an adjustment prompt message when the relative position information exceeds a preset parameter range, an adjustment prompt message can be issued when the position is abnormal, thereby reducing the possibility of the abnormal position of the intraocular lens after surgery requiring a second surgery.

[0148] The collection, storage, use, processing, transmission, provision and disclosure of user personal information involved in this disclosure are in compliance with relevant laws and regulations and do not violate public order and good morals.

[0149] It is important to note that personal information collected from users should be used for legitimate and reasonable purposes and should not be shared or sold beyond these legitimate uses. Furthermore, such collection / sharing should be conducted only after receiving the user's informed consent, including but not limited to notifying the user to read the user agreement / user notice and sign an agreement / authorization that includes the relevant user information before using the feature. Furthermore, any necessary steps must be taken to safeguard and secure access to such personal information and ensure that others with access to personal information comply with its privacy policy and procedures.

[0150] This disclosure contemplates providing implementations that allow users to selectively block the use or access of personal information data. Specifically, this disclosure contemplates providing hardware and / or software to prevent or block access to such personal information data. Risks can be minimized by limiting data collection and deleting data once it is no longer needed. Furthermore, where applicable, such personal information can be de-identified to protect user privacy.

[0151] In the descriptions of the aforementioned embodiments, the reference terms "one embodiment", "some embodiments", "example", "specific example", or "some examples" mean that the specific features, structures, materials or characteristics described in conjunction with the embodiment or example are included in at least one embodiment or example of the present disclosure. In this specification, the schematic expressions of the above terms do not necessarily refer to the same embodiment or example. Moreover, the specific features, structures, materials or characteristics described may be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art may combine and combine the different embodiments or examples described in this specification and the features of the different embodiments or examples, unless they are mutually inconsistent.

[0152] Furthermore, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of technical features being referred to. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. Throughout the present disclosure, "plurality" means at least two, such as two, three, etc., unless otherwise specifically defined.

[0153] Any process or method description in a flowchart or otherwise described herein may be understood to represent a module, segment or portion of code comprising one or more executable instructions for implementing the steps of a custom logical function or process, and the scope of the preferred embodiments of the present disclosure includes additional implementations in which functions may be performed out of the order shown or discussed, including performing functions in a substantially simultaneous manner or in the reverse order depending on the functions involved, which should be understood by those skilled in the art to which the embodiments of the present disclosure belong.

[0154] The logic and / or steps represented in the flowcharts or otherwise described herein, for example, can be considered as a sequenced list of executable instructions for implementing the logical functions, and can be embodied in any computer-readable medium for use by, or in conjunction with, an instruction execution system, apparatus, or device (e.g., a computer-based system, a system including a processor, or other system that can fetch and execute instructions from an instruction execution system, apparatus, or device). For purposes of this specification, "computer-readable medium" can be any device that can contain, store, communicate, propagate, or transport a program for use by, or in conjunction with, an instruction execution system, apparatus, or device. More specific examples (a non-exhaustive list) of computer-readable media include the following: an electrical connection with one or more wires (electronic devices), a portable computer disk cartridge (magnetic devices), a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM) or flash memory, a fiber optic device, and a portable compact disc read-only memory (CDROM). In addition, the computer-readable medium may even be paper or other suitable medium on which the program is printed, since the program may be obtained electronically, for example, by optically scanning the paper or other medium, followed by editing, deciphering, or processing in another suitable manner as necessary, and then stored in a computer memory.

[0155] It should be understood that various parts of the present disclosure can be implemented using hardware, software, firmware, or a combination thereof. In the above-described embodiments, multiple steps or methods can be implemented using software or firmware stored in a memory and executed by a suitable instruction execution system. For example, if implemented using hardware, as in another embodiment, any one of the following technologies known in the art or a combination thereof can be used to implement the present invention: a discrete logic circuit having a logic gate circuit for implementing a logic function on a data signal, an application-specific integrated circuit having a suitable combination of logic gate circuits, a programmable gate array (PGA), a field programmable gate array (FPGA), etc.

[0156] Those skilled in the art will appreciate that all or part of the steps in the method for implementing the above-mentioned embodiment can be completed by instructing related hardware through a program, and the program can be stored in a computer-readable storage medium. When the program is executed, it includes one or a combination of the steps of the method embodiment.

[0157] In addition, the functional units in the various embodiments of the present disclosure may be integrated into a single processing module, each unit may exist physically separately, or two or more units may be integrated into a single module. The aforementioned integrated modules may be implemented in the form of hardware or in the form of software functional modules. If the integrated modules are implemented in the form of software functional modules and sold or used as independent products, they may also be stored in a computer-readable storage medium.

[0158] The storage medium mentioned above may be a read-only memory, a magnetic disk, or an optical disk, etc. Although the embodiments of the present disclosure have been shown and described above, it is understood that the above embodiments are exemplary and should not be construed as limiting the present disclosure. A person of ordinary skill in the art may make changes, modifications, substitutions, and variations to the above embodiments within the scope of the present disclosure.

Claims

1. A method for monitoring implantation of an artificial lens, characterized in that: include: Acquiring real-time ocular images and / or OCT scan images of the eye; determining at least one type of relative position information between the intraocular lens and the eye based on the eye image and / or the OCT scan image, wherein the at least one type of relative position information includes a maximum distance between a lower boundary of the cornea and an upper boundary of the intraocular lens in a vertical direction, a minimum distance between a lower boundary of the intraocular lens and an upper boundary of the lens in a vertical direction, and an angle between a long axis of the intraocular lens and a horizontal line; When the relative position information exceeds the preset parameter range, an adjustment prompt message is issued.

2. The method according to claim 1, characterized in that Determining at least one relative position information between the intraocular lens and the eye based on the eye image and / or the OCT scan image includes: determining surgical stage information of an intraocular lens implantation surgery based on the eye image and / or the OCT scan image; According to the operation stage information, extraction and calculation of relevant information of the relative position information are started, and the relative position information is determined according to the relevant information.

3. The method according to claim 2, characterized in that Determining surgical stage information of the intraocular lens implantation surgery based on the eye image and / or the OCT scan image includes: A trained image classification model is used to perform image classification on the eye image and / or the OCT scan image to obtain surgical stage information of the intraocular lens implantation surgery, wherein the trained image classification model is obtained by training an initial image classification model using an image sample set, and the image sample set includes eye image samples and / or OCT scan image samples corresponding to multiple surgical stages.

4. The method according to claim 2, characterized in that The extracting and calculating of the relevant information of the relative position information based on the surgical stage information includes: When the operation stage information indicates that the intraocular lens implantation operation is in the implantation process stage, starting the extraction and calculation of the relevant information of the relative position information; or, When the operation stage information indicates that the intraocular lens implantation operation is in a non-adjustment stage of the implantation process, the extraction and calculation of the relevant information of the relative position information is started.

5. The method according to claim 2, characterized in that After determining the at least one relative position information according to the relevant information, the method further includes: Based on the relative position information and the surgical stage information, relative position setting information is superimposed and displayed on the eye image and / or the OCT scan image, wherein the relative position setting information is numerical information and / or indication information of the relative position information.

6. The method according to claim 5, characterized in that The adjustment prompt information is sent out in at least one of the following ways: Indicating that the relative position information exceeds the preset parameter range by superimposing a change in the displayed relative position setting information; Identifying the intraocular lens on the surgical microscope by projection and indicating the intraocular lens in a highlighted manner; The relative position information is indicated as exceeding the preset parameter range by means of a sound warning.

7. The method according to any one of claims 1 to 6, characterized in that The determining of at least one relative position information between the intraocular lens and the eye includes: Performing image segmentation and recognition on the OCT scan image to determine the tissue boundaries of the cornea, the intraocular lens, and the lens; According to the tissue boundary, the maximum distance between the lower boundary of the cornea and the upper boundary of the intraocular lens in the vertical direction and the minimum distance between the lower boundary of the intraocular lens and the upper boundary of the lens in the vertical direction are determined.

8. The method according to any one of claims 1 to 6, characterized in that The determining of at least one relative position information between the intraocular lens and the eye includes: determining an imaged crystal width of the intraocular lens in the OCT scan image; Determining a rotation angle of a scanning direction corresponding to the eye image relative to a horizontal line; determining a deflection angle of the intraocular lens relative to the scanning direction according to the imaging lens width and the actual lens width of the intraocular lens; The angle between the long axis of the intraocular lens and the horizontal line is determined according to the rotation angle and the deflection angle.

9. The method according to any one of claims 1 to 6, characterized in that The preset parameter range includes at least one of the following: the preset parameter range corresponding to the maximum distance between the lower boundary of the cornea and the upper boundary of the artificial lens in the vertical direction is a value greater than 2.8 mm, the preset parameter range corresponding to the minimum distance between the lower boundary of the artificial lens and the upper boundary of the lens in the vertical direction is 200 μm to 1000 μm, and the preset parameter range corresponding to the angle between the long axis of the artificial lens and the horizontal line is 0° to 15°.

10. A surgical microscope system for intraocular lens implantation, characterized in that: include: An eye image acquisition unit, used for acquiring eye images during surgery; An OCT unit, used for acquiring OCT scan images of the eye; One or more control computing units, used to obtain and calculate at least one relative position information between the intraocular lens and the eye according to the method described in any one of claims 1 to 9, and / or to identify the area and boundaries of eye tissue, and / or to determine surgical stage information based on eye images or videos during the operation.

Images