Eye movement safety control method, electronic device and storage medium

Abstract

The present invention provides an eye movement safety control method, an electronic device and a storage medium. The method comprises: determining the initial position of the target tissue according to a target initial image of the target tissue in the eye of a target user; aiming a laser emission point at the initial position of the target tissue; acquiring a key image acquired at the current moment; determining the key position of the target tissue on the key image; determining whether the position of the target tissue in the eye aimed at by the laser emission point moves according to the key position and the initial position; if the position of the target tissue in the eye aimed at by the laser emission point does not move, it means that the eye of the target user does not deviate and move during the time period between the acquisition time of the target initial image and the acquisition time of the key image, and the target tissue can be irradiated with a therapeutic light beam, and the laser emission point is controlled to emit a therapeutic light beam to the target tissue in the eye of the target user, so as to achieve safety protection of the eye of the target user during surgery.

Description

Background Art

[0002] Photocoagulation surgery is a surgery that obtains an image of the user's eye, determines the location of the target tissue in the user's eye, and then uses a laser transmitter to emit a therapeutic beam to the target tissue in the user's eye to treat the user's eye. Current photocoagulation surgery immediately emits a therapeutic beam to the target tissue after determining the location of the target tissue in the user's eye. However, if the user's eye moves during the period between the acquisition time of the user's eye image and the emission time of the therapeutic beam, so that the target tissue is not at the location determined by the eye image, the therapeutic beam will be emitted to the target tissue location determined based on the eye image, resulting in the location of the therapeutic beam irradiating is not the actual location of the target tissue, which will cause damage to the user's eyes and endanger the user's safety. Summary of the invention

[0003] In view of the above technical problems, the technical solution adopted by the present invention is:

[0004] According to one aspect of the present application, there is provided an eye movement safety control method, comprising the following steps:

[0005] Step S100, in response to receiving a target initial image of a target tissue in an eye of a target user, determining an initial position of the target tissue in the eye of the target user on the target initial image according to the target initial image;

[0006] Step S200, aiming the laser emission point at the target tissue in the eye of the target user according to the initial position; the laser emission point is used to emit a treatment beam;

[0007] Step S300, obtaining a key image of the target tissue in the eye of the target user collected at the current moment;

[0008] Step S400, determining the key position of the target tissue in the eye of the target user on the key image according to the key image;

[0009] Step S500, determining whether the position of the target tissue in the eye aimed at by the laser emission point moves according to the key position and the initial position;

[0010] Step S600: If the position of the target tissue in the eye aimed at by the laser emission point does not move, the laser emission point is controlled to emit a treatment light beam to the target tissue in the eye of the target user.

[0011] In an exemplary embodiment of the present application, the target initial image is determined by the following steps:

[0012] Step S101, obtaining a number of initial images of target tissues in the eyes of a target user within a target time period; the end time of the target time period is the current time;

[0013] Step S102: Obtain a number of image features of each initial image to obtain an image feature list set A = (A1, A2, ..., A i ,...,A n );A i =(A i1 ,A i2 ,...,A im ,...,A if(i) ), where i = 1, 2, ..., n, and n is the number of initial images; A i is the image feature list corresponding to the i-th initial image; m = 1, 2, ..., f(i); f(i) is the number of image features included in the i-th initial image; A im is the mth image feature included in the i-th initial image;

[0014] Step S103, traverse the image feature list set A, if A im is the preset key image feature, then A im Determine the target image features and obtain the target image feature quantity list B corresponding to each initial image = (B1, B2, ..., B i ,...,B n ), where B i is the number of target image features included in the i-th initial image;

[0015] Step S104, marking the pixel points corresponding to each target image feature in the initial image corresponding to MAX(B) to obtain the target initial image; wherein MAX() is a preset maximum value determination function.

[0016] In an exemplary embodiment of the present application, the initial position of the target tissue in the eye of the target user is the position of the area surrounded by the marked pixel points on the target initial image.

[0017] In an exemplary embodiment of the present application, step S200 includes:

[0018] Step S210, determining an initial image aiming point corresponding to the target initial image according to a number of target image features included in the target initial image;

[0019] Step S220, determining the laser aiming point corresponding to the target tissue in the eye of the target user according to the aiming point of the initial image;

[0020] Step S230, moving the laser emission point to the laser aiming point.

[0021] In an exemplary embodiment of the present application, step S400 includes:

[0022] Step S410: Determine a key image aiming point corresponding to the key image according to a number of image features included in the key image.

[0023] In an exemplary embodiment of the present application, step S500 includes:

[0024] Step S510, selecting one image feature from a plurality of non-target image features included in the target initial image, and determining it as the initial reference image feature;

[0025] Step S520, determining the image features in the key image that are the same as the initial reference image features as the key reference image features;

[0026] Step S530, determining the distance L1 and the deviation angle J1 between the pixel point corresponding to the initial reference image feature and the aiming point of the initial image;

[0027] Step S540, determining the distance L2 and the deviation angle J2 between the pixel point corresponding to the key reference image feature and the key image aiming point;

[0028] Step S550: If |L1-L2|<L0, and |J1-J2|<J0, it is determined that the position of the target tissue in the eye aimed at by the laser emission point has not moved; otherwise, it is determined that the position of the target tissue in the eye aimed at by the laser emission point has moved; wherein L0 is a preset distance difference threshold; J0 is a preset deviation angle threshold.

[0029] In an exemplary embodiment of the present application, after step S600, the eye movement safety control method further includes:

[0030] Step S610, acquiring in real time a target image of the target tissue in the eye of the target user during the process of being irradiated by the treatment light beam;

[0031] Step S620, determining an area surrounded by pixels corresponding to a plurality of key reference image features in the key image as a key area;

[0032] Step S630, determining the target area in the target image according to the position of the key area in the key image; the position of the target area in its corresponding target image is the same as the position of the key area in the key image;

[0033] Step S640: Obtain a key eigenvalue vector C=(C1, C2, ..., C j ,...,C g ), where j = 1, 2, ..., g; g is the number of pixels in the key area; C j is the characteristic value of the jth pixel in the key area;

[0034] Step S650: Obtain a target eigenvalue vector D=(D1, D2, ..., D j ,...,D g ), where D j is the characteristic value of the j-th pixel in the target area;

[0035] Step S660: If the matching degree between the key eigenvalue vector C and the target eigenvalue vector D is less than a preset matching degree threshold, the laser emission point is controlled to stop emitting the treatment beam.

[0036] In an exemplary embodiment of the present application, step S600 further includes:

[0037] Step S601: If the position of the target tissue in the eye aimed at by the laser emission point moves, the laser emission point is controlled to stop emitting the treatment light beam.

[0038] According to one aspect of the present application, a non-transitory computer-readable storage medium is provided, in which at least one instruction or at least one program is stored, and the at least one instruction or the at least one program is loaded and executed by a processor to implement the aforementioned eye movement safety control method.

[0039] According to one aspect of the present application, an electronic device is provided, comprising a processor and the aforementioned eye movement safety control method.

[0040] The present invention has at least the following beneficial effects:

[0041] The present invention determines the initial position of the target tissue in the eye of the target user on the target initial image according to several image features of the target initial image of the target tissue in the eye of the target user received, and aims the laser emission point at the initial position corresponding to the target tissue in the eye of the target user, and then determines the key position of the target tissue in the eye according to the key image of the target tissue in the eye of the target user acquired at the current moment, and determines whether the position of the target tissue in the eye aimed at by the laser emission point moves according to the deviation distance and deviation angle between the key position and the initial position. If the position of the target tissue in the eye aimed at by the laser emission point does not move, it means that the eye of the target user does not deviate and move during the time period between the acquisition time of the target initial image and the acquisition time of the key image, and the target tissue can be irradiated with a therapeutic light beam, and the laser emission point is controlled to emit a therapeutic light beam to the target tissue in the eye of the target user, so as to achieve safe protection of the eye of the target user during the operation. BRIEF DESCRIPTION OF THE DRAWINGS

[0042] In order to more clearly illustrate the technical solutions in the embodiments of the present invention, the following briefly introduces the drawings required for use in the description of the embodiments. Obviously, the drawings described below are only some embodiments of the present invention. For ordinary technicians in this field, other drawings can be obtained based on these drawings without creative work.

[0043] Figure 1 This is a flow chart of an eye movement safety control method provided by an embodiment of the present invention. DETAILED DESCRIPTION

[0044] The following will be combined with the drawings in the embodiments of the present invention to clearly and completely describe the technical solutions in the embodiments of the present invention. Obviously, the described embodiments are only part of the embodiments of the present invention, not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those skilled in the art without creative work are within the scope of protection of the present invention.

[0045] An eye movement safety control method is applied to an eye movement safety control system. The eye movement safety control system includes an image acquisition system, an image recognition system, a laser irradiation system and a lighting device.

[0046] The eye movement safety control system is used to treat the target tissue in the user's eye and determine whether the target tissue needs to be repositioned based on the movement of the target tissue during the treatment.

[0047] The image acquisition system is used to acquire images of target tissues in the eyes of the target user. The device used to acquire images in the image acquisition system is an area scan camera or a line scan camera. As the optimal embodiment, an area scan camera is preferably used.

[0048] The image recognition system is connected to the image acquisition system and is used to determine the position of the target tissue in the eye of the target user based on several initial images sent by the image acquisition system; and after receiving the laser aiming signal, confirm whether the position of the target tissue in the eye of the target user on the key image moves based on the key image sent by the image acquisition system, and if not, send a laser emission signal.

[0049] The laser irradiation system is connected to the image recognition system and is used to aim the laser emission point at the target tissue in the eye of the target user after the position of the target tissue in the eye of the target user is determined, and send a laser aiming signal to the image recognition system; and when receiving the laser emission signal sent by the image recognition system, emit a treatment light beam to the target tissue in the eye of the target user.

[0050] The image acquisition system is connected to an illumination device, which is used to emit an illumination beam, and the illumination beam is a beam used to image the target tissue to obtain the target tissue image. If the camera of the image acquisition system adopts an area scan camera, an illumination beam is required. If the camera of the image acquisition system adopts a linear scan camera, since the linear scan camera does not need to provide a light source when acquiring images, an illumination device is not required at this time.

[0051] The laser irradiation system comprises a laser emitting device, which is used to emit a therapeutic light beam, and the therapeutic light beam is a light beam used for laser treatment of a target tissue during photocoagulation surgery.

[0052] like Figure 1 As shown, the eye movement safety control method described in this application includes the following steps:

[0053] Step S100, in response to receiving a target initial image of a target tissue in an eye of a target user, determining an initial position of the target tissue in the eye of the target user on the target initial image according to the target initial image;

[0054] The target user is a user who needs to undergo photocoagulation surgery, the target tissue in the eye is the site that needs laser treatment for photocoagulation surgery, the target initial image is an image that includes imaging of the target tissue, the target tissue is imaged by an illumination light beam, and then the image of the user's eye with the target tissue is captured by an image acquisition device to obtain the target initial image.

[0055] The initial position is the relative position of the target tissue in the user's eye in the target initial image.

[0056] The target initial image is determined through steps S101 to S104:

[0057] Step S101, obtaining a number of initial images of target tissues in the eyes of a target user within a target time period; the end time of the target time period is the current time;

[0058] Step S102: Obtain a number of image features of each initial image to obtain an image feature list set A = (A1, A2, ..., A i ,...,A n );A i =(A i1 ,A i2 ,...,A im ,...,A if(i) ), where i = 1, 2, ..., n, and n is the number of initial images; A i is the image feature list corresponding to the i-th initial image; m = 1, 2, ..., f(i); f(i) is the number of image features included in the i-th initial image; A imis the mth image feature included in the i-th initial image;

[0059] The initial images are images of the target user's eyes from various directions captured by the image acquisition system. Since the initial images are images of the target user's eyes from different angles, it is necessary to first find the initial image containing the lesion location (i.e., the location requiring laser dot treatment) through the image features of each initial image.

[0060] Step S103, traverse the image feature list set A, if A im is the preset key image feature, then A im Determine the target image features and obtain the target image feature quantity list B corresponding to each initial image = (B1, B2, ..., B i ,...,B n ), where B i is the number of target image features included in the i-th initial image;

[0061] The key image features may be image features of the lesion or image features of other contrast points. If the image features of the lesion are obvious, the image features of the lesion are used as the key image features; if the image features of the lesion are not obvious (e.g., the lesion may appear as a colloid in the image without obvious features), in order to accurately find the lesion location, it is necessary to determine the contrast points of the lesion location in advance. The contrast points are points with obvious image features, such as the point where the macula is located in the eye. After determining the contrast points, determine the positional relationship between the contrast points and the lesion, such as the distance or angle between the lesion location and the contrast points, and determine the image features of the contrast points as the key image features.

[0062] Step S104, marking the pixel points corresponding to each target image feature in the initial image corresponding to MAX(B) to obtain the target initial image; wherein MAX() is a preset maximum value determination function.

[0063] The initial image including the target image features is an image that records the lesion location or the comparison point location. In order to make the location of the lesion point more accurate, the image includes the most features of the lesion location or the comparison point location. Therefore, the initial image including the most target image features is determined as the target initial image.

[0064] If the key image feature is the image feature of the lesion (target tissue), the area surrounded by the marked pixels on the target initial image is the initial position of the target tissue in the target user's eye; if the key image feature is the image feature of the comparison point, the area surrounded by the marked pixels on the target initial image is the position of the comparison point, and the initial position of the target tissue is found through the marked comparison points.

[0065] Step S200, aiming the laser emission point at the target tissue in the eye of the target user according to the initial position; the laser emission point is used to emit a treatment beam;

[0066] Further, step S200 includes steps S210 to S230, as follows:

[0067] Step S210, determining an initial image aiming point corresponding to the target initial image according to a number of target image features included in the target initial image;

[0068] If the key image feature is a lesion image feature, the position point where the target image feature is located is directly determined as the initial image aiming point corresponding to the target initial image, and the initial image aiming point is the position point where the lesion is located.

[0069] If the key image feature is the image feature of the contrast point, then after receiving the target initial image sent by the image recognition system, the location of the lesion is found based on the relative position of the contrast point corresponding to the target image feature and the lesion. The initial image aiming point corresponding to the target initial image is the location point of the lesion found, that is, the position where the laser dot is required later.

[0070] Step S220, determining the laser aiming point corresponding to the target tissue in the eye of the target user according to the aiming point of the initial image;

[0071] The initial image aiming point is a position point on the target initial image, and the laser aiming point is a point on the target tissue in the eye of the target user in reality. After the initial image aiming point is determined, the laser aiming point on the target tissue in the eye of the target user is found based on the initial image aiming point on the target initial image.

[0072] Step S230, moving the laser emission point to the laser aiming point.

[0073] Step S300, obtaining a key image of the target tissue in the eye of the target user collected at the current moment;

[0074] The key image is the image acquired by the image acquisition system at the aiming point of the initial image after receiving the image acquisition signal.

[0075] Step S400, determining the key position of the target tissue in the eye of the target user on the key image according to the key image;

[0076] Further, step S400 includes step S410:

[0077] Step S410: Determine a key image aiming point corresponding to the key image according to a number of image features included in the key image.

[0078] The key image aiming point is the position point in the key image corresponding to the initial image aiming point.

[0079] Step S500, determining whether the position of the target tissue in the eye aimed at by the laser emission point moves according to the key position and the initial position;

[0080] Further, step S500 includes steps S510 to S550, as follows:

[0081] Step S510, selecting one image feature from a plurality of non-target image features included in the target initial image, and determining it as the initial reference image feature;

[0082] Step S520, determining the image features in the key image that are the same as the initial reference image features as the key reference image features;

[0083] Step S530, determining the distance L1 and the deviation angle J1 between the pixel point corresponding to the initial reference image feature and the aiming point of the initial image;

[0084] Step S540, determining the distance L2 and the deviation angle J2 between the pixel point corresponding to the key reference image feature and the key image aiming point;

[0085] Step S550: If |L1-L2|<L0, and |J1-J2|<J0, it is determined that the position of the target tissue in the eye aimed at by the laser emission point has not moved; otherwise, it is determined that the position of the target tissue in the eye aimed at by the laser emission point has moved; wherein L0 is a preset distance difference threshold; J0 is a preset deviation angle threshold.

[0086] The feature point corresponding to the initial reference image feature and the feature point corresponding to the key reference image feature are at the same position point. If the relative position distance and angle between the two exceed the preset threshold, it means that the target user's eyes have moved during the time period between the moment when the laser emission point of the laser emitting device moves to the laser aiming point and the moment when the key image is collected. For the sake of treatment safety, it is necessary to stop the laser dot treatment and re-determine the laser aiming point; if the relative position distance and angle between the two do not exceed the preset threshold, it means that the target user's eyes have not moved, and the position of the laser aiming point determined previously is accurate, so the laser aiming point is directly treated with dot treatment.

[0087] During the eye movement confirmation of the laser aiming point, since the image acquisition system directly captures the image of the laser aiming point instead of capturing the target user's eyes at various angles, the time for determining the key image is shortened, and the overall time used for eye movement confirmation is also reduced, thereby reducing the probability of eye movement of the target user.

[0088] The process method of steps S102 to S220 for determining the laser aiming point is a feature matching method, i.e., the process from acquiring the initial image of the target to determining the laser aiming point. Since this process only determines the laser aiming point and has not yet moved the laser emission point to the target tissue in the eye of the target user, it is a feature point positioning process before laser emission. Therefore, the feature matching method may take a long time. Moreover, due to the different locations of the lesions and the fact that hardware control may be used to move the laser emission point to the laser aiming point, the time of this process is relatively not fixed.

[0089] The process method of step S230-step S550 is an eye movement confirmation method, that is, the process from moving the laser emission point to the target tissue in the target user's eye to determining whether the target user's eye moves. Since this process has moved the laser emission point to the target tissue in the eye, it is a confirmation step before laser acupuncture treatment. In order to reduce the probability of eye movement of the target user, this step reduces the overall time of the eye movement confirmation method. Since the acquisition time of the key image is relatively fixed and short, the overall time of the eye movement confirmation method is also relatively fixed and short.

[0090] The traditional eye laser treatment method is that the staff manually collects images and manually determines the laser aiming point. After the laser aiming point is determined, the laser emission point is moved to the laser aiming point and the laser is directly tapped. There is no step of secondary eye movement confirmation of the laser aiming point. This is likely to have a significant impact on the target user's eye treatment process and greatly reduce the safety of eye treatment. Therefore, the method of this application can be used to perform secondary eye movement confirmation before laser tapping to improve the safety of the eye being hit by the laser.

[0091] The distance difference threshold is determined by steps S551 to S555:

[0092] Step S551, obtaining a number of historical key images; the historical key images are reference images when the laser emission point emits a treatment beam to the target tissue in the eye of the historical user during the historical period; the end time of the historical period is earlier than the current time;

[0093] Step S552, traversing each historical key image, if the treatment light beam emitted by the laser emission point to the target tissue in the eye of the historical user corresponding to the historical key image does not deviate, then determining the historical key image as the historical target image;

[0094] Step S553, obtaining the deviation distance value between the position of the target tissue in the eye on each historical target image and the position of the target tissue in the eye on the corresponding historical initial image; the historical initial image is a reference image when the laser emission point is aimed at the target tissue in the eye of the user corresponding to the historical target image;

[0095] Step S554, averaging a plurality of deviation distance values ​​to obtain an average deviation distance value;

[0096] Step S555: determine the average deviation distance value as the distance difference threshold.

[0097] The method for determining the deviation angle threshold is similar to the method for determining the distance difference threshold. The deviation angle threshold is determined by taking the average value of the deviation angles between the position of the target tissue in the eye on several historical target images and the position of the target tissue in the eye on the corresponding historical initial images.

[0098] On the other hand, the deviation angle threshold and the distance difference threshold can be determined by averaging processing, or by other processing methods, such as a maximum value determination method, a minimum value determination method, etc., and can also be customized according to the actual situation of the user.

[0099] Step S600: If the position of the target tissue in the eye aimed at by the laser emission point does not move, then control the laser emission point to emit a treatment beam to the target tissue in the eye of the target user;

[0100] Furthermore, step S600 further includes:

[0101] Step S601: If the position of the target tissue in the eye aimed at by the laser emission point moves, the laser emission point is controlled to stop emitting the treatment light beam.

[0102] In the process of emitting a treatment beam from the laser emission point to a key position corresponding to the target tissue in the eye of the target user, in order to further achieve intraoperative safety protection of the eye of the target user, the method described in steps S610 to S660 is also performed:

[0103] Step S610, acquiring in real time a target image of the target tissue in the eye of the target user during the process of being irradiated by the treatment light beam;

[0104] Step S620, determining an area surrounded by pixels corresponding to a plurality of key reference image features in the key image as a key area;

[0105] Step S630, determining the target area in the target image according to the position of the key area in the key image;

[0106] The position of the target region in its corresponding target image is the same as the position of the key region in the key image.

[0107] Step S640: Obtain a key eigenvalue vector C=(C1, C2, ..., C j ,...,C g), where j = 1, 2, ..., g; g is the number of pixels in the key area; C j is the characteristic value of the jth pixel in the key area;

[0108] Step S650: Obtain a target eigenvalue vector D=(D1, D2, ..., D j ,...,D g ), where D j is the characteristic value of the j-th pixel in the target area;

[0109] Step S660: If the matching degree between the key eigenvalue vector C and the target eigenvalue vector D is less than a preset matching degree threshold, the laser emission point is controlled to stop emitting the treatment beam.

[0110] During the process of laser irradiation of the target user's eyes, the image of the target tissue is acquired in real time. If the degree of match between the acquired image during treatment and the key image is less than a threshold, it means that the offset angle or offset distance of the target tissue position exceeds a certain threshold, and it is determined that the target user's eyes have moved. In order to ensure the safety of the target user's eyes, it is necessary to stop the laser treatment immediately and redetermine the laser aiming point.

[0111] The present invention determines the initial position of the target tissue in the eye of the target user on the target initial image according to several image features of the target initial image of the target tissue in the eye of the target user received, and aims the laser emission point at the initial position corresponding to the target tissue in the eye of the target user, and then determines the key position of the target tissue in the eye according to the key image of the target tissue in the eye of the target user acquired at the current moment, and determines whether the position of the target tissue in the eye aimed at by the laser emission point moves according to the deviation distance and deviation angle between the key position and the initial position. If the position of the target tissue in the eye aimed at by the laser emission point does not move, it means that the eye of the target user does not deviate and move during the time period between the acquisition time of the target initial image and the acquisition time of the key image, and the target tissue can be irradiated with a therapeutic light beam, and the laser emission point is controlled to emit a therapeutic light beam to the target tissue in the eye of the target user, so as to achieve safe protection of the eye of the target user during the operation.

[0112] An embodiment of the present invention further provides a computer program product, which includes program code. When the program product is run on an electronic device, the program code is used to enable the electronic device to execute the steps of the method according to various exemplary embodiments of the present invention described above in this specification.

[0113] In addition, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0114] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a mobile terminal, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0115] In an exemplary embodiment of the present disclosure, an electronic device capable of implementing the above method is also provided.

[0116] It will be appreciated by those skilled in the art that various aspects of the present invention may be implemented as a system, method or program product. Therefore, various aspects of the present invention may be specifically implemented in the following forms, namely: a complete hardware implementation, a complete software implementation (including firmware, microcode, etc.), or a combination of hardware and software, which may be collectively referred to herein as a "circuit", "module" or "system".

[0117] The electronic device according to this embodiment of the present invention is only an example and should not bring any limitation to the functions and scope of use of the embodiments of the present invention.

[0118] The electronic device is presented in the form of a general-purpose computing device. The components of the electronic device may include, but are not limited to: the at least one processor mentioned above, the at least one storage device mentioned above, and a bus connecting different system components (including storage devices and processors).

[0119] The storage stores program codes, which can be executed by the processor, so that the processor executes the steps according to various exemplary embodiments of the present invention described in the above “Exemplary Method” section of this specification.

[0120] The memory may include readable media in the form of volatile memory, such as random access memory (RAM) and / or cache memory, and may further include read only memory (ROM).

[0121] The storage may also include a program / utility having a set (at least one) of program modules, such program modules including but not limited to: an operating system, one or more application programs, other program modules and program data, each of which or some combination may include the implementation of a network environment.

[0122] The bus may represent one or more of several types of bus structures including a memory bus or memory controller, a peripheral bus, an accelerated graphics port, a processor, or a local bus using any of a variety of bus architectures.

[0123] The electronic device can also communicate with one or more external devices (such as keyboards, pointing devices, Bluetooth devices, etc.), and can also communicate with one or more devices that enable users to interact with the electronic device, and / or communicate with any device (such as routers, modems, etc.) that enables the electronic device to communicate with one or more other computing devices. This communication can be carried out through an input / output (I / O) interface. In addition, the electronic device can also communicate with one or more networks (such as local area networks (LANs), wide area networks (WANs) and / or public networks, such as the Internet) through a network adapter. As shown in the figure, the network adapter communicates with other modules of the electronic device through a bus. It should be understood that, although not shown in the figure, other hardware and / or software modules can be used in conjunction with the electronic device, including but not limited to: microcode, device drivers, redundant processors, external disk drive arrays, RAID systems, tape drives, and data backup storage systems, etc.

[0124] Through the description of the above implementation, it is easy for those skilled in the art to understand that the example implementation described here can be implemented by software, or by software combined with necessary hardware. Therefore, the technical solution according to the implementation of the present disclosure can be embodied in the form of a software product, which can be stored in a non-volatile storage medium (which can be a CD-ROM, a USB flash drive, a mobile hard disk, etc.) or on a network, including several instructions to enable a computing device (which can be a personal computer, a server, a terminal device, or a network device, etc.) to execute the method according to the implementation of the present disclosure.

[0125] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible implementations, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to execute the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0126] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0127] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0128] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0129] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0130] In addition, the above-mentioned figures are only schematic illustrations of the processes included in the method according to an exemplary embodiment of the present invention, and are not intended to be limiting. It is easy to understand that the processes shown in the above-mentioned figures do not indicate or limit the time sequence of these processes. In addition, it is also easy to understand that these processes can be performed synchronously or asynchronously, for example, in multiple modules.

[0131] It should be noted that, although several modules or units of the device for action execution are mentioned in the above detailed description, this division is not mandatory. In fact, according to the embodiments of the present disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. On the contrary, the features and functions of one module or unit described above can be further divided into multiple modules or units to be embodied.

[0132] The above is only a specific embodiment of the present invention, but the protection scope of the present invention is not limited thereto. Any changes or substitutions that can be easily thought of by a person skilled in the art within the technical scope disclosed by the present invention should be included in the protection scope of the present invention. Therefore, the protection scope of the present invention shall be subject to the protection scope of the claims.

Claims

1. A non-transitory computer-readable storage medium, wherein at least one instruction or at least one program is stored in the storage medium, characterized in that: The at least one instruction or the at least one program is loaded by the processor to perform the following steps: Step S100, in response to receiving a target initial image of a target tissue in an eye of a target user, determining an initial position of the target tissue in the eye of the target user on the target initial image according to the target initial image; Step S200, aiming the laser emission point at the target tissue in the eye of the target user according to the initial position; the laser emission point is used to emit a treatment beam; Step S300, obtaining a key image of the target tissue in the eye of the target user collected at the current moment; Step S400: determining the key position of the target tissue in the eye of the target user on the key image according to the key image; Step S500, determining whether the position of the target tissue in the eye aimed at by the laser emission point moves according to the key position and the initial position; Step S600: If the position of the target tissue in the eye aimed at by the laser emission point does not move, control the laser emission point to emit a treatment light beam to the target tissue in the eye of the target user; Step S610, acquiring in real time a target image of the target tissue in the eye of the target user during the process of being irradiated by the treatment light beam; Step S620, determining an area surrounded by pixels corresponding to a plurality of key reference image features in the key image as a key area; Step S630, determining a target area in the target image according to the position of the key area in the key image; the position of the target area in the corresponding target image is the same as the position of the key area in the key image; Step S640: Obtain a key eigenvalue vector C=(C1, C2, ..., C j ,...,C g ), where j=1,2,...,g; g is the number of pixels in the key area; C j is the characteristic value of the j-th pixel in the key area; Step S650: Obtain a target eigenvalue vector D=(D1, D2, ..., D j ,...,D g ), where D j is the characteristic value of the j-th pixel in the target area; Step S660: If the matching degree between the key eigenvalue vector C and the target eigenvalue vector D is less than a preset matching degree threshold, the laser emission point is controlled to stop emitting the treatment beam.

2. The non-transitory computer-readable storage medium according to claim 1, wherein: The target initial image is determined by the following steps: Step S101, acquiring a number of initial images of target tissues in the eyes of the target user within a target time period; the end time of the target time period is the current time; Step S102: Obtain a number of image features of each of the initial images to obtain an image feature list set A=(A1, A2, ..., A i ,...,A n );A i =(A i1 ,A i2 ,...,A im ,...,A if(i) ), wherein i=1,2,...,n, and n is the number of the initial images; A i is the image feature list corresponding to the i-th initial image; m=1,2,...,f(i); f(i) is the number of image features included in the i-th initial image; A im is the mth image feature included in the i-th initial image; Step S103, traverse the image feature list set A, if A im is the preset key image feature, then A im Determine as the target image feature, and obtain the target image feature quantity list B=(B1, B2, ..., B i ,...,B n ), where B i is the number of target image features included in the i-th initial image; Step S104, marking the pixel points corresponding to each of the target image features in the initial image corresponding to MAX(B) to obtain the target initial image; wherein MAX() is a preset maximum value determination function.

3. The non-transitory computer-readable storage medium according to claim 2, wherein: The initial position of the target tissue in the eye of the target user is the position of the area surrounded by the marked pixel points on the target initial image.

4. The non-transitory computer-readable storage medium according to claim 3, wherein: The step S200 includes: Step S210, determining an initial image aiming point corresponding to the target initial image according to a plurality of target image features included in the target initial image; Step S220, determining the laser aiming point corresponding to the target tissue in the eye of the target user according to the initial image aiming point; Step S230: moving the laser emission point to the laser aiming point.

5. The non-transitory computer-readable storage medium according to claim 4, wherein: The step S400 includes: Step S410: Determine a key image aiming point corresponding to the key image according to a number of image features included in the key image.

6. The non-transitory computer-readable storage medium according to claim 5, wherein: The step S600 further includes: Step S601: If the position of the target tissue in the eye aimed at by the laser emission point moves, the laser emission point is controlled to stop emitting the treatment light beam.

7. The non-transitory computer-readable storage medium according to claim 1, wherein: The step S500 includes steps S510 to S550: Step S510, selecting one image feature from a plurality of non-target image features included in the target initial image, and determining it as an initial reference image feature; Step S520: determining the image features in the key image that are the same as the initial reference image features as key reference image features; Step S530, determining the distance L1 and the deviation angle J1 between the pixel point corresponding to the initial reference image feature and the aiming point of the initial image; Step S540, determining the distance L2 and the deviation angle J2 between the pixel point corresponding to the key reference image feature and the key image aiming point; Step S550: If |L1-L2|<L0, and |J1-J2|<J0, it is determined that the position of the target tissue in the eye aimed at by the laser emission point has not moved; otherwise, it is determined that the position of the target tissue in the eye aimed at by the laser emission point has moved; wherein L0 is a preset distance difference threshold; J0 is a preset deviation angle threshold.

8. An electronic device, characterized in that: The method comprises a processor and the non-transitory computer-readable storage medium according to any one of claims 1 to 7.

Images