Image processing method, system and device for eliminating laser delamination
By establishing a communication connection between image acquisition equipment and laser equipment in laser surgery, controlling the laser laser launch time of laser equipment solves the problem of laser layering in the image frame during laser surgery, and improves the vision and effect of the surgery.
Patent Information
- Application Number
- CN202211616763.X
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Filing Date
- 2022-12-15
- Publication Date
- 2025-01-24
- Estimated Expiration
- 2042-12-15
AI Technical Summary
During laser surgery, due to the short release time of laser, stratification occurs in the image frame, affecting the doctor's operating field and surgical effect.
By establishing a communication connection between the image acquisition device and the laser device, after detecting the exposure completion event, the laser device is controlled to emit the laser signal according to the image output frame rate and laser emission frequency to ensure that the laser emission time is within the Readout time after the image exposure. Avoid laser excitation during image exposure.
Effectively eliminate the laser layers in the image frame, improve the vision of doctors' operations, and improve the effect of surgery.
Smart Images

Figure CN115988325B_ABST
Abstract
Description
Technical Field
[0001] The present application relates to image processing technology, and in particular to an image processing method, system and device for eliminating laser delamination. Background Art
[0002] At present, during laser surgery, if the release time (pulse width) of the laser within the exposure time of a frame of image is very short, such as hundreds of microseconds (us), only a portion of the exposure lines will produce a "response", and the remaining exposure lines will still be normally exposed. For example, during holmium laser surgery, if the release time (pulse width) of the holmium laser within the exposure time of a frame of image is very short, such as hundreds of microseconds (us), only a portion of the exposure lines will produce a "response", and the remaining exposure lines will still be normally exposed.
[0003] This situation will result in stratification in the final image frame (one part includes the laser stratification area, and the other part includes the normal image area). The laser stratification area has a high brightness or even overexposed, and will occasionally show dynamic "light bars" when the image frames are displayed later, which will affect the doctor's operating field during laser surgery, interfere with the doctor's judgment, and fail to achieve the expected surgical effect. Summary of the invention
[0004] The present application provides an image processing method, system and device for eliminating laser stratification, so as to eliminate laser stratification in an image frame.
[0005] The present application embodiment provides an image processing method for eliminating laser delamination, the method is used for an image acquisition device in laser surgery; a communication connection is established between the image acquisition device and a laser device in laser surgery, the method comprising:
[0006] When an exposure completion event is detected, determining whether it is necessary to control the laser device to emit a laser signal according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device;
[0007] On the premise that it is determined that the laser device needs to be controlled to emit a laser signal, a laser enable signal is sent through the communication connection established between the image acquisition device and the laser device, so that the laser device emits a laser signal after detecting the laser enable signal.
[0008] The embodiment of the present application also provides an image processing method for eliminating laser delamination, which is applied to a laser device in laser surgery, wherein a communication connection is established between the laser device and an image acquisition device in laser surgery, and the method comprises:
[0009] receiving a laser enable signal sent by the image acquisition device through the communication connection established between the image acquisition device and the laser device; when the image acquisition device detects an exposure completion event, the image acquisition device determines whether it is currently necessary to control the laser device to emit a laser signal based on the current image output frame rate N of the image acquisition device and the holmium laser emission frequency M of the laser device, and when it is determined that it is currently necessary to control the laser device to emit a laser signal, sends a laser enable signal to the laser device through the communication connection;
[0010] A laser signal is emitted based on the laser enable signal.
[0011] The present application embodiment provides an image processing system for eliminating laser delamination, the system comprising:
[0012] An image acquisition device and a laser device in laser surgery; a communication connection is established between the image acquisition device and the laser device;
[0013] The image acquisition device executes the first method as above;
[0014] The laser device performs the second method as described above.
[0015] The embodiment of the present application provides an image processing device for eliminating laser delamination, which is used for an image acquisition device in laser surgery; a communication connection is established between the image acquisition device and the laser device in the laser surgery, and the device includes:
[0016] a determination unit, configured to determine whether it is necessary to control the laser device to emit a laser signal according to a current image output frame rate N of the image acquisition device and a laser emission frequency M of the laser device when an exposure completion event is detected;
[0017] A control unit is used to send a laser enable signal through the communication connection established between the image acquisition device and the laser device, under the premise of determining that the laser device needs to be controlled to emit a laser signal, so that the laser device emits a laser signal after detecting the laser enable signal.
[0018] The embodiment of the present application provides an image processing device for eliminating laser delamination, the device is applied to a laser device in laser surgery, a communication connection is established between the laser device and an image acquisition device in laser surgery, the device comprises:
[0019] a receiving unit, configured to receive a laser enable signal sent by the image acquisition device through the communication connection established between the image acquisition device and the laser device; when the image acquisition device detects an exposure completion event, the image acquisition device determines whether it is currently necessary to control the laser device to emit a laser signal based on a current image output frame rate N of the image acquisition device and a holmium laser emission frequency M of the laser device, and when it is determined that it is currently necessary to control the laser device to emit a laser signal, the receiving unit sends a laser enable signal to the laser device through the communication connection;
[0020] A transmitting unit is used to transmit a laser signal based on the laser enable signal.
[0021] An electronic device. The electronic device includes: a processor and a machine-readable storage medium;
[0022] The machine-readable storage medium stores machine-executable instructions that can be executed by the processor;
[0023] The processor is used to execute machine executable instructions to implement the steps of the above disclosed method.
[0024] It can be seen from the above technical scheme that in this embodiment, the timing of laser device excitation is controlled by establishing communication between image acquisition devices such as endoscopic camera systems in laser surgery and laser devices such as holmium laser devices, so as to control the time of laser emission by laser devices such as holmium laser devices in laser surgery to be within the Readout time, thereby avoiding the laser device from emitting laser during image exposure, and ultimately avoiding (or misaligning) image exposure and laser excitation, ensuring that the generated current frame image will not produce laser stratification caused by laser excitation, thereby eliminating the laser stratification phenomenon in the acquired current frame image, eliminating the doctor's visual impairment, and providing a good surgical viewing experience. BRIEF DESCRIPTION OF THE DRAWINGS
[0025] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
[0026] Figure 1a A schematic diagram of a layered image frame provided in an embodiment of the present application;
[0027] Figure 1b A schematic diagram of a normal image frame provided in an embodiment of the present application;
[0028] Figure 2 A flow chart of the method provided in the embodiment of the present application;
[0029] Figure 3 A schematic diagram of the timing of outputting a graph provided in an embodiment of the present application;
[0030] Figure 4 A flowchart of step 201 provided for an embodiment of the present application;
[0031] Figure 5 Another flow chart provided for an embodiment of the present application;
[0032] Figure 6 A system structure diagram provided for an embodiment of the present application;
[0033] Figure 7 A structural diagram of a device provided in an embodiment of the present application;
[0034] Figure 8 Another device structure diagram provided for an embodiment of the present application;
[0035] Fig. 9 A structural diagram of an electronic device provided in an embodiment of the present application. DETAILED DESCRIPTION
[0036] Here, exemplary embodiments will be described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the accompanying drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described in the following exemplary embodiments do not represent all embodiments consistent with the present application. Instead, they are only examples of devices and methods consistent with some aspects of the present application.
[0037] The terms used in this application are for the purpose of describing specific embodiments only and are not intended to limit this application. The singular forms "a", "said" and "the" used in this application are also intended to include plural forms, unless the context clearly indicates other meanings.
[0038] As described above, in laser surgery, if the release time (pulse width) of the laser within the exposure time of a frame of image is often very short (only a few hundred us), only a portion of the exposure rows will produce a "response", and the remaining exposure rows will still be normally exposed, resulting in stratification in the final frame of image (referred to as laser stratification). This laser stratification will cause a frame of image to be divided into two areas: the laser stratification area and the normal image area. The area size and position of the laser stratification area are not fixed, but the brightness of the laser stratification area is high or even overexposed. Taking holmium laser surgery as an example, stratification will occur in a frame of image collected during holmium laser surgery (referred to as holmium laser stratification). This holmium laser stratification will cause a frame of image to be divided into two areas: the holmium laser stratification area and the normal image area. Figure 1a An example of an image showing an area where holmium laser delamination is present. Figure 1b An image of normal exposure is shown as an example.
[0039] For the above-mentioned images with laser stratification, such as holmium laser stratification, dynamic "light bars" will appear from time to time when they are displayed, which will cause visual discomfort to doctors who are performing laser surgery, such as holmium laser surgery, and affect the operating field, interfere with the doctor's judgment, and fail to achieve the expected surgical effect. To solve this technical problem, this embodiment provides an image processing method for eliminating laser stratification, such as holmium laser stratification, which can eliminate laser stratification in image frames, and is described by example below:
[0040] See also Figure 2 , Figure 2 The method flow chart provided in the embodiment of the present application is applied to the image acquisition device in laser surgery. As an embodiment, the image acquisition device may be an endoscopic imaging system in an endoscope, such as a set of lenses in an endoscope.
[0041] In this embodiment, a communication connection needs to be established between the image acquisition device used in laser surgery and the laser device. When applied to holmium laser surgery, the endoscopic imaging system establishes a communication connection with the holmium laser device. This embodiment does not specifically limit the communication connection method, which includes but is not limited to an Ethernet port, a serial port, a CAN bus, Bluetooth, etc.
[0042] Based on the above description, Figure 2 As shown, the process may include the following steps:
[0043] Step 201, when an exposure completion event is detected, it is determined whether it is necessary to control the laser device to emit a laser signal according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device.
[0044] In this embodiment, the laser device in the laser surgery, after detecting an external trigger (also called a laser emission trigger), transmits the laser excitation signal to the image acquisition device through the above communication connection, so that the image acquisition device executes Figure 2 The process shown.
[0045] Specifically, after receiving the laser excitation signal, the image acquisition device starts the exposure signal detection. In this embodiment, the image acquisition process of the image acquisition device, such as a camera, includes the following two parts: the first part is the automatic exposure time (Exposure), and the second part is the Readout time. The readout time refers to the time when the sensor in the image acquisition device outputs the image after the image is exposed, and this time is generally about 20 to 30ms. That is, the time to acquire a frame of image (also called the image output time) = exposure time + readout time. Figure 3 An example is shown of the time of drawing output.
[0046] Based on the above description, in this embodiment, as described in step 201, when the image acquisition device detects the exposure completion event, it will determine whether it is necessary to control the laser device to emit a laser signal based on the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device. Here, the laser emission frequency M can be the frequency of laser excitation within one second (s). For example, if the laser emission frequency M is 15HZ, it means that the laser will be excited 15 times within 1s. In this embodiment, the laser emission frequency M of the laser device can be carried by the laser device in the above-mentioned laser excitation signal and sent to the image acquisition device, or it can be pre-configured in the image acquisition device, which is not specifically limited in this embodiment.
[0047] In the above description, the exposure completion event is, for example, receiving an exposure completion signal, a signal for the start of Readout, a Readout enable signal, etc. Optionally, in this embodiment, an exposure completion signal is generated when each frame of automatic exposure ends, and the exposure completion signal is equivalent to the signal for the start of Readout, also called a Readout enable signal.
[0048] It can be seen from step 201 that in this embodiment, the laser device in the laser surgery, such as the holmium laser device, does not directly perform laser emission even when the above-mentioned laser emission trigger is detected, but the image acquisition device is linked, and the image acquisition device determines whether it is necessary to control the laser device to emit a laser signal based on the current image output frame rate N and the laser emission frequency M of the laser device. As for how to determine whether it is necessary to control the laser device to emit a laser signal based on the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device, the following will be described by example, and will not be repeated here.
[0049] Step 202, under the premise of determining that the laser device needs to be controlled to emit a laser signal, a laser enable signal is sent through the communication connection established between the image acquisition device and the laser device, so that the laser device emits a laser signal after detecting the laser enable signal.
[0050] In this embodiment, the laser device used in laser surgery, such as a holmium laser device, performs laser emission after detecting the above-mentioned laser enable signal.
[0051] It should be noted that this step 202 is executed under the premise of detecting the exposure completion event. Based on this premise, the time when the laser equipment in laser surgery, such as the holmium laser equipment, emits the laser will be within the above-mentioned Readout time, and the exposure process will definitely not excite the laser, which causes the image exposure and laser excitation to be misaligned, and the current frame image generated will not produce the laser stratification phenomenon caused by laser excitation.
[0052] So far, completed Figure 2 The process shown.
[0053] pass Figure 2 It can be seen from the shown process that in this embodiment, the timing of laser device stimulating laser is controlled by establishing communication between image acquisition devices such as endoscopic camera systems in laser surgery and laser devices such as holmium laser devices, so as to control the time of laser emission by laser devices such as holmium laser devices in laser surgery to be within the above-mentioned Readout time, thereby avoiding laser device stimulating laser during image exposure, and ultimately avoiding (or misaligning) image exposure and laser excitation, ensuring that the generated current frame image will not produce laser stratification caused by laser excitation, thereby eliminating the laser stratification phenomenon in the acquired current frame image, eliminating the doctor's visual impairment, and providing a good surgical viewing experience.
[0054] The following describes how to determine whether it is necessary to control the laser device to emit a laser signal according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device in the above step 201:
[0055] See also Figure 4 , Figure 4 The step 201 provided in the embodiment of the present application is implemented as a flowchart. Figure 4 As shown, the process may include the following steps:
[0056] Step 401, determining an image frame-laser correlation relationship according to a current image output frame rate N of an image acquisition device and a laser emission frequency M of a laser device.
[0057] In this embodiment, the image frame-laser association relationship is used to indicate that the image acquisition device needs to control the laser device to emit n laser signals every time it acquires m image frames.
[0058] As an embodiment, there are many ways to determine the image frame-laser association relationship based on the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device, such as: calculating the greatest common factor of M and N, dividing the numerator and denominator of M / N by the greatest common factor, and obtaining m / n, where m is greater than n, and n is greater than or equal to 1; determining the image frame-laser association relationship based on m / n. If N is 30 and M is 20, then n is 3 and m is 2, which means that the laser is excited twice every 3 frames, that is, the image acquisition device needs to generate the above-mentioned laser enable signal for 2 frames of images out of every 3 frames of images acquired.
[0059] Step 402: Determine whether it is currently necessary to control the laser device to emit a laser signal based on the image frame-laser association relationship.
[0060] As an embodiment, there are many ways to determine whether it is currently necessary to control the laser device to emit a laser signal based on the image frame-laser association relationship, such as: obtaining the first laser excitation signal sent by the laser device through the above-mentioned communication connection under the premise that the current image output frame rate of the image acquisition device is N and the laser emission frequency of the laser device is M; taking the image frame collected after receiving the first laser excitation signal as the first frame; starting from the first frame, determining whether it is currently necessary to control the laser device to emit a laser signal according to the above-mentioned image frame-laser association relationship.
[0061] Optionally, there are many ways to implement the above-mentioned method of determining whether it is currently necessary to control the laser device to emit a laser signal starting from the first frame according to the image frame-laser association relationship, such as detecting the frame number K of the target image frame corresponding to the above-mentioned exposure completion event; the frame number K refers to the frame obtained by counting from the above-mentioned first frame; based on K, the current control cycle is determined; wherein, if K is greater than or equal to n, K / n is rounded to obtain a calculation result p, and the current control cycle is determined to be the p+1th control cycle, and p is greater than or equal to 1; if K is less than n, the current control cycle is determined to be the 1st control cycle; according to the image frame-laser association relationship and the order of the current image frame in the current control cycle, it is determined whether it is currently necessary to control the laser device to emit a laser signal.
[0062] Here, according to the image frame-laser association relationship and the order of the current image frame in the current control cycle, it is determined whether it is necessary to control the laser device to emit a laser signal at present, for example: if it is determined whether to emit a laser in accordance with the order of precedence in each control cycle, if the order number of the current image frame in the current control cycle is less than or equal to m, it is determined that it is necessary to control the laser device to emit a laser signal, otherwise, it is determined that it is not necessary to control the laser device to emit a laser signal at present. For example, the image frame-laser association relationship indicates that the laser is excited twice every 3 frames. If the current image frame is the second frame image in the current control cycle, based on the image frame-laser association relationship (indicating that the laser is excited twice every 3 frames), it can be determined that it is necessary to control the laser device to emit a laser signal at present; and if the current image frame is the third frame image in the current control cycle, because the first two frames have determined that the laser device needs to be controlled to emit a laser signal, then based on the image frame-laser association relationship (indicating that the laser is excited twice every 3 frames), it can be determined that it is not necessary to control the laser device to emit a laser signal at present. It should be noted that this is just an example and is not intended to be limiting.
[0063] So far, completed Figure 4 The process shown.
[0064] pass Figure 4 The process shown implements how to determine whether it is necessary to control the laser device to emit a laser signal based on the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device.
[0065] It should be noted that, in this embodiment, as described above, the laser device in the laser surgery will detect the laser stop trigger after detecting the laser emission trigger. Once the laser stop trigger is detected, an excitation termination signal will be sent to the image acquisition device through the above connection. The image acquisition device ends the control of the laser device emitting the laser after detecting the laser termination signal sent by the laser device through the above communication connection.
[0066] The above is a description of the method provided in the embodiment of the present application from the perspective of an image acquisition device such as an endoscopic imaging system in laser surgery. The following is a description of the method provided in the embodiment of the present application from the perspective of a laser device such as a holmium laser device in laser surgery:
[0067] See also Figure 5 , Figure 5 Another method flow chart provided in an embodiment of the present application. The method is applied to a laser device used in laser surgery, such as a holmium laser device, which establishes a communication connection with an image acquisition device used to acquire images in laser surgery, such as an endoscopic imaging system.
[0068] like Figure 5 As shown, the process may include the following steps:
[0069] Step 501: receiving a laser enable signal sent by an image acquisition device through a communication connection established between the image acquisition device and the laser device.
[0070] In this embodiment, the image acquisition device sends a laser enable signal based on Figure 2 For example, when an exposure completion event is detected, based on the current image output frame rate N of the image acquisition device and the holmium laser emission frequency M of the laser device, it is determined that the laser device needs to be controlled to emit a laser signal, and a laser enable signal is sent to the laser device through a communication connection. For details, see Figure 2 The process shown.
[0071] Step 502: emitting a laser signal based on a laser enable signal.
[0072] When the laser device receives a laser enable signal, it will emit a laser signal based on the laser enable signal.
[0073] Based on the laser enable signal described above, it can be known that in this embodiment, the timing of laser device stimulating laser is controlled by establishing communication between image acquisition devices such as endoscopic camera systems in laser surgery and laser devices such as holmium laser devices, so as to control the time of laser emission by laser devices such as holmium laser devices in laser surgery to be within the above-mentioned Readout time, thereby avoiding the laser device stimulating laser during the image exposure process, and ultimately avoiding (or misaligning) image exposure and laser excitation, ensuring that the generated current frame image will not produce laser stratification caused by laser excitation, thereby eliminating the laser stratification phenomenon in the acquired current frame image, eliminating the doctor's visual impairment, and providing a good surgical viewing experience.
[0074] So far, completed Figure 5 The process shown.
[0075] The method provided in the embodiment of the present application is described above. The system and device provided in the embodiment of the present application are described below:
[0076] See also Figure 6 , Figure 6 This is a system structure diagram provided by an embodiment of the present application. The system includes: an image acquisition device and a laser device used in laser surgery; a communication connection is established between the image acquisition device and the laser device;
[0077] The image acquisition device performs the following steps: Figure 2 Steps in the process shown.
[0078] The laser device performs the following Figure 5 Steps in the process shown.
[0079] So far, completed Figure 6 Structural description of the system shown.
[0080] See also Figure 7 , Figure 7 This is a structural diagram of a device provided in an embodiment of the present application. The device is used as an image acquisition device in laser surgery; a communication connection is established between the image acquisition device and the laser device in the laser surgery, and the device includes:
[0081] a determination unit, configured to determine whether it is necessary to control the laser device to emit a laser signal according to a current image output frame rate N of the image acquisition device and a laser emission frequency M of the laser device when an exposure completion event is detected;
[0082] A control unit is used to send a laser enable signal through the communication connection established between the image acquisition device and the laser device, under the premise of determining that the laser device needs to be controlled to emit a laser signal, so that the laser device emits a laser signal after detecting the laser enable signal.
[0083] Optionally, the determining whether it is currently necessary to control the laser device to emit a laser signal according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device comprises: determining an image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device; the image frame-laser association relationship is used to indicate that the image acquisition device needs to control the laser device to emit n laser signals every time m image frames are acquired; determining whether it is currently necessary to control the laser device to emit a laser signal according to the image frame-laser association relationship;
[0084] Optionally, the determining the image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device includes: calculating the greatest common factor of M and N, dividing the numerator and denominator of M / N by the greatest common factor respectively to obtain m / n, where m is greater than n, and n is greater than or equal to 1; determining the image frame-laser association relationship according to m / n;
[0085] Optionally, determining whether it is currently necessary to control the laser device to emit a laser signal based on the image frame-laser association relationship includes: obtaining a first holmium laser excitation signal sent by the laser device through the communication connection under the premise that the current image output frame rate of the image acquisition device is N and the laser emission frequency of the laser device is M; taking an image frame acquired after receiving the first holmium laser excitation signal as the first frame; and starting from the first frame, determining whether it is currently necessary to control the laser device to emit a laser signal based on the image frame-laser association relationship;
[0086] Optionally, starting from the first frame, determining whether it is currently necessary to control the laser device to emit a laser signal according to the image frame-laser association relationship includes: detecting the frame number K of the current image frame corresponding to the exposure completion event; the frame number K refers to the number obtained by counting from the first frame; determining the current control cycle according to K; wherein, if K is greater than or equal to n, rounding K / n to obtain a calculation result p, determining that the current control cycle is the p+1th control cycle, and p is greater than or equal to 1; if K is less than n, determining that the current control cycle is the 1st control cycle; determining whether it is currently necessary to control the laser device to emit a laser signal according to the image frame-laser association relationship and the order of the current image frame in the current control cycle;
[0087] Optionally, the determining unit executes the detection of the exposure completion event on the premise of detecting the laser excitation signal sent by the laser device through the communication connection; or,
[0088] The control unit ends the control of the laser device emitting laser light upon detecting a laser termination signal sent by the laser device through the communication connection.
[0089] So far, completed Figure 7 Structural description of the device shown.
[0090] See also Figure 8 , Figure 8 This is another device structure diagram provided in an embodiment of the present application. The device is applied to a laser device in laser surgery, and a communication connection is established between the laser device and an image acquisition device in laser surgery. The device includes:
[0091] a receiving unit, configured to receive a laser enable signal sent by the image acquisition device through the communication connection established between the image acquisition device and the laser device; when the image acquisition device detects an exposure completion event, the image acquisition device determines whether it is currently necessary to control the laser device to emit a laser signal based on a current image output frame rate N of the image acquisition device and a holmium laser emission frequency M of the laser device, and when it is determined that it is currently necessary to control the laser device to emit a laser signal, the receiving unit sends a laser enable signal to the laser device through the communication connection;
[0092] A transmitting unit is used to transmit a laser signal based on the laser enable signal.
[0093] So far, completed Figure 8 Structural description of the device shown.
[0094] The present application also provides Figure 7 or the hardware structure of the device shown in 8. Fig. 9 , Fig. 9 This is a structural diagram of an electronic device provided in an embodiment of the present application. Fig. 9 As shown, the hardware structure may include: a processor and a machine-readable storage medium, the machine-readable storage medium storing machine-executable instructions that can be executed by the processor; the processor is used to execute the machine-executable instructions to implement the method disclosed in the above example of this application.
[0095] Based on the same application concept as the above method, an embodiment of the present application also provides a machine-readable storage medium, on which a number of computer instructions are stored. When the computer instructions are executed by a processor, the method disclosed in the above example of the present application can be implemented.
[0096] Exemplarily, the above-mentioned machine-readable storage medium can be any electronic, magnetic, optical or other physical storage device that can contain or store information, such as executable instructions, data, etc. For example, the machine-readable storage medium can be: RAM (Radom Access Memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard disk drive), solid state drive, any type of storage disk (such as CD, DVD, etc.), or similar storage medium, or a combination thereof.
[0097] The systems, devices, modules or units described in the above embodiments may be implemented by a computer processor or entity, or by a product having a certain function. A typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email transceiver device, a game console, a tablet computer, a wearable device or a combination of any of these devices.
[0098] For the convenience of description, the above device is described in various units according to their functions. Of course, when implementing the present application, the functions of each unit can be implemented in the same or multiple software and / or hardware.
[0099] Those skilled in the art will appreciate that the embodiments of the present application may be provided as methods, systems, or computer program products. Therefore, the present application may adopt the form of a complete hardware embodiment, a complete software embodiment, or an embodiment in combination with software and hardware. Moreover, the embodiments of the present application may adopt the form of a computer program product implemented in one or more computer-usable storage media (including but not limited to disk storage, CD-ROM, optical storage, etc.) that contain computer-usable program code.
[0100] The present application is described with reference to the flowchart and / or block diagram of the method, device (system) and computer program product according to the embodiment of the present application. It should be understood that each flow process and / or box in the flow chart and / or block diagram and the combination of the flow chart and / or box in the flow chart and / or block diagram can be realized by computer program instructions. These computer program instructions can be provided to the processor of a general-purpose computer, a special-purpose computer, an embedded processing machine or other programmable data processing device to produce a machine, so that the instructions executed by the processor of the computer or other programmable data processing device produce a device for realizing the function specified in one flow chart or multiple flows and / or one box or multiple boxes of the block diagram.
[0101] Moreover, these computer program instructions can also be stored in a computer-readable memory that can guide a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured product including an instruction device, which implements the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0102] These computer program instructions may also be loaded onto a computer or other programmable data processing device so that a series of operational steps are executed on the computer or other programmable device to produce a computer-implemented process, whereby the instructions executed on the computer or other programmable device provide steps for implementing the functions specified in one or more processes in the flowchart and / or one or more boxes in the block diagram.
[0103] The above is only an embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various changes and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present application should be included in the scope of the claims of the present application.
Claims
1. An image processing method for eliminating laser delamination, characterized in that: The method is used in image acquisition equipment in laser surgery; A communication connection is established between the image acquisition device and a laser device used in laser surgery. The method includes: Receiving a laser excitation signal sent by the laser device through the communication connection; the laser device sends the laser excitation signal after detecting a laser emission trigger; Performing exposure detection based on the laser excitation signal, and determining whether it is necessary to control the laser device to emit a laser signal according to a current image output frame rate N of the image acquisition device and a laser emission frequency M of the laser device when an exposure completion event is detected; On the premise that it is determined that the laser device needs to be controlled to emit a laser signal, a laser enable signal is sent through the communication connection established between the image acquisition device and the laser device, so that the laser device emits a laser signal after detecting the laser enable signal.
2. The method according to claim 1, characterized in that The determining whether it is necessary to control the laser device to emit a laser signal according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device comprises: An image frame-laser association relationship is determined according to a current image output frame rate N of the image acquisition device and a laser emission frequency M of the laser device; the image frame-laser association relationship is used to indicate that the image acquisition device needs to control the laser device to emit n laser signals every time m image frames are acquired; According to the image frame-laser association relationship, it is determined whether it is currently necessary to control the laser device to emit a laser signal.
3. The method according to claim 2, characterized in that Determining the image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device includes: Calculate the greatest common factor of M and N, divide the numerator and denominator of M / N by the greatest common factor respectively, and obtain m / n, where m is greater than n, and n is greater than or equal to 1; The image frame-laser correlation relationship is determined based on the m / n.
4. The method according to claim 2, characterized in that: The determining, based on the image frame-laser association relationship, whether it is currently necessary to control the laser device to emit a laser signal comprises: Obtaining a first holmium laser excitation signal sent by the laser device through the communication connection under the premise that the current image output frame rate of the image acquisition device is N and the laser emission frequency of the laser device is M; taking the image frame acquired after receiving the first holmium laser excitation signal as the first frame; Starting from the first frame, it is determined whether it is currently necessary to control the laser device to emit a laser signal according to the image frame-laser association relationship.
5. The method according to claim 4, characterized in that The step of determining whether it is necessary to control the laser device to emit a laser signal according to the image frame-laser association relationship starting from the first frame includes: Detecting the frame number K of the current image frame corresponding to the exposure completion event; the frame number K is obtained by counting from the first frame; According to K, the current control cycle is determined; wherein, if K is greater than or equal to n, K / n is rounded to obtain a calculation result p, and the current control cycle is determined to be the p+1th control cycle, and p is greater than or equal to 1; if K is less than n, the current control cycle is determined to be the 1st control cycle; According to the image frame-laser association relationship and the order of the current image frame in the current control cycle, it is determined whether it is currently necessary to control the laser device to emit a laser signal.
6. The method according to claim 1, characterized in that The method further comprises: On the premise of detecting a laser termination signal sent by the laser device through the communication connection, the control of the laser device emitting laser is terminated.
7. An image processing method for eliminating laser delamination, characterized in that: The method is applied to a laser device in laser surgery, wherein a communication connection is established between the laser device and an image acquisition device in laser surgery, and the method comprises: Sending a laser excitation signal to the image acquisition device through the communication connection, so that the image acquisition device performs exposure detection based on the laser excitation signal; the laser device sends the laser excitation signal after detecting a laser emission trigger; receiving a laser enable signal sent by the image acquisition device through the communication connection established between the image acquisition device and the laser device; when the image acquisition device detects an exposure completion event, the image acquisition device determines whether it is currently necessary to control the laser device to emit a laser signal based on the current image output frame rate N of the image acquisition device and the holmium laser emission frequency M of the laser device, and when it is determined that it is currently necessary to control the laser device to emit a laser signal, sends a laser enable signal to the laser device through the communication connection; A laser signal is emitted based on the laser enable signal.
8. An image processing system for eliminating laser delamination, characterized in that: The system includes: An image acquisition device and a laser device in laser surgery; a communication connection is established between the image acquisition device and the laser device; The image acquisition device performs the method according to any one of claims 1 to 6; The laser device performs the method of claim 7.
9. An image processing device for eliminating laser delamination, characterized in that: The device is used as an image acquisition device in laser surgery; The image acquisition device establishes a communication connection with the laser device in the laser surgery, and the device comprises: a determination unit, configured to receive a laser excitation signal sent by the laser device through the communication connection; the laser device sends the laser excitation signal after detecting a laser emission trigger; perform exposure detection based on the laser excitation signal, and when an exposure completion event is detected, determine whether it is currently necessary to control the laser device to emit a laser signal according to a current image output frame rate N of the image acquisition device and a laser emission frequency M of the laser device; A control unit is used to send a laser enable signal through the communication connection established between the image acquisition device and the laser device, under the premise of determining that the laser device needs to be controlled to emit a laser signal, so that the laser device emits a laser signal after detecting the laser enable signal.
10. The device according to claim 9, characterized in that The determining whether it is necessary to control the laser device to emit a laser signal at present according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device comprises: determining an image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device; the image frame-laser association relationship is used to indicate that the image acquisition device needs to control the laser device to emit a laser signal n times every time m image frames are acquired; determining whether it is necessary to control the laser device to emit a laser signal at present according to the image frame-laser association relationship; The determining of the image frame-laser association relationship according to the current image output frame rate N of the image acquisition device and the laser emission frequency M of the laser device comprises: calculating the greatest common factor of M and N, dividing the numerator and the denominator of M / N by the greatest common factor respectively to obtain m / n, where m is greater than n and n is greater than or equal to 1; determining the image frame-laser association relationship according to m / n; The determining whether it is currently necessary to control the laser device to emit a laser signal based on the image frame-laser association relationship includes: obtaining the first holmium laser excitation signal sent by the laser device through the communication connection under the premise that the current image output frame rate of the image acquisition device is N and the laser emission frequency of the laser device is M; taking the image frame acquired after receiving the first holmium laser excitation signal as the first frame; starting from the first frame, determining whether it is currently necessary to control the laser device to emit a laser signal based on the image frame-laser association relationship; The step of determining whether it is necessary to control the laser device to emit a laser signal at present according to the image frame-laser association relationship starting from the first frame includes: detecting the frame number K of the current image frame corresponding to the exposure completion event; the frame number K is obtained by counting from the first frame; determining the current control cycle according to K; wherein, if K is greater than or equal to n, rounding K / n to obtain a calculation result p, determining that the current control cycle is the p+1th control cycle, and p is greater than or equal to 1; if K is less than n, determining that the current control cycle is the 1st control cycle; determining whether it is necessary to control the laser device to emit a laser signal at present according to the image frame-laser association relationship and the order of the current image frame in the current control cycle; The control unit ends the control of the laser device emitting laser light upon detecting a laser termination signal sent by the laser device through the communication connection.
11. An image processing device for eliminating laser delamination, characterized in that: The device is applied to a laser device in laser surgery, wherein a communication connection is established between the laser device and an image acquisition device in the laser surgery, and the device comprises: a receiving unit, configured to receive a laser enable signal sent by the image acquisition device through the communication connection established between the image acquisition device and the laser device; when the image acquisition device detects an exposure completion event, the image acquisition device determines whether it is currently necessary to control the laser device to emit a laser signal based on a current image output frame rate N of the image acquisition device and a holmium laser emission frequency M of the laser device, and when it is determined that it is currently necessary to control the laser device to emit a laser signal, the receiving unit sends a laser enable signal to the laser device through the communication connection; An emitting unit is used to emit a laser signal based on the laser enable signal; and to send a laser excitation signal to the image acquisition device through the communication connection, so that the image acquisition device performs exposure detection based on the laser excitation signal; the laser device sends the laser excitation signal after detecting a laser emission trigger.
12. An electronic device, characterized in that: The electronic device includes: a processor and a machine-readable storage medium; The machine-readable storage medium stores machine-executable instructions that can be executed by the processor; The processor is used to execute machine executable instructions to implement the method steps of any one of claims 1-7.
Citation Information
Patent Citations
Laser light interval transmitting method and device
CN112642064A
Imaging system and imaging method for high-speed flowing particles and readable storage medium
CN114441418A