Endoscope-based wound treatment method and endoscope system

Abstract

The application discloses an endoscope-based wound treatment method and an endoscope system. The method comprises the following steps: acquiring a first endoscope image after endoscopic submucosal dissection; identifying an unclosed wound in the first endoscope image to obtain wound information, wherein the wound information at least comprises a wound size, a wound position and a wound shape, the wound size is used to indicate the length and width of the unclosed wound, the wound position is used to indicate the coordinates and range of the unclosed wound in the first endoscope image, and the wound shape is used to indicate the edge shape of the unclosed wound; determining a first closing operation scheme for the unclosed wound according to the wound information; and outputting first prompt information according to the first closing operation scheme. The application can realize automatic identification of a wound area, accurately evaluate the current wound treatment condition according to the identified wound information, and then give a prompt to the wound treatment condition, thereby improving the treatment efficiency of the wound.

Description

Technical Field

[0001] This application relates to the field of medical device technology, and in particular to an endoscope-based wound management method and endoscope system. Background Technology

[0002] Endoscopic submucosal dissection (ESD) is a novel minimally invasive method for treating early gastrointestinal cancers and precancerous lesions, achieving the same results as surgical procedures. It involves using specialized instruments such as high-frequency electrosurgical units under endoscopy to gradually peel away gastrointestinal lesions, including early gastrointestinal tumors, from the underlying normal submucosa, in order to completely remove the lesions.

[0003] After lesion removal, all visible blood vessels on the wound surface require prophylactic hemostasis. Areas prone to bleeding should be treated with thermal coagulation forceps or argon plasma coagulation. For deeper dissections or muscle layer fissures, metal clips should be used for closure. Inexperienced physicians may not be able to accurately perform hemostasis during wound management, leading to incomplete wound treatment and postoperative abnormal bleeding. Furthermore, larger wounds may require multiple metal clips, which can obstruct the physician's view, affecting their observation and assessment of wound progress, and potentially causing errors. Summary of the Invention

[0004] This application provides an endoscopic wound treatment method and endoscopic system to improve wound treatment efficiency.

[0005] In a first aspect, embodiments of this application provide an endoscopic wound management method, using a processor of an endoscopic system, comprising:

[0006] Acquire the first endoscopic image after the endoscopic submucosal dissection procedure;

[0007] Identify unclosed wounds in the first endoscopic image to obtain wound information. The wound information includes at least: wound size, wound location, and wound shape. The wound size is used to indicate the length and width of the unclosed wound. The wound location is used to indicate the coordinates and range of the unclosed wound in the first endoscopic image. The wound shape is used to indicate the edge shape of the unclosed wound.

[0008] Based on the wound information, a first closure procedure is determined for the unclosed wound;

[0009] The first prompt message is output according to the first closing operation scheme.

[0010] Secondly, embodiments of this application provide an endoscope system, which includes: a processor, a display, and an endoscope;

[0011] The endoscope is configured to execute endoscopic image acquisition instructions from the processor; the display is used to display endoscopic images; and the processor is configured to implement the method as described in the first aspect.

[0012] Thirdly, embodiments of this application provide an electronic device, including a memory, a processor, and executable program code stored in the memory and executable on the processor, wherein the processor executes the executable program code and performs the steps of the method described in the first aspect.

[0013] Fourthly, embodiments of this application provide a computer-readable storage medium storing executable program code, the executable program code including execution instructions for performing the steps of the method as described in the first aspect.

[0014] Fifthly, embodiments of this application provide a computer program product, wherein the computer program product includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps described in the first aspect of embodiments of this application. The computer program product may be a software installation package.

[0015] As can be seen, in this embodiment, a first endoscopic image after an endoscopic submucosal dissection is first acquired; then, an unclosed wound in the first endoscopic image is identified to obtain wound information, which includes at least: wound size, wound location, and wound morphology. The wound size indicates the length and width of the unclosed wound, the wound location indicates the coordinates and range of the unclosed wound in the first endoscopic image, and the wound morphology indicates the edge shape of the unclosed wound. Then, a first closure operation plan is determined for the unclosed wound based on the wound information; finally, a first prompt message is output based on the first closure operation plan. This application achieves accurate assessment of the current wound treatment status by automatically identifying and analyzing unclosed wounds in postoperative endoscopic images, thereby providing prompts for wound treatment and improving wound treatment efficiency. Attached Figure Description

[0016] To more clearly illustrate the technical solutions of the embodiments of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0017] Figure 1 This is a system architecture diagram of an endoscope system provided in an embodiment of this application;

[0018] Figure 2 This is a schematic flowchart of an endoscope-based wound management method provided in an embodiment of this application;

[0019] Figure 3 This is a schematic diagram of the first type of wound treatment interface provided in the embodiments of this application;

[0020] Figure 4 This is a closed clamp position marking diagram provided in an embodiment of this application;

[0021] Figure 5 This is a schematic diagram of the first type of prompt information display area provided in the embodiments of this application;

[0022] Figure 6 This is a schematic diagram of the second type of wound treatment interface provided in the embodiments of this application;

[0023] Figure 7 This is a schematic diagram of the second type of prompt information display area provided in the embodiments of this application;

[0024] Figure 8 This is a schematic diagram of the third type of prompt information display area provided in the embodiments of this application;

[0025] Figure 9 This is a functional unit block diagram of an endoscope-based wound treatment device provided in an embodiment of this application;

[0026] Figure 10 This is a functional unit block diagram of another endoscope-based wound treatment device provided in the embodiments of this application;

[0027] Figure 11 This is a schematic diagram of the structure of an electronic device proposed in an embodiment of this application. Detailed Implementation

[0028] To enable those skilled in the art to better understand the present application, the technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of the present application, and not all embodiments. Based on the embodiments in the present application, all other embodiments obtained by those of ordinary skill in the art without creative effort are within the scope of protection of the present application.

[0029] The terms "first," "second," etc., in the specification, claims, and accompanying drawings of this application are used to distinguish different objects, not to describe a specific order. Furthermore, the terms "comprising" and "having," and any variations thereof, are intended to cover non-exclusive inclusion. For example, a process, method, system, product, or apparatus that includes a series of steps or units is not limited to the listed steps or units, but may optionally include steps or units not listed, or may optionally include other steps or units inherent to these processes, methods, products, or apparatuses.

[0030] In this document, the term "embodiment" means that a particular feature, structure, or characteristic described in connection with an embodiment may be included in at least one embodiment of this application. The appearance of this phrase in various places throughout the specification does not necessarily refer to the same embodiment, nor is it a separate or alternative embodiment mutually exclusive with other embodiments. It will be explicitly and implicitly understood by those skilled in the art that the embodiments described herein can be combined with other embodiments.

[0031] When inexperienced doctors perform wound care, they may not be able to accurately judge the placement, orientation, and number of metal clips, leading to incomplete wound treatment and postoperative abnormal bleeding. Furthermore, larger wounds may require multiple clips, raising the question of how to achieve complete wound treatment with fewer clips. Additionally, multiple clips can obstruct the doctor's view, causing errors in observing and assessing whether the wound has been properly treated.

[0032] To address the aforementioned issues, this application provides an endoscope-based wound management method and endoscope system. The embodiments of this application will be described in detail below with reference to the accompanying drawings.

[0033] Please see Figure 1 , Figure 1 This application provides a system architecture diagram of an endoscope system, as shown in the embodiment. Figure 1 As shown, the endoscope system 100 includes a processor 101, a display 102, and an endoscope 103. The processor 101, the display 102, and the endoscope 103 are interconnected. The endoscope 103 is used to acquire image information of the internal tissues of the observed object, such as a human or animal, through an optical lens or electronic imaging element at its front end, convert it into electrical or digital signals, and then transmit it to the processor 101 for processing, and finally display it on the display 102.

[0034] The processor 101 is the control core of the system. Based on the doctor's operations or preset programs, it issues commands to the monitor 102 and endoscope 103, such as controlling the endoscope 103 to acquire and transmit images, and controlling the monitor 102 to display images. The processor 101 can also adjust the display parameters of the monitor 102, such as brightness and contrast, and adjust the illumination brightness and focus of the endoscope 103. Specifically, the processor 101 receives image information in the form of electrical or digital signals from the endoscope 103, and identifies and analyzes the wound based on this image information, thereby generating wound guidance prompts. Simultaneously, it sends the generated guidance prompts and the identified wound image to the monitor 102, enabling the monitor 102 to receive and display the information.

[0035] Specifically, the display 102 includes an image presentation terminal and an operation feedback interface. The image presentation terminal is used to display the image data transmitted from the processor 101 in an intuitive image format, providing doctors with clear images of the internal tissues of the object under observation, facilitating observation and diagnosis. The operation feedback interface is used in conjunction with the processor 101 to provide doctors with generated guidance prompts and other information.

[0036] Based on this, this application provides an endoscope-based wound treatment method and endoscope system, which will be described in detail below with reference to the accompanying drawings.

[0037] Please see Figure 2 , Figure 2 This is a schematic flowchart of an endoscopic wound management method provided in an embodiment of this application, as shown below. Figure 2 As shown, the method includes the following steps:

[0038] S210, acquire the first endoscopic image after the endoscopic submucosal dissection operation.

[0039] In this process, after the ESD procedure, the processor of the endoscope system, or the server of the terminal device connected to the endoscope, sends an image acquisition command to the endoscope. The endoscope then executes the image acquisition command to acquire the first endoscopic image and transmits it to the command-sending terminal. Furthermore, it can also acquire the dynamic process of the wound within a preset time period after the procedure.

[0040] S220, identify the unclosed wound in the first endoscopic image and obtain wound information.

[0041] The wound information includes at least: wound size, wound location, and wound morphology. The wound size is used to indicate the length and width of the unclosed wound. The wound location is used to indicate the coordinates and range of the unclosed wound in the first endoscopic image. The wound morphology is used to indicate the edge shape of the unclosed wound.

[0042] The system automatically identifies endoscopic images via a processor or server, distinguishing between mucosal image areas, closed wound areas, and open wound areas. Different colors are used to differentiate these areas in the first endoscopic image, with each area's identifier including its size, location, and shape. Furthermore, the system automatically delineates the edges of open wound areas, displaying the unclosed region.

[0043] Specifically, traditional machine learning methods can be used for automatic identification. Specifically, the Otsu method and the levelset method are used to segment the image to obtain the wound area. First, the Otsu method is used to perform binary classification of the image based on color to obtain the approximate location of the wound, which serves as the initial contour. Then, the levelset method is used to obtain the refined wound contour. This method has relatively low computational cost, performs well for specific types of mirrors and wound types, and allows for interactive determination of the initial contour.

[0044] Specifically, automatic identification can also be achieved using a deep learning-based approach. Specifically, the UNet network model is used, trained with collected wound images and expert-annotated datasets of wound regions and types. The trained model is then used to segment the wound region on real-time endoscopic images to determine the wound extent and type.

[0045] After acquiring the first endoscopic image, the processor controls the display screen to enter the wound processing interface. The wound processing interface includes an endoscopic image display area and a prompt information display area, with the first endoscopic image displayed in the endoscopic image display area. After automatic recognition of the first endoscopic image, the recognized endoscopic image marking the unclosed wound area replaces the first endoscopic image and is displayed in the endoscopic image display area. Furthermore, the recognized endoscopic image marking the unclosed wound area and the first endoscopic image can be displayed together in the endoscopic image display area.

[0046] Specifically, please refer to Figure 3 , Figure 3 This is a schematic diagram of the first type of wound treatment interface provided in the embodiments of this application, as shown below. Figure 3As shown, the endoscopic image display area of ​​the wound treatment interface can contain multiple endoscopic images, including, for example, four endoscopic images: A, B, C, and D. Endoscopic image A shows a relatively complete internal tissue surface; Endoscopic image B shows some black and grayish-white substances at the wound site, which may be necrotic tissue or other attachments, indicating a more complex wound condition; Endoscopic image C shows obvious damage and irregular tissue morphology at the wound site, with a somewhat grayish color, indicating the degree of wound damage; Endoscopic image D shows several metal clips at the wound site for closing the wound, with red closure lines marking the unclosed areas.

[0047] Specifically, users can perform zoom, rotation, and other operations by clicking on the images mentioned above.

[0048] Furthermore, the endoscopic image display area also includes a dynamic broadcast window for displaying endoscopic images in real time.

[0049] like Figure 3 As shown, the wound treatment interface also includes a photo control and a recording control. Clicking the photo control will take a screenshot of the current wound treatment interface. Clicking the recording control for the first time will start recording a video of the current wound treatment interface. Clicking the recording control a second time will stop recording.

[0050] S230, determine a first closure operation plan for the unclosed wound based on the wound information.

[0051] Specifically, the first closure operation scheme includes information on the number of closure clips required for the unclosed wound and the position information of each closure clip in the unclosed wound, wherein the closure clip is used to close the wound.

[0052] Specifically, determining the first closure operation plan for the unclosed wound based on the wound information includes: determining the quantity information based on the wound size and the wound shape; determining the location information based on the wound size, the wound location, the wound shape, and the quantity information; and obtaining the first closure operation plan based on the quantity information and the location information.

[0053] The closure clips are metal clips. The initial number of closure clips can be determined based on the size of the wound, the length and width of the wound (small, medium, or large), or the area of ​​the wound. Then, referring to the number of closure clips for each wound level, a preliminary number of closure clips is obtained. For example, for a small wound with a length and width of less than 1 cm, the initial number of closure clips is one.

[0054] Furthermore, the need to add closure clips can be determined based on the wound morphology. Specifically, if the wound is irregular in shape, such as long strip or polygon, the number of closure clips should be increased appropriately according to the protruding parts and turning points to ensure that each part can be effectively closed.

[0055] After determining the number of closure clips, their positions are determined based on the principles of uniform distribution, complete wound coverage, and avoidance of critical structures. First, the wound morphology is considered, and the placement rules for the clips are determined accordingly. For example, for straight wounds, clips are placed at regular intervals along the wound edge, starting from one end. For irregular wounds, key areas such as corners, protrusions, or wider sections are identified, and clips are placed at these locations to maintain the basic shape of the wound. Based on these placement rules, the length and width of the wound, and the location information of unclosed wounds, the position information of each clip is determined. This position information corresponds to the specific coordinates that the clip needs to hold in the endoscopic image.

[0056] The metal clip is positioned close to the normal tissue and mucous membrane around the wound, and the contact points between the metal clip and the surrounding normal tissue and mucous membrane are marked on the wound image. For an example, please refer to [link to example]. Figure 4 , Figure 4 This is a closed clamp position marking diagram provided in an embodiment of this application, such as... Figure 4 As shown, the unclosed wound is elliptical and requires three closure clips. Each clip has two anchor points. Figure 4 The same color is used to indicate the position of the first clamping clamp. Specifically, two purple marks are used to indicate the clamping position of the second clamping clamp, and two green marks are used to indicate the clamping position of the third clamping clamp.

[0057] As can be seen, the embodiments of this application can provide users with accurate closure procedures, thereby effectively closing the wound and achieving stable closure.

[0058] S240, output the first prompt information according to the first closing operation scheme.

[0059] The process involves determining multiple closing steps based on the number and position of the closing clips. These steps are arranged sequentially, and each step carries auxiliary information explaining the reason for its current order. Furthermore, only the order of the most important closing steps may be determined, while other steps can be determined by the user.

[0060] Specifically, the endoscope system further includes a display screen for displaying a wound treatment interface. The wound treatment interface includes an endoscope image display area and a prompt information display area. After outputting the first prompt information according to the first closure operation scheme, the method further includes: displaying a first endoscope image of the unclosed wound marked in the endoscope image display area; and displaying the first prompt information in the prompt information display area.

[0061] After displaying a prompt message about the current wound, the endoscopic image of the marked unclosed wound is shown in the endoscopic image display area of ​​the wound treatment interface, similar to... Figure 3 Image D in the image only shows the current endoscopic image before the closure operation has been performed; the metal clip is not present. For further details, please refer to... Figure 5 , Figure 5 This is a schematic diagram of the first type of prompt information display area provided in the embodiments of this application, such as... Figure 5 As shown, the prompt information display area includes a first closing step area, a second closing step area, a third closing step area, and so on. Each closing step area may include at least one closing step. The closing steps in the first closing step area have a higher priority than the closing steps in the second closing step area, and the closing steps in the second closing step area have a higher priority than the closing steps in the third closing step area. For example, multiple closing steps in the first prompt information can be displayed sequentially in the prompt information display area according to their priority.

[0062] As can be seen, in this embodiment of the application, by automatically identifying and analyzing the unclosed wound in the postoperative endoscopic images, the current wound treatment status can be accurately assessed, thereby providing prompts for the wound treatment status and improving the efficiency of wound treatment.

[0063] In one possible embodiment, after outputting the first prompt information according to the first closure operation scheme, the method further includes: acquiring a second endoscopic image after the user performs the second closure step; determining a second closure operation scheme based on the second endoscopic image; and outputting a second prompt information based on the second closure operation scheme.

[0064] Each time a doctor completes a closure procedure, an endoscopic image is acquired. Then, the doctor identifies the unclosed wound in the newly acquired endoscopic image, obtains information such as the size, location, and shape of the unclosed wound, and determines a new closure procedure based on the above information, thereby outputting new prompt information.

[0065] As can be seen, in this embodiment of the application, real-time identification of unclosed wounds enables real-time prompts for wound treatment, thereby improving the efficiency of wound treatment.

[0066] Specifically, the first prompt information includes multiple first closure steps. After acquiring the second endoscopic image after the user performs the second closure step, and before determining the second closure operation scheme based on the second endoscopic image, the method further includes: determining whether the user refers to the first prompt information based on the multiple first closure steps and the second closure step; if the user does not refer to the first prompt information, determining the number of times the user has not referred; and detecting that the number of times the user has not referred is less than or equal to a preset number.

[0067] After performing the wound closure operation using metal clips, the doctor determines whether the closure operation is related to the multiple closure operations in the first prompt information. Specifically, the doctor can determine whether there is a corresponding closure step among the multiple first closure steps based on the position of the metal clips in the second closure operation. If there is, it is determined that the doctor referred to the first prompt information; if not, it is determined that the doctor did not refer to the first prompt information.

[0068] Each time it is determined that the doctor has not referred to the prompt information, the number of times the doctor has not referred will be updated, that is, the number of times the doctor has not referred will be increased by one. If the current number of times the doctor has not referred is less than or equal to the preset number, a closure operation plan will be generated and a new prompt information will be output.

[0069] Specifically, if the number of non-references is detected to be greater than the preset number, a confirmation message is output. The confirmation message is used by the user to confirm whether to turn off the prompt function, and the prompt function is used to display a single prompt message.

[0070] Specifically, the endoscope system further includes a display screen for displaying a wound treatment interface. After detecting that the number of non-references is greater than the preset number, the method further includes: popping up a confirmation window on the wound treatment interface. The confirmation window includes the confirmation information, a confirm control, and a deny control. The confirm control is used to confirm that the prompt function is turned off, and the deny control is used to confirm that the prompt function is not turned off.

[0071] If the number of times the function is not referenced exceeds a preset number, the function will be disabled. A confirmation window will pop up in the wound treatment interface to ask whether the function needs to be disabled, i.e., whether to continue outputting prompt messages. Please refer to [link / reference]. Figure 6 , Figure 6 This is a schematic diagram of the second type of wound treatment interface provided in the embodiments of this application, as shown below. Figure 6 As shown, a confirmation window pops up in the wound treatment interface. The confirmation window includes confirmation information on whether to turn off the prompt function, a yes control, and a no control. The yes control corresponds to the confirm control, and the no control corresponds to the negate control.

[0072] The system allows users to confirm whether to close the prompt function by clicking a control. If the user does not click the confirm or deny control within a preset time, the confirmation interface window will automatically close, and the prompt information will continue to be displayed in real time.

[0073] In one possible embodiment, after acquiring the second endoscopic image after the user performs the second closure step, the method further includes: determining, based on the second endoscopic image, whether the second closure step needs to be corrected; if the second closure step needs to be corrected, outputting guidance information, the guidance information including the deviation position and / or deviation angle of the closure clamp used in the second closure step.

[0074] After the doctor completes a closure step, the appropriateness of the closure step is determined based on the endoscopic images. Specifically, the orientation and position of the current metal clip are determined to be appropriate, and thus, whether the closure operation needs to be corrected.

[0075] If the second closure step needs correction, it is necessary to determine whether the doctor followed the instructions during the closure operation. If the doctor followed the instructions, it is determined whether the metal clips are perpendicular to the wound surface and whether they correspond to the marked areas. If the metal clips are perpendicular to the wound surface and fall exactly at the marked areas, the second closure step does not require correction. If the metal clips are not perpendicular to the wound surface or do not correspond to the marked areas, the second closure step requires correction.

[0076] If the doctor does not follow the prompts when performing the closure procedure, it will determine whether there is a gap or exposed tissue. If so, it will be determined that correction is needed; if not, it will be determined that no correction is needed.

[0077] Furthermore, guidance information is output based on the position and clamping direction of the metal clip displayed on the endoscopic image. The guidance information includes the correct clamping position and the correct clamping angle of the metal clip.

[0078] Specifically, the endoscope system further includes a display screen for displaying a wound treatment interface, the wound treatment interface including a prompt information display area, and after outputting guidance information if correction is needed for the second closure step, the method further includes: displaying the guidance information in the prompt information display area.

[0079] Please refer to Figure 7 , Figure 7 This is a schematic diagram of the second type of prompt information display area provided in the embodiments of this application, such as... Figure 7As shown, the prompt information display area also includes a guide information display area for displaying guide information, with prompt information displayed below the guide information display area.

[0080] In one possible embodiment, after acquiring the second endoscopic image after the user performs the second closure step, and before determining the second closure operation scheme based on the second endoscopic image, the method further includes: outputting the closure result of the second closure step based on the second endoscopic image, the closure result including the closure operation type, the number of closure clips used, the closure status of the unclosed wound, and / or the marking information of the incompletely closed area in the second endoscopic image; detecting that the closure status of the unclosed wound is that the unclosed wound is not completely closed.

[0081] The system outputs a closure result for each closure step and automatically identifies any unclosed areas. If any remain, it automatically outlines the edge of the unclosed wound area and displays it. If the unclosed wound is fully closed, the closure result includes the closure operation type, the number of closure clips used, and the fully closed state, without further prompts. If the unclosed wound is not fully closed, the closure result includes the closure operation type, the number of closure clips used, the incomplete closure state, and the marking information of the incompletely closed area in the acquired real-time endoscopic image, while continuing to output new prompts.

[0082] Specifically, the endoscope system further includes a display screen for displaying a wound treatment interface. The wound treatment interface includes an endoscope image display area and a prompt information display area. After outputting the second prompt information according to the second closure operation scheme, the method further includes: displaying a second endoscope image with the marked incompletely closed area in the endoscope image display area; and displaying the second prompt information and the closure result in the prompt information display area.

[0083] If the unclosed wound is in a fully closed state, a second endoscopic image is displayed in the endoscopic image display area, and a prompt information display area shows the closure operation type, the number of closure clips used, and the closure result of a fully closed state. If the unclosed wound is in a partially closed state, a second endoscopic image with the partially closed area marked is displayed in the endoscopic image display area. An example could be... Figure 3 The endoscope image D is displayed in the image; and the closure result, including the type of closure operation, the number of closure clips used, the closure status of incomplete closure, and the marking information of the incompletely closed area in the acquired real-time endoscope image, as well as a second prompt message, is displayed in the prompt information display area.

[0084] Please see Figure 8 , Figure 8 This is a schematic diagram of the third type of prompt information display area provided in the embodiments of this application, such as... Figure 8 As shown, the prompt information display area also includes a closure result display area for displaying the closure result, and a second prompt information is displayed at the prompt information location. For example, according to... Figure 3 The closure result obtained from the endoscope image D is as follows: the closure operation type is metal clip closure, the number of closure clips used is 4, the closure status is not completely closed, indicating that further processing is required, and the identification information of the incompletely closed area is the red mark in the endoscope image D.

[0085] In one possible embodiment, the wound closure method also includes purse-string suture with nylon cord, which is suitable for large ESD wounds. Purse-string suture with nylon cord can effectively close the wound. Specifically, firstly, a nylon cord is inserted into the stomach through the endoscopic biopsy channel; then, the nylon cord is placed around the wound, and titanium clips are used to fix the nylon cord loop to the mucosal tissue at the edge of the wound; finally, the nylon cord is pulled together under direct endoscopic visualization to complete the purse-string suture.

[0086] Wound closure methods also include stapler-assisted procedures, such as over-the-scope clips (OTSC), suitable for larger wounds. First, a suitable stapler is selected, then it is delivered to the wound location for precise alignment; finally, the stapler is activated to ensure tight adhesion to the wound, completing the closure. Another wound closure method is thermosensitive gel, which can be applied directly via a catheter.

[0087] If the wound cannot be closed using metal clips, other closure methods can be selected to perform the closure operation, displaying the closure progress in real time and generating corresponding prompts. For example, in the nylon rope purse-string suture closure operation mode, prompts or guidance information on the suture position are output; in the stapler-assisted closure operation mode, prompts or guidance are provided on determining the angle between the stapler and the wound.

[0088] For examples consistent with the above embodiments, please refer to... Figure 9 , Figure 9 This is a functional unit block diagram of an endoscope-based wound treatment device provided in an embodiment of this application, as shown below. Figure 9As shown, the endoscopic wound treatment device 90 includes: an acquisition unit 91 for acquiring a first endoscopic image after an endoscopic submucosal dissection operation; an identification unit 92 for identifying unclosed wounds in the first endoscopic image and obtaining wound information, the wound information including at least: wound size, wound location, and wound morphology, the wound size indicating the length and width of the unclosed wound, the wound location indicating the coordinates and range of the unclosed wound in the first endoscopic image, and the wound morphology indicating the edge shape of the unclosed wound; a determination unit 93 for determining a first closure operation plan for the unclosed wound based on the wound information; and an output unit 94 for outputting a first prompt message based on the first closure operation plan.

[0089] In one possible embodiment, the first closure operation scheme includes information on the number of closure clips required for the unclosed wound and information on the position of each closure clip in the unclosed wound, the closure clips being used to close the wound.

[0090] In one possible embodiment, in determining a first closure operation plan for the unclosed wound based on the wound information, the determining unit 93 is specifically configured to: determine the quantity information based on the wound size and the wound morphology; determine the location information based on the wound size, the wound location, the wound morphology, and the quantity information; and obtain the first closure operation plan based on the quantity information and the location information.

[0091] In one possible embodiment, after outputting the first prompt information according to the first closure operation scheme, the endoscope-based wound treatment device 90 is further configured to: acquire a second endoscopic image after the user performs the second closure step; determine a second closure operation scheme according to the second endoscopic image; and output a second prompt information according to the second closure operation scheme.

[0092] In one possible embodiment, the first prompt information includes multiple first closure steps. After acquiring the second endoscopic image after the user performs the second closure step, and before determining the second closure operation scheme based on the second endoscopic image, the endoscopic wound treatment device 90 is further configured to: determine whether the user has referred to the first prompt information based on the multiple first closure steps and the second closure step; if the user has not referred to the first prompt information, determine the number of times the user has not referred; and detect that the number of times the user has not referred is less than or equal to a preset number.

[0093] In one possible embodiment, the endoscopic wound treatment device 90 is further configured to: if the number of non-references is detected to be greater than the preset number, output confirmation information, wherein the confirmation information is used by the user to confirm whether to turn off the prompt function, and the prompt function is used to display a single prompt message.

[0094] In one possible embodiment, after acquiring a second endoscopic image after the user performs the second closure step, the endoscopic wound treatment device 90 is further configured to: determine whether the second closure step needs to be corrected based on the second endoscopic image; if the second closure step needs to be corrected, output guidance information, the guidance information including the deviation position and / or deviation angle of the closure clamp used in the second closure step.

[0095] In one possible embodiment, after acquiring the second endoscopic image after the user performs the second closure step, and before determining the second closure operation scheme based on the second endoscopic image, the endoscopic wound treatment device 90 is further configured to: output the closure result of the second closure step based on the second endoscopic image, the closure result including the closure operation type, the number of closure clips used, the closure state of the unclosed wound, and / or the marking information of the incompletely closed area in the second endoscopic image; and detect that the closure state of the unclosed wound is that the unclosed wound is not completely closed.

[0096] In one possible embodiment, the endoscope system further includes a display screen for displaying a wound treatment interface, the wound treatment interface including an endoscope image display area and a prompt information display area. After outputting the first prompt information according to the first closure operation scheme, the endoscope-based wound treatment device 90 is further configured to: display a first endoscope image of the unclosed wound marked in the endoscope image display area; and display the first prompt information in the prompt information display area.

[0097] In one possible embodiment, the endoscope system further includes a display screen for displaying a wound treatment interface. After detecting that the number of non-references is greater than the preset number and outputting confirmation information, the endoscope-based wound treatment device 90 is further configured to: pop up a confirmation window on the wound treatment interface, the confirmation window including the confirmation information, a confirm control, and a deny control, the confirm control being used to confirm that the prompt function is turned off, and the deny control being used to confirm that the prompt function is not turned off.

[0098] In one possible embodiment, the endoscope system further includes a display screen for displaying a wound treatment interface, the wound treatment interface including a prompt information display area. After outputting guidance information if the second closure step needs to be corrected, the endoscope-based wound treatment device 90 is further configured to display the guidance information in the prompt information display area.

[0099] In one possible embodiment, the endoscope system further includes a display screen for displaying a wound treatment interface, the wound treatment interface including an endoscope image display area and a prompt information display area. After outputting the second prompt information according to the second closure operation scheme, the endoscope-based wound treatment device 90 is further configured to: display a second endoscope image of the marked incompletely closed area in the endoscope image display area; and display the second prompt information and the closure result in the prompt information display area.

[0100] It is understood that since the method embodiments and the device embodiments are different presentations of the same technical concept, the content of the method embodiment section in this application should be adapted to the device embodiment section, and will not be repeated here.

[0101] In the case of using integrated units, please refer to Figure 10 , Figure 10 This is a functional unit block diagram of another endoscope-based wound treatment device provided in the embodiments of this application, such as... Figure 10 As shown, the endoscopic wound treatment device 90 includes a processing module 902 and a communication module 901. The processing module 902 controls and manages the operation of the endoscopic wound treatment device 90, for example, executing the steps of the acquisition unit 91, the identification unit 92, the determination unit 93, and the output unit 94, and / or performing other processes of the technology described herein. The communication module 901 is used for interaction between the endoscopic wound treatment device 90 and other devices. Figure 10 As shown, the endoscope-based wound treatment device 90 may further include a storage module 903, which is used to store the program code and data of the endoscope-based wound treatment device 90.

[0102] The processing module 902 can be a processor or controller, such as a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field-programmable gate array (FPGA), or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof. It can implement or execute various exemplary logic blocks, modules, and circuits described in conjunction with the disclosure of this application. The processor can also be a combination that implements computing functions, such as a combination of one or more microprocessors, a combination of a DSP and a microprocessor, etc. The communication module 901 can be a transceiver, RF circuitry, or a communication interface, etc. The storage module 903 can be a memory.

[0103] All relevant content in each scenario involved in the above method embodiments can be referenced from the functional descriptions of the corresponding functional modules, and will not be repeated here. The above-mentioned endoscope-based wound treatment device 90 can perform the above-mentioned... Figure 2 The endoscopic wound management method shown is illustrated.

[0104] Please see Figure 11 , Figure 11 This is a schematic diagram of the structure of an electronic device proposed in an embodiment of this application, as shown below. Figure 11 As shown, the electronic device 1100 includes a processor 1110, a memory 1120, a communication interface 1130, and one or more programs 1121. The one or more programs 1121 are stored in the memory and configured to be executed by the processor. When the program is executed, it includes some or all of the steps of any of the process configuration methods described in the above method embodiments. The processor, memory, and communication interface are interconnected and complete communication between them.

[0105] The memory can be volatile memory such as Dynamic Random Access Memory (DRAM) or non-volatile memory such as a hard disk drive. The memory stores a set of executable program code, and the processor calls the executable program code stored in the memory to execute some or all of the steps of any of the endoscopic wound treatment methods described in the above embodiments of the endoscopic wound treatment method.

[0106] As can be seen, the electronic device 1100 described in this application first acquires a first endoscopic image after an endoscopic submucosal dissection operation; then, it identifies unclosed wounds in the first endoscopic image to obtain wound information, which includes at least: wound size, wound location, and wound morphology. The wound size indicates the length and width of the unclosed wound, the wound location indicates the coordinates and range of the unclosed wound in the first endoscopic image, and the wound morphology indicates the edge shape of the unclosed wound. Then, based on the wound information, a first closure operation plan is determined for the unclosed wound; finally, a first prompt message is output based on the first closure operation plan. This application achieves accurate assessment of the current wound treatment status by automatically identifying and analyzing unclosed wounds in postoperative endoscopic images, thereby providing prompts for wound treatment and improving wound treatment efficiency.

[0107] This application also provides a computer storage medium storing a computer program for electronic data interchange, which causes a computer to perform some or all of the steps of any of the methods described in the above method embodiments, wherein the computer includes an electronic device.

[0108] This application also provides a computer program product, which includes a non-transitory computer-readable storage medium storing a computer program operable to cause a computer to perform some or all of the steps of any of the methods described in the above method embodiments. The computer program product may be a software installation package, and the computer may include an electronic device.

[0109] It should be noted that, for the sake of simplicity, the aforementioned methods are described as a series of actions. However, those skilled in the art should understand that this application is not limited to the described order of actions, as some steps may be performed in other orders or simultaneously. Furthermore, those skilled in the art should also understand that the embodiments described in the specification are optional, and the actions and modules involved are not necessarily essential to this application.

[0110] In the above embodiments, the descriptions of each embodiment have their own emphasis. For parts not described in detail in a certain embodiment, please refer to the relevant descriptions of other embodiments.

[0111] In the several embodiments provided in this application, it should be understood that the disclosed apparatus can be implemented in other ways. For example, the apparatus embodiments described above are merely illustrative; for instance, the division of units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another system, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical or other forms.

[0112] The units described as separate components may or may not be physically separate. The components shown as units may or may not be physical units; that is, they may be located in one place or distributed across multiple network units. Some or all of the units can be selected to achieve the purpose of this embodiment, depending on actual needs.

[0113] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software program module.

[0114] If the integrated unit is implemented as a software program module and sold or used as an independent product, it can be stored in a computer-readable storage device (CMD). Based on this understanding, the technical solution of this application, in essence, or the part that contributes to the prior art, or all or part of the technical solution, can be embodied in the form of a software product. This computer software product is stored in a memory and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute all or part of the steps of the methods described in the various embodiments of this application. The aforementioned memory includes various media capable of storing program code, such as USB flash drives, read-only memory (ROM), random access memory (RAM), portable hard drives, magnetic disks, or optical disks.

[0115] Those skilled in the art will understand that all or part of the steps in the various methods of the above embodiments can be implemented by a program instructing related hardware. The program can be stored in a computer-readable storage device, which may include: a flash drive, a read-only memory, a random access memory, a magnetic disk, or an optical disk, etc.

[0116] The embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The above description of the embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. An endoscopic-based wound management method, characterized in that, A processor applied to an endoscope system, the method comprising: Acquire the first endoscopic image after the endoscopic submucosal dissection procedure; Identify unclosed wounds in the first endoscopic image to obtain wound information. The wound information includes at least: wound size, wound location, and wound shape. The wound size is used to indicate the length and width of the unclosed wound. The wound location is used to indicate the coordinates and range of the unclosed wound in the first endoscopic image. The wound shape is used to indicate the edge shape of the unclosed wound. Based on the wound information, a first closure operation plan is determined for the unclosed wound. The first closure operation plan includes the number of closure clips required for the unclosed wound and the position information of each closure clip in the unclosed wound. The closure clips are used to close the wound. The first prompt message is output according to the first closure operation scheme; Acquire a second endoscopic image after the user performs the second closure step; Determine whether the second closure step needs to be corrected based on the second endoscopic image; If corrections are needed for the second closing step, guidance information is output, which includes the offset position and / or offset angle of the closing clamp used in the second closing step.

2. The method according to claim 1, characterized in that, The step of determining a first closure operation plan for the unclosed wound based on the wound information includes: The quantity information is determined based on the wound size and the wound morphology; The location information is determined based on the wound size, the wound location, the wound shape, and the number of wounds. The first closure operation scheme is obtained based on the quantity information and the location information.

3. The method according to claim 1, characterized in that, After acquiring the second endoscopic image after the user performs the second closure step, the method further includes: Determine the second closure procedure based on the second endoscopic image; The second prompt message is output according to the second closing operation scheme.

4. The method according to claim 3, characterized in that, The first prompt information includes multiple first closure steps. After acquiring the second endoscopic image after the user performs the second closure step, and before determining the second closure operation scheme based on the second endoscopic image, the method further includes: Based on the plurality of first closing steps and the second closing steps, it is determined whether the user has referred to the first prompt information; If the user does not refer to the first prompt information, then the number of times the user has not referred is determined; The number of unreferenced instances was detected to be less than or equal to a preset number.

5. The method according to claim 4, characterized in that, The method further includes: If the number of non-references is detected to be greater than the preset number, a confirmation message is output. The confirmation message is used by the user to confirm whether to turn off the prompt function. The prompt function is used to display a single prompt message.

6. The method according to claim 3, characterized in that, After acquiring the second endoscopic image after the user performs the second closure step, and before determining the second closure operation scheme based on the second endoscopic image, the method further includes: The closure result of the second closure step is output based on the second endoscopic image. The closure result includes the closure operation type, the number of closure clips used, the closure status of the unclosed wound, and / or the marking information of the incompletely closed area in the second endoscopic image. The detection indicates that the unclosed wound is not fully closed.

7. The method according to any one of claims 1-6, characterized in that, The endoscopic system further includes a display screen for displaying a wound treatment interface. The wound treatment interface includes an endoscopic image display area and a prompt information display area. After outputting the first prompt information according to the first closure operation scheme, the method further includes: A first endoscopic image of the unclosed wound marked is displayed in the endoscopic image display area; and the first prompt information is displayed in the prompt information display area.

8. The method according to claim 5, characterized in that, The endoscopic system further includes a display screen for displaying a wound treatment interface. After detecting that the number of non-references exceeds the preset number and outputting a confirmation message, the method further includes: A confirmation window pops up on the wound treatment interface. The confirmation window includes the confirmation information, a confirm control, and a denial control. The confirm control is used to confirm that the prompt function is turned off, and the denial control is used to confirm that the prompt function is not turned off.

9. The method according to claim 1, characterized in that, The endoscopic system further includes a display screen for displaying a wound management interface, the wound management interface including a prompt information display area. If corrections to the second closure step are needed, after outputting guidance information, the method further includes: The guidance information is displayed in the prompt information display area.

10. The method according to claim 6, characterized in that, The endoscopic system further includes a display screen for displaying a wound treatment interface. The wound treatment interface includes an endoscopic image display area and a prompt information display area. After outputting the second prompt information according to the second closure operation scheme, the method further includes: A second endoscopic image of the incompletely closed area is displayed in the endoscopic image display area; and the second prompt information and the closure result are displayed in the prompt information display area.

11. An endoscope system, characterized in that, The endoscope system includes: a processor, a display, and an endoscope; The endoscope is configured to execute endoscopic image acquisition instructions from the processor; the display is used to display endoscopic images; the processor is configured to implement the method as described in any one of claims 1-10.

Images