Intelligent monitoring method and system for video image of visual double-lumen bronchial catheter

Abstract

This invention relates to the field of image recognition technology, and discloses a method and system for intelligent monitoring of images of a visual double-lumen bronchial catheter. Responding to a preset trigger condition, the system uses the visual double-lumen bronchial catheter to acquire a reference image showing the relative positional relationship between the second inflatable cuff and the carina at the carina level within the patient's trachea. Status data is then detected to obtain reference status data on the relative positional relationship between the second inflatable cuff and the carina. During surgery, the system uses the visual double-lumen bronchial catheter to acquire real-time detection images within the patient's trachea and obtains detection status data on the relative positional relationship between the second inflatable cuff and the carina. The system determines whether the difference between the detection status data and the reference status data meets a preset condition. If so, it sends a warning message indicating an abnormal position of the visual double-lumen bronchial catheter. This achieves automated identification and warning of abnormal positions of the visual double-lumen bronchial catheter during surgery based on status data from the reference and detection images.

Description

Technical Field

[0001] This invention discloses a method and system for intelligent monitoring of images of a visual dual-lumen bronchial tube, which relates to the field of image recognition technology. Background Technology

[0002] Lung isolation is routinely required during anesthesia for lung-related diagnostic and treatment surgeries to physically isolate the tracheal pathway between the operated lung and the unoperated lung (healthy lung). This allows for the prolonged coexistence of two different states: the operated lung remaining in a state of respiratory arrest while the healthy lung is under normal artificial ventilation. It also prevents the direct dissemination of tumorous or infectious fluids or blood from the operated lung to the healthy lung via the airway during the surgical procedure. Visual double-lumen endotracheal tubes (DBLs) are the most common tool for managing lung isolation airways and are widely used in clinical surgical anesthesia to achieve lung isolation and one-lung ventilation. DBLs are available in left and right lateral versions, physically separating the ventilation pathways of the two lungs at the level of the left / right main bronchus openings. This allows for flexible switching between bilateral lung ventilation, left-sided unilateral lung ventilation, or right-sided unilateral lung ventilation as needed for the surgical anesthesia.

[0003] Under normal circumstances, when changes occur in the images acquired by the visual double-lumen bronchial tube, the attending physician or anesthesiologist needs to determine whether there is a problem with the insertion of the visual double-lumen bronchial tube based on the real-time acquired images. For example, the visual double-lumen bronchial tube may be well aligned after anesthesia, but due to changes in the patient's surgical position, traction on the trachea or main bronchus during the operation, the tube that has been inserted into the left or right main bronchus and is well aligned may shift, leading to poor mechanical ventilation of the unaffected lung or incomplete closure of the operated lung, resulting in respiratory problems. The anesthesiologist needs to handle these issues promptly.

[0004] However, during surgery, the attending physician focuses more on the location of the lesion, while the anesthesiologist is more concerned with the patient's overall condition. They may not be able to detect displacement of the visual double-lumen bronchial tube in time. Even minor displacement is difficult to detect visually. However, even small displacement during prolonged surgery can lead to poor mechanical ventilation of the healthy lung or incomplete closure of the operated lung, causing respiratory problems. Therefore, timely and accurate identification of visual double-lumen bronchial tube displacement and prompting timely intervention by the physician is a pressing issue. Summary of the Invention

[0005] In view of the above-mentioned defects or deficiencies in the existing technology, it is desirable to provide a visual dual-lumen bronchial tube image intelligent monitoring method and system, so as to automatically detect and identify the position of the tube through real-time acquired detection images, and send an abnormality reminder when the tube displacement occurs to prompt the doctor to deal with the tube displacement in a timely manner, thereby avoiding medical accidents caused by tube displacement.

[0006] In a first aspect, embodiments of the present invention provide a method for intelligent monitoring of images of a visual dual-lumen bronchial catheter, comprising: In response to a preset triggering condition, a reference image of the relative position of the second inflatable cuff to the carina at the level of the patient's trachea is obtained using a visual double-lumen bronchial catheter. The reference image includes the tracheal carina, at least a portion of the bronchial opening on the intubation side at the carina level, and a portion of the second inflatable cuff of the visual double-lumen bronchial catheter. State data detection is performed on the reference image to obtain reference state data on the relative positional relationship between the second inflatable cuff and the carina within the trachea; the reference state data includes at least one of the following: the first contact arc length between the second inflatable cuff and the bronchial wall on the horizontal intubation side of the carina; and the first image area of ​​the second inflatable cuff in the reference image. During the surgery, the visual double-lumen endotracheal tube is used to acquire real-time images of the relative positional relationship between the second inflatable cuff and the carina at the carina level within the patient's trachea. Status data is then detected on these images to obtain status data of the relative positional relationship between the second inflatable cuff and the carina within the trachea. This status data includes at least one of the following: the second contact arc length between the second inflatable cuff and the bronchial wall on the intubation side at the carina level; and the second image area of ​​the second inflatable cuff in the detected images. The status data corresponds one-to-one with the reference status data. Determine whether the difference between the detected status data and the reference status data meets a preset condition. If so, send a reminder message indicating an abnormal position of the visual dual-lumen bronchial tube.

[0007] In some embodiments, when the reference state data is a first contact arc length and the detected state data is a second contact arc length, the state data detection includes: For the reference image and the detection image respectively, the edges of the second inflatable cuff and the bronchus on the carina horizontal cannulation side are extracted to obtain the cuff edge point set and the bronchus wall edge point set; The set of contact points between the second inflatable cuff and the bronchial wall edge point set is determined based on the intersection of the cuff edge point set and the bronchial wall edge point set. Obtain the pixel coordinates of at least two contact points in the set of contact points, and determine the first contact arc length and the second contact arc length based on the pixel coordinates of the at least two contact points.

[0008] In some embodiments, the determination of the contact arc length based on the pixel coordinates of the at least two contact points is achieved using the following formula:

[0009] in, The contact arc length between the second inflatable cuff and the bronchial wall on the side of the carina horizontal intubation cannula is given. The pixel coordinates of the contact point. , This represents the number of contact points in the contact point cluster.

[0010] In some embodiments, when the reference state data is a first image area and the detected state data is a second image area, the state data detection includes: For the reference image and the detection image respectively, the edge of the second inflatable bladder is extracted to obtain the bladder edge point set; The area of ​​the first image and the area of ​​the second image are determined based on the set of edge points of the sheath.

[0011] In some embodiments, the determination of the image area based on the set of edge points of the sheath is achieved using the following formula:

[0012] in, The area of ​​the second inflatable bladder in the image. These are the pixel coordinates of the points on the edge of the capsule. , This represents the number of cuff edge points in the cuff edge point set.

[0013] In some embodiments, it also includes: Acquire the patient's respiratory cycle signal, determine the reference time of the reference image in the respiratory cycle in response to the preset trigger condition, and use the reference time as the target acquisition time for the detection image acquisition; During the procedure, for each respiratory cycle of the patient, the target acquisition time is identified, and the visual dual-lumen bronchial catheter is controlled to acquire the detection image at the target acquisition time.

[0014] In some embodiments, it also includes: Obtain the actual acquisition time of the detected image during the respiratory cycle; Based on the actual acquisition time and the target acquisition time, determine the compensation factor corresponding to the detected image; Based on the compensation factor, the second contact arc length and the second image area are calculated after breathing compensation.

[0015] In some embodiments, the calculation of the second contact arc length based on respiratory compensation is performed using the following formula:

[0016] in, This is the second contact arc length after respiratory compensation. The second contact arc length is calculated directly from the detected image. This refers to the actual data collection time. For the target acquisition time, is the time decay constant.

[0017] In some embodiments, it also includes: The control and reminder terminal displays the reference image in a first preset area and the detection image in a second preset area, wherein the first preset area and the second preset area are located on the same axis. When sending a reminder message about an abnormal position of the visual double-lumen bronchial tube, the system controls the reminder terminal to send at least one of a preset reminder icon and a prompt text, and controls the reminder terminal to emit an alarm prompt sound at a preset frequency.

[0018] Secondly, embodiments of the present invention provide a visual dual-lumen bronchial tube image intelligent monitoring system, comprising: A response module is used to respond to a preset triggering condition and use a visual double-lumen bronchial catheter to acquire a reference image of the relative positional relationship between the second inflatable cuff and the carina at the level of the patient's trachea. The reference image includes the tracheal carina, at least a portion of the bronchial opening on the intubation side at the carina level, and a portion of the second inflatable cuff of the visual double-lumen bronchial catheter. The first detection module is used to perform state data detection on the reference image to obtain reference state data on the relative positional relationship between the second inflatable cuff and the carina in the trachea; the reference state data includes at least one of the following: the first contact arc length between the second inflatable cuff and the bronchial wall on the horizontal intubation side of the carina; and the first image area of ​​the second inflatable cuff in the reference image. The second detection module is used during surgery to acquire, in real time, a detection image of the relative positional relationship between the second inflatable cuff and the carina at the carina level within the patient's trachea using the visual double-lumen bronchial catheter, and to perform state data detection on the detection image to obtain detection state data of the relative positional relationship between the second inflatable cuff and the carina within the trachea; the detection state data includes at least one of the second contact arc length between the second inflatable cuff and the bronchial wall on the intubation side at the carina level, and the second image area of ​​the second inflatable cuff in the detection image; the detection state data corresponds one-to-one with the reference state data; The judgment module is used to determine whether the difference between the detection status data and the reference status data reaches a preset condition. If so, it sends a reminder message that the position of the visual dual-lumen bronchial tube is abnormal.

[0019] Thirdly, embodiments of the present invention provide an electronic device, including a memory, a processor, and a computer program stored in the memory and executable on the processor, wherein the processor executes the program to implement the method described in the embodiments of the present invention.

[0020] Fourthly, embodiments of the present invention provide a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the method as described in the embodiments of the present invention.

[0021] Fifthly, embodiments of the present invention provide a computer program product, including a computer program, characterized in that, when the computer program is executed by a processor, it implements the method described in the embodiments of the present invention.

[0022] The intelligent monitoring method and system for visual dual-lumen bronchial catheter images provided in this invention, in response to a preset trigger condition, acquires a reference image of the relative positional relationship between the second inflatable cuff and the carina at the carina level within the patient's trachea using the visual dual-lumen bronchial catheter. By performing state data detection on the reference image, reference state data of the relative positional relationship between the second inflatable cuff and the carina within the trachea is obtained. Furthermore, during surgery, the system uses the visual dual-lumen bronchial catheter to acquire real-time detection images of the relative positional relationship between the second inflatable cuff and the carina at the carina level within the patient's trachea, and performs state data detection on these images to obtain detection state data of the relative positional relationship between the second inflatable cuff and the carina within the trachea. Finally, the system determines the relationship between the detection state data and the reference state data. If the difference meets the preset conditions, a reminder message for abnormal position of the visual double-lumen bronchial tube is sent. This enables automated identification and reminder of abnormal position of the visual double-lumen bronchial tube based on the status data in the reference image and the detection image during the operation. Doctors do not need to spend time paying attention to and judging the displacement of the visual double-lumen bronchial tube during the operation, which effectively ensures the doctor's focus during the operation. Moreover, the use of automated image recognition technology for difference judgment greatly improves the difficulty of judgment when the displacement of the visual double-lumen bronchial tube is small compared with human judgment. It can make accurate position difference judgment without relying on the doctor's image interpretation experience, which greatly improves the reliability and accuracy of intraoperative visual double-lumen bronchial tube displacement judgment.

[0023] Additional aspects and advantages of the invention will be set forth in part in the description which follows, and in part will be obvious from the description, or may be learned by practice of the invention. Attached Figure Description

[0024] Other features, objects, and advantages of the invention will become more apparent from the following detailed description of non-limiting embodiments with reference to the accompanying drawings: Figure 1a An image that visualizes problems that may occur during the placement of a double-lumen endotracheal tube using existing technology; Figure 1b This is another imaging technique that visualizes problems that may occur during the placement of a double-lumen endotracheal tube. Figure 2 The implementation environment architecture diagram of the intelligent monitoring method for visual dual-lumen bronchial tube images provided in the embodiments of the present invention is shown; Figure 3a This is a schematic diagram of the structure of a visual double-lumen bronchial tube provided in an embodiment of the present invention; Figure 3b Front view of the visual double-lumen bronchial tube provided in an embodiment of the present invention. Figure 3c for Figure 3b Sectional view along the middle II; Figure 3d This is a bottom view of a visual double-lumen bronchial tube provided in an embodiment of the present invention; Figure 3e for Figure 3d Sectional view along HH; Figure 3f This is a magnified view of the distal end of a visual double-lumen bronchial tube provided in an embodiment of the present invention; In the picture: 10-Double-lumen bronchial tube, 101-First inflatable cuff, 102-Second inflatable cuff, 103-First lumen, 104-Second lumen, 105-One-way valve, 106-Camera, 107-Suction hole, 108-Nozzle; Figure 4 A flowchart illustrating an embodiment of the intelligent monitoring method for visual dual-lumen bronchial tube images provided by the present invention is shown. Figure 5 A schematic diagram of an interactive display interface provided in an embodiment of the present invention is shown; Figure 6 This diagram illustrates a reminder terminal sending reminder information according to an embodiment of the present invention. Figure 7 A flowchart illustrating another embodiment of the present invention provides a method for intelligent monitoring of visual dual-lumen bronchial tube images. Figure 8 This diagram illustrates the structure of a visual dual-lumen bronchial tube imaging intelligent monitoring system according to an embodiment of the present invention. Figure 9 A schematic diagram of a computer system suitable for implementing embodiments of the present invention is shown. Detailed Implementation

[0025] The present invention will now be described in further detail with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the invention and not intended to limit it. Furthermore, it should be noted that, for ease of description, only the parts relevant to the invention are shown in the accompanying drawings.

[0026] It should be noted that, unless otherwise specified, the embodiments and features described in the present invention can be combined with each other. The present invention will now be described in detail with reference to the accompanying drawings and embodiments.

[0027] In related technologies, to facilitate the alignment of double-lumen bronchial tubes during placement, visual double-lumen bronchial tubes have been applied in clinical anesthesia. For example, CN202682499U discloses a visual double-lumen bronchial tube, which includes at least two lumens of different lengths relative to the tracheal carina. The lumens selectively communicate with the patient's main trachea or left / right main bronchi at at least two locations within the trachea for ventilation. The tube includes: a first lumen having a distal opening associated with a first inflatable cuff near the carina within the trachea; a second lumen having a distal opening extending through the carina and associated with a second inflatable cuff within one of the left and right main bronchial branches; and a dedicated image sensor lumen spanning the length of the first lumen and including an image sensor and an illumination source disposed distally near the first lumen, configured to provide images of the tracheal bifurcation point of the tracheal carina, the opening of the left bronchial branch, and the opening of the right bronchial branch. The image signals collected by the image sensor are transmitted to the display screen on the near side of the doctor via wired or wireless means, so that the doctor can observe the image at the front end of the image sensor in real time.

[0028] Furthermore, such as Figure 1a As shown, nearly half of the distal second inflatable cuff is positioned above the carina. At this point, the visual double-lumen bronchial tube is inserted too superficially, and there is viscous secretion between the second inflatable cuff and the bronchial wall on the side of the intubation at the carina level. If the traction during surgery increases, even a slight displacement of the visual double-lumen bronchial tube could cause the second inflatable cuff to slip out of the bronchus on that side, resulting in displacement of the visual double-lumen bronchial tube. This could lead to closure of the operated lung, preventing respiratory movement and affecting the surgical procedure. Furthermore, the opening of the main bronchus on the non-operated lung could be blocked or partially blocked by the second inflatable cuff, affecting normal ventilation of the healthy lung. In severe cases, blood oxygen saturation may not be maintained at normal levels. Figure 1b As shown in the image, the distal second inflatable cuff is barely visible. This indicates that the visual double-lumen endotracheal tube has been inserted too deeply or has been displaced due to surgical manipulation. This will directly affect airway pressure and normal artificial ventilation, and in severe cases, may lead to abnormal blood oxygen saturation and / or hemodynamics.

[0029] It should be understood that during surgery, complications such as... Figure 1a or Figure 1b The visual double-lumen endotracheal tube displacement shown in the image, if not promptly identified and addressed by the attending physician or anesthesiologist, could very likely lead to poor artificial ventilation or decreased blood oxygen saturation in the patient, and in severe cases, an accident that could endanger the patient's life.

[0030] Based on this, the present invention proposes a visual dual-lumen bronchial catheter image intelligent monitoring method and system, which automatically detects and identifies the catheter position through real-time acquired detection images, and sends an abnormality reminder when catheter displacement occurs to prompt doctors to deal with the catheter displacement in a timely manner, thereby avoiding medical accidents caused by catheter displacement.

[0031] For the specific implementation environment of the intelligent monitoring method for visual dual-lumen bronchial tube images proposed in this invention, please refer to [link / reference needed]. Figure 2 . Figure 2 The diagram illustrates the implementation environment architecture of the intelligent monitoring method for visual dual-lumen bronchial tube images provided in this embodiment of the invention.

[0032] like Figure 2 As shown, the implementation environment architecture includes: a visual dual-lumen bronchial tube 10, a server 20, and an alert terminal 30.

[0033] like Figures 3a-3f The diagram shows various views, cross-sectional views, and partial enlarged views of the visual dual-lumen bronchial catheter 10 of the present invention. The visual dual-lumen bronchial catheter 10 includes a first lumen 103, a second lumen 104, a first inflatable cuff 101, a second inflatable cuff 102, and a camera 106. The first lumen 103 has a first opening distal end near the tracheal carina and associated with the first inflatable cuff 101. The second lumen 104 has a second opening distal end extending through the carina and associated with the second inflatable cuff 102 within one of the left and right bronchial branches. It also includes an image sensor lumen spanning the length of the first lumen 103. The camera 106 is located distal to the first opening and is used to capture images of the front end of the first opening, transmitting the image signal to a display at the proximal end via a cable or wireless module.

[0034] More preferably, a one-way valve 105 that can communicate with the outside atmosphere is provided between the interface at the proximal end of the first lumen 103 and the ventilator (not shown in the figure). The one-way valve 105 is configured to allow airflow from the affected lung to be discharged to the atmosphere only, and not allow the atmosphere to enter the first lumen 103. Preferably, the one-way valve 105 is a thin film cavity or a latex cavity, and has a slit at the top of the cavity.

[0035] More preferably, at least one adsorption hole 108 is provided near the proximal end of the second inflatable cuff 102. Preferably, a plurality of adsorption holes 108 are evenly spaced along the outer periphery of the catheter. The adsorption holes 108 are connected to an adsorption device (not shown in the figure) at the proximal end through a dedicated adsorption lumen, for adsorbing sputum, blood and other adhering substances on the outer periphery of the catheter.

[0036] Further preferably, the front end of the camera 106 is provided with multiple nozzles 107. The nozzles 107 are connected to a near-end cleaning liquid source (not shown in the figure) through a dedicated cleaning tube. At least one nozzle 107 is designed to spray cleaning agent toward the lens of the camera 106. Further preferably, at least one nozzle 107 is designed to spray cleaning agent toward the far-end suction hole 108, so that the cleaning agent, along with sputum, blood, and other adhering substances, can be promptly and cleanly removed. As a result, the camera 106 can capture clear images from the far end, especially clear images of the second inflatable cuff 102 and its vicinity.

[0037] Server 20 is communicatively connected to camera 106 of visual dual-lumen bronchial tube 10 and alert terminal 30, respectively. Server 20 is used to receive images collected by image sensor of visual dual-lumen bronchial tube 10 and execute the intelligent monitoring method for visual dual-lumen bronchial tube images proposed in this embodiment of the invention, so as to control the alert terminal 30 to send an alert message indicating abnormal position of visual dual-lumen bronchial tube when the difference between the detection status data and the reference status data reaches a preset condition.

[0038] Server 20 can be a standalone physical server, a server cluster or distributed system composed of multiple physical servers, or a cloud server that provides basic cloud computing services such as cloud services, cloud databases, cloud computing, cloud functions, cloud storage, network services, cloud communication, middleware services, domain name services, security services, CDN, and big data and artificial intelligence platforms.

[0039] Server 20 is directly or indirectly connected to the visual dual-lumen bronchial tube 10 and the alert terminal 30 via wired or wireless communication. Optionally, the aforementioned wireless or wired network uses standard communication technologies and / or protocols. The network is typically the Internet, but can also be any network, including but not limited to any combination of Local Area Network (LAN), Metropolitan Area Network (MAN), Wide Area Network (WAN), mobile, wired or wireless networks, private networks, or virtual private networks.

[0040] The intelligent monitoring method for visual dual-lumen bronchial tube images proposed in this invention can be implemented by a visual dual-lumen bronchial tube image intelligent monitoring system, which can be installed on a terminal device or server.

[0041] To further illustrate the technical solutions provided by the embodiments of the present invention, a detailed description is provided below in conjunction with the accompanying drawings and specific implementation methods. Although the embodiments of the present invention provide method operation instruction steps as shown in the following embodiments or drawings, the method may include more or fewer operation instruction steps based on conventional or non-inventive methods. In steps where there is no logically necessary causal relationship, the execution order of these steps is not limited to the execution order provided by the embodiments of the present invention. In actual processing or when the device executes the method, it may be executed sequentially or in parallel according to the method shown in the embodiments or drawings.

[0042] It should be noted that the acquisition or use of data in this embodiment of the invention requires user consent. Data can only be obtained after user authorization, and the acquisition or use of data complies with relevant laws and regulations. Users include, but are not limited to, patients and doctors.

[0043] Please refer to Figure 4 , Figure 4 A flowchart illustrating an embodiment of the intelligent monitoring method for visual dual-lumen bronchial tube images provided by the present invention is shown. Figure 4 As shown, the method includes: Step 401: In response to a preset triggering condition, a reference image of the relative positional relationship between the second inflatable cuff and the carina at the level of the patient's trachea is obtained using a visual double-lumen bronchial catheter. The reference image includes the tracheal carina, at least a portion of the bronchial opening on the intubation side at the carina level, and a portion of the second inflatable cuff of the visual double-lumen bronchial catheter.

[0044] It should be noted that, as Figure 5 As shown, the intelligent monitoring system for visual dual-lumen bronchial tube imaging provides doctors with an interactive display interface for displaying visual dual-lumen bronchial tube images and doctor-inputted operational data. The doctor-input operational data includes, but is not limited to, image acquisition parameters for clearly displaying the patient's tracheal state data, such as color, brightness, and contrast, as well as an image selection trigger control. The image selection trigger control is used to respond to the doctor's selection operation, confirm the receipt of preset trigger conditions, and use the image corresponding to the selection operation as a reference image.

[0045] It should also be noted that, since the reference image is a standard image used for comparison with the detection image later, the position of the visual double-lumen bronchial tube in the reference image should be the correct position required for the surgery. Based on this, the reference image should include the tracheal carina, at least part of the bronchial opening on the carina level, and part of the second inflatable cuff of the visual double-lumen bronchial tube.

[0046] In some feasible embodiments, upon receiving a preset trigger condition, image recognition can be further performed on the image corresponding to the selection operation to determine whether the image includes the tracheal carina, at least a portion of the bronchial opening on the horizontal intubation side of the carina, and a portion of the second inflatable cuff of the visual double-lumen bronchial catheter. If so, the image corresponding to the selection operation is determined to be a reference image and is used as such. If not, the image corresponding to the selection operation does not meet the reference image condition, and the control reminder terminal sends a false trigger reminder to remind the doctor to re-perform the alignment operation so that the finally determined reference image meets the condition for being used as a reference image, thereby further improving the reliability of intelligent monitoring of visual double-lumen bronchial catheter images during surgery.

[0047] In some preferred embodiments, the doctor can trigger the image selection trigger control multiple times. Each time a preset trigger condition is received, the image corresponding to the current selection operation is used as a reference image to replace the image corresponding to the previous selection operation.

[0048] Step 402: Perform state data detection on the reference image to obtain reference state data on the relative positional relationship between the second inflatable cuff and the carina within the trachea; the reference state data includes at least one of the following: the first contact arc length between the second inflatable cuff and the bronchial wall on the side of the horizontal cannulation of the carina, and the first image area of ​​the second inflatable cuff in the reference image.

[0049] It should be noted that the state data is used to characterize the state of the visual double-lumen bronchial tube in the trachea, such as fixed position, moving position, and secretion obstruction. In this embodiment of the invention, the state data includes data characterizing the relative positional relationship between the visual double-lumen bronchial tube and the tracheal wall, specifically including the contact arc length between the second inflatable cuff and the bronchial wall on the carina-level insertion side, and the image area of ​​the second inflatable cuff in the reference image. The image area is the effective area of ​​the cuff in the image acquired by the visual double-lumen bronchial tube; specifically, it can be the horizontal surface area between the second inflatable cuff on the main tracheal wall side and the tracheal tube.

[0050] In some embodiments, before performing state data detection on the reference image, the reference image is preprocessed, including but not limited to grayscale conversion and Gaussian filtering, to reduce image noise in the reference image and improve the reliability of state data detection, thereby ensuring the accuracy and reliability of the judgment of abnormal position of the posterior visible bronchial tube.

[0051] Step 403: During the operation, a visual double-lumen endotracheal tube is used to acquire in real time a detection image of the relative positional relationship between the second inflatable cuff and the carina at the level of the carina within the patient's trachea. The detection image is then subjected to state data detection to obtain detection state data of the relative positional relationship between the second inflatable cuff and the carina within the trachea. The detection state data includes at least one of the following: the second contact arc length between the second inflatable cuff and the bronchial wall on the intubation side at the level of the carina, and the second image area of ​​the second inflatable cuff in the detection image. The detection state data corresponds one-to-one with the reference state data.

[0052] It should be noted that the detection status data corresponds one-to-one with the reference status data. That is, if the reference status data only includes the first contact arc length between the second inflatable cuff and the bronchial wall of the carina horizontal cannula, then the detection status data must at least include the second contact arc length between the second inflatable cuff and the bronchial wall of the carina horizontal cannula. If the reference status data only includes the first image area of ​​the second inflatable cuff in the reference image, then the detection status data must at least include the second image area of ​​the second inflatable cuff in the detection image. If the reference status data includes both the first contact arc length between the second inflatable cuff and the bronchial wall of the carina horizontal cannula and the first image area of ​​the second inflatable cuff in the reference image, then the detection status data must include both the second contact arc length between the second inflatable cuff and the bronchial wall of the carina horizontal cannula and the second image area of ​​the second inflatable cuff in the detection image.

[0053] In some embodiments, before performing state data detection on the detection image, the detection image is also preprocessed, including but not limited to grayscale conversion and Gaussian filtering, to reduce image noise in the detection image and improve the reliability of state data detection, thereby ensuring the accuracy and reliability of the judgment of abnormal position of the posterior visible bronchial tube.

[0054] Step 404: Determine whether the difference between the detection status data and the parameter status data meets the preset conditions. If so, send a reminder message that the position of the visual dual-lumen bronchial tube is abnormal.

[0055] It should be noted that the preset condition is a difference threshold used to identify the positional differences of the visual double-lumen bronchial catheter. The preset condition can be set according to the type of status data. For example, when the status data is the contact arc length between the second inflatable cuff and the bronchial wall on the carina horizontal insertion side, the preset condition can be a length threshold for the difference in contact arc length. That is, if the difference between the first contact arc length and the second contact arc length is greater than or equal to the length threshold, it is determined that the difference between the detected status data and the reference status data has reached the preset condition. When the status data is the image area of ​​the second inflatable cuff in the image, the preset condition can be the change in image area. That is, if the change in area between the first image area and the second image area is greater than or equal to the area change threshold, it is determined that the difference between the detected status data and the reference status data has reached the preset condition.

[0056] In some feasible embodiments, two types of state data can be judged simultaneously. If the difference between the detected state data and the reference state data reaches any preset condition, it is determined that the difference between the detected state data and the reference state data has reached the preset condition. Alternatively, the difference between the detected state data and the reference state data can be determined when both types of state data reach the preset condition simultaneously. This invention does not impose any specific limitations.

[0057] In some embodiments, the length threshold can be 10%-20% of the contact arc length, and the area change threshold can be 10%-20%. The specific values ​​can be set according to the actual situation, and the present invention does not impose any specific limitations.

[0058] Furthermore, in a feasible embodiment, sending a reminder message about an abnormal position of the visual double-lumen bronchial tube includes: when sending the reminder message about an abnormal position of the visual double-lumen bronchial tube, controlling the reminder terminal to send at least one of a preset reminder icon and a prompt text, and controlling the reminder terminal to emit an alarm prompt sound at a preset frequency.

[0059] In some preferred embodiments, during the surgery, the control and reminder terminal displays a reference image in a first preset area and a detection image in a second preset area. The first and second preset areas are located on the same axis, allowing for split-screen display to facilitate a more intuitive understanding of the status information of the second inflatable cuff by the doctor, thereby improving decision-making efficiency. For example, it can be as follows... Figure 6 As shown, the first preset area and the second preset area are set on the same horizontal axis.

[0060] In other words, such as Figure 6As shown, during the operation, the visual dual-lumen bronchial tube imaging intelligent monitoring system provides doctors with a comparison interface for simultaneously observing reference images and detection images. When the difference between the detection status data and the reference status data reaches a preset condition, the system sends a reminder message to the doctor indicating an abnormal position of the visual dual-lumen bronchial tube by displaying at least one of the reminder icon and prompt text in the comparison interface.

[0061] In some preferred embodiments, the reminder terminal is a display device including a speaker. When the difference between the detected state data and the reference state data reaches a preset condition, the speaker of the reminder terminal is further controlled to emit an alarm prompt tone at a preset frequency to send audio reminder information to the doctor, so as to avoid the problem of untimely information acquisition caused by the doctor being unable to observe the reminder terminal in time while focusing on the lesion site.

[0062] Therefore, the intelligent monitoring method for visual dual-lumen bronchial catheter images provided in this embodiment of the invention, in response to a preset trigger condition, uses the visual dual-lumen bronchial catheter to acquire a reference image of the relative positional relationship between the second inflatable cuff and the carina at the level of the carina within the patient's trachea. By performing state data detection on the reference image, reference state data of the relative positional relationship between the second inflatable cuff and the carina within the trachea is obtained. Furthermore, during surgery, the visual dual-lumen bronchial catheter is used to acquire in real-time detection images of the relative positional relationship between the second inflatable cuff and the carina at the level of the carina within the patient's trachea, and state data detection is performed on these detection images to obtain detection state data of the relative positional relationship between the second inflatable cuff and the carina within the trachea. The detection state data and the reference state data are then compared. If the difference meets the preset conditions, a reminder message for abnormal position of the visual double-lumen bronchial tube is sent. This enables automated identification and reminder of abnormal position of the visual double-lumen bronchial tube based on the status data in the reference image and the detection image during the operation. Doctors do not need to spend time paying attention to and judging the displacement of the visual double-lumen bronchial tube during the operation, which effectively ensures the doctor's focus during the operation. Moreover, the use of automated image recognition technology for difference judgment greatly improves the difficulty of judgment when the displacement of the visual double-lumen bronchial tube is small compared with human judgment. It can make accurate position difference judgment without relying on the doctor's image interpretation experience, which greatly improves the reliability and accuracy of intraoperative visual double-lumen bronchial tube displacement judgment.

[0063] Meanwhile, this invention uses the contact arc length between the second inflatable cuff and the bronchial wall on the carina level and the second image area of ​​the second inflatable cuff in the detection image as state data. This effectively transforms the position judgment of the visual double-lumen bronchial tube in the narrow space of the trachea, which lacks reference information, into a relatively simple image data judgment. It fully considers the balance between the morphological changes of the visual double-lumen bronchial tube at different positions in the trachea and the data that can be collected from images with small information content. This effectively solves the problem that it is not easy to directly collect and analyze the insertion depth analysis of the visual double-lumen bronchial tube from the image, as well as the problem that the airway conditions of different patients are inconsistent and cannot be fully predicted.

[0064] In addition, in this embodiment of the invention, a reference image of the same patient is used as a reference standard for abnormal judgment, which realizes personalized judgment for different patients, effectively avoiding a large number of misjudgments caused by fixed parameter judgment, thereby effectively improving the adaptability and accuracy of visual double-lumen bronchial tube displacement judgment.

[0065] In a feasible embodiment, when the reference state data is the first contact arc length and the detected state data is the second contact arc length, the state data detection includes: extracting the edges of the second inflatable cuff and the bronchial wall on the carina horizontal cannula side for the reference image and the detected image respectively, to obtain the cuff edge point set and the bronchial wall edge point set; determining the contact point set between the second inflatable cuff and the bronchial wall on the carina horizontal cannula side based on the intersection of the cuff edge point set and the bronchial wall edge point set; obtaining the pixel coordinates of at least two contact points in the contact point set; and determining the first contact arc length and the second contact arc length based on the pixel coordinates of the at least two contact points.

[0066] It should be noted that edge extraction of the second inflatable cuff and the bronchial wall of the carina horizontal intubation can be achieved using existing image processing algorithms, such as the Canny edge detection algorithm, and this invention does not specifically limit this.

[0067] In other words, the Canny edge detection algorithm can be used to extract edges from the second inflatable cuff and the bronchial wall on the carina-horizontal intubation side in the reference image and the detection image, respectively, to obtain the reference cuff edge point set and the reference bronchial wall edge point set corresponding to the reference image, and the detection cuff edge point set and the detection bronchial wall edge point set corresponding to the detection image. It should be understood that the cuff edge point set is the coordinate set of the identified edge points of the second inflatable cuff, and the bronchial wall edge point set is the coordinate set of the identified edge points of the bronchial wall on the carina-horizontal intubation side. That is, the reference cuff edge point set is the coordinate set of the edge points of the second inflatable cuff in the reference image, the detection cuff edge point set is the coordinate set of the edge points of the second inflatable cuff in the detection image, the reference bronchial wall edge point set is the coordinate set of the edge points of the bronchial wall on the carina-horizontal intubation side in the reference image, and the detection bronchial wall edge point set is the coordinate set of the edge points of the bronchial wall on the carina-horizontal intubation side in the detection image.

[0068] Furthermore, for the reference image, after acquiring the reference cuff edge point set and the reference bronchial wall edge point set, the reference contact point set between the second inflatable cuff and the bronchial wall on the carina horizontal insertion side is determined based on the intersection of the reference cuff edge point set and the reference bronchial wall edge point set. Then, the pixel coordinates of at least two reference contact points in the reference contact point set are acquired, and the first contact arc length is determined based on the pixel coordinates of the at least two reference contact points. Correspondingly, for the detection image, after acquiring the detection cuff edge point set and the detection bronchial wall edge point set, the detection contact point set between the second inflatable cuff and the bronchial wall on the carina horizontal insertion side is determined based on the intersection of the detection cuff edge point set and the detection bronchial wall edge point set. Then, the pixel coordinates of at least two detection contact points in the detection contact point set are acquired, and the second contact arc length is determined based on the pixel coordinates of the at least two detection contact points.

[0069] In a preferred embodiment, since the edge extraction of the second inflatable cuff and the bronchial wall on the carina horizontal cannulation side is performed using the Canny edge detection algorithm, the reference cuff edge point set and the reference bronchial wall edge point set, as well as the detection cuff edge point set and the detection bronchial wall edge point set, may not be completely identical. That is, the pixel coordinates of the edge points in the cuff edge point set and the bronchial wall edge point set are not completely identical. Therefore, in this embodiment of the invention, linear fitting can be performed first on the cuff edge point set and the bronchial wall edge point set to obtain the cuff edge curve and the bronchial wall edge curve. Then, the point set within at least two intersection points of the cuff edge curve and the bronchial wall edge curve is taken as the contact point set. Alternatively, the contact curve can be determined based on the cuff edge curve and the bronchial wall edge curve, and then the contact point set can be determined based on the contact curve.

[0070] For example, taking a reference image as an example, linear fitting can be performed on the reference cuff edge point set and the reference bronchial wall edge point set respectively to obtain the reference cuff edge curve and the reference bronchial wall edge curve. Then, the reference contact curve is obtained by fitting the reference cuff edge curve and the reference bronchial wall edge curve, and the set of at least two pixels in the reference contact curve is taken as the reference contact point set.

[0071] In a preferred embodiment, the contact arc length is determined based on the pixel coordinates of at least two contact points using the following formula:

[0072] in, This is the contact arc length between the second inflatable cuff and the bronchial wall on the side of the carina horizontal intubation. The pixel coordinates of the contact point. , This represents the number of contact points in the contact point cluster.

[0073] Therefore, this embodiment of the invention performs edge extraction on the reference image and the detection image respectively, and then calculates the contact arc length. It can achieve accurate and reliable contact arc length calculation without manual intervention, providing an accurate data basis for subsequent arc length difference judgment and improving the accuracy and reliability of anomaly judgment.

[0074] In a feasible embodiment, when the reference state data is the area of ​​the first image and the detection state data is the area of ​​the second image, the state data detection includes: extracting the edges of the second inflatable bladder for the reference image and the detection image respectively to obtain a set of bladder edge points, and determining the area of ​​the first image and the area of ​​the second image based on the set of bladder edge points.

[0075] Optionally, in the embodiments of the present invention, the Canny edge detection algorithm can be used to determine the cuff edge point set, or the cuff edge point set determined during the aforementioned contact arc length calculation can be directly reused, thereby effectively reducing the computational load of image data processing and improving image processing efficiency.

[0076] Furthermore, the image area is determined based on the set of points on the edge of the capsule using the following formula:

[0077] in, The area of ​​the second inflatable cuff in the image. These are the pixel coordinates of the points on the edge of the capsule. , This represents the number of cuff edge points in the cuff edge point set.

[0078] It should be understood that, such as Figure 7As shown, in this embodiment of the invention, after acquiring a reference image in response to a preset trigger condition, the first contact arc length and the first image area corresponding to the reference image are directly acquired. Then, the first contact arc length and the first image area are stored. After acquiring a detection image, it is only necessary to perform image recognition on the detection image to obtain the second contact arc length and the second image area. Then, the difference between the first contact arc length and the second contact arc length, as well as the first image area and the second image area, are judged respectively to determine whether the difference between the detection state data and the reference state data reaches the preset condition. If not, the detection image is acquired and image recognition is performed to obtain the second contact arc length and the second image area until the surgery is completed or the difference between the detection state data and the reference state data reaches the preset condition.

[0079] Therefore, this invention enables accurate and reliable image area calculation without manual intervention, providing an accurate data foundation for subsequent image area difference judgment and improving the accuracy and reliability of anomaly detection. Simultaneously, reusing the set of edge points calculated from the arc length effectively reduces the amount of data in image processing, ensuring the timeliness of the judgment results and achieving high-speed, accurate judgment and analysis.

[0080] In one feasible embodiment, the bronchi contract and expand with the patient's breathing. For some patients, such as those with bronchiectasis, the degree of bronchial contraction and expansion is greater than that of normal patients in order to ensure effective breathing volume. Therefore, in order to further avoid misjudgment caused by the patient's normal breathing, the present invention further proposes a method for correcting the status data according to the patient's respiratory cycle.

[0081] Specifically, the patient's respiratory signal is acquired, and a reference time for the reference image in the respiratory cycle is determined in response to a preset trigger condition. The reference time is used as the target acquisition time for the detection image. During the operation, for each respiratory cycle of the patient, the target acquisition time is identified, and the visual double-lumen bronchial tube is controlled to acquire detection images at the target acquisition time.

[0082] It should be noted that the reference time is the time position of the time point when the reference image is acquired within the respiratory cycle, such as the start position, end position, or middle position of the respiratory cycle. This invention does not impose a specific limitation, but determines the specific time based on the relationship between the time of acquiring the preset trigger condition and the periodicity of the respiratory signal.

[0083] In other words, when acquiring reference images, the reference time for acquiring the reference images within the respiratory cycle is determined. Then, during the operation, the target acquisition time of the respiratory cycle is identified, and the visual double-lumen bronchial catheter is controlled to acquire detection images at the target acquisition time. This ensures that the acquisition of detection images is performed in the same respiratory state as the reference images, so that the detection images and reference images are at the same moment in the patient's respiratory cycle, i.e., the bronchial dilation or constriction is basically consistent. Based on this, the positional difference of the visual double-lumen bronchial catheter can be judged by using the reference images and detection images acquired in the same respiratory state. This can effectively avoid data deviations caused by excessive bronchial dilation or constriction ranges in the patient, thereby effectively improving the accuracy and reliability of the positional difference judgment of the visual double-lumen bronchial catheter.

[0084] In one specific embodiment, in order to further avoid the discrepancy between the actual acquisition time of the detection image and the target acquisition time due to signal transmission delay, the present invention further proposes to compensate the second contact arc length and the second image area according to the actual acquisition time of the detection image, so as to further reduce the numerical deviation of the second contact arc length and the second image area caused by the time deviation of the sampling process.

[0085] Specifically, the actual acquisition time of the detection image during the respiratory cycle is obtained. Based on the actual acquisition time and the target acquisition time, the compensation factor corresponding to the detection image is determined. Based on the compensation factor, the second contact arc length and the second image area after respiratory compensation are calculated.

[0086] Furthermore, the second contact arc length based on breathing compensation is calculated using the following formula:

[0087] in, This is the second contact arc length after respiratory compensation. The second contact arc length is calculated directly from the detected image. This refers to the actual data collection time. For the target acquisition time, is the time decay constant.

[0088] in, This is a compensation factor.

[0089] It should be noted that although the operation of the method of the present invention is described in a specific order in the accompanying drawings, this does not require or imply that the operations must be performed in that specific order, or that all the operations shown must be performed in order to achieve the desired result.

[0090] Figure 8 A schematic diagram of the structure of a visual dual-lumen bronchial tube imaging intelligent monitoring system provided in an embodiment of the present invention is shown.

[0091] like Figure 8 As shown, the intelligent monitoring system 80 for visual dual-lumen bronchial tube imaging includes: The response module 801 is used to respond to a preset triggering condition and use a visual double-lumen bronchial catheter to acquire a reference image of the relative positional relationship between the second inflatable cuff and the carina at the level of the patient's trachea. The reference image includes the tracheal carina, at least a portion of the bronchial opening on the intubation side at the carina level, and a portion of the second inflatable cuff of the visual double-lumen bronchial catheter. The first detection module 802 is used to perform state data detection on the reference image to obtain reference state data on the relative positional relationship between the second inflatable cuff and the carina in the trachea; the reference state data includes at least one of the following: the first contact arc length between the second inflatable cuff and the bronchial wall on the horizontal intubation side of the carina; and the first image area of ​​the second inflatable cuff in the reference image. The second detection module 803 is used during surgery to acquire, in real time, a detection image of the relative positional relationship between the second inflatable cuff and the carina at the carina level within the patient's trachea using the visual double-lumen bronchial catheter, and to perform state data detection on the detection image to obtain detection state data of the relative positional relationship between the second inflatable cuff and the carina within the trachea; the detection state data includes at least one of the second contact arc length between the second inflatable cuff and the bronchial wall on the intubation side at the carina level, and the second image area of ​​the second inflatable cuff in the detection image; the detection state data corresponds one-to-one with the reference state data; The judgment module 804 is used to determine whether the difference between the detection status data and the reference status data reaches a preset condition. If so, it sends a reminder message that the position of the visual dual-lumen bronchial tube is abnormal.

[0092] It should be understood that the modules or modules described in the Visual Dual-Lumen Bronchial Catheter Imaging Intelligent Monitoring System 80 are similar to those in the reference. Figure 4 The steps in the described method correspond accordingly. Therefore, the operations and features described above for the method are also applicable to the intelligent monitoring system 80 for visual dual-lumen bronchial tube images and its included modules, and will not be repeated here. The intelligent monitoring system 80 for visual dual-lumen bronchial tube images can be pre-implanted in the browser or other secure applications of an electronic device, or it can be loaded into the browser or its secure applications of an electronic device through download or other means. The corresponding modules in the intelligent monitoring system 80 for visual dual-lumen bronchial tube images can cooperate with the modules in the electronic device to implement the solutions of the embodiments of the present invention.

[0093] The division of modules or units mentioned in the detailed description above is not mandatory. In fact, according to the embodiments of this disclosure, the features and functions of two or more modules or units described above can be embodied in one module or unit. Conversely, the features and functions of one module or unit described above can be further divided and embodied by multiple modules or units.

[0094] The following is for reference. Figure 9 , Figure 9 A schematic diagram of a computer system suitable for implementing embodiments of the present invention is shown. like Figure 9 As shown, the computer system 900 includes a central processing unit (CPU) 901, which can perform various appropriate actions and processes based on programs stored in read-only memory (ROM) 902 or programs loaded from storage section 908 into random access memory (RAM) 903. RAM 903 also stores various programs and data required for the system's operating instructions. CPU 901, ROM 902, and RAM 903 are interconnected via bus 904. Input / output (I / O) interface 905 is also connected to bus 904.

[0095] The following components are connected to I / O interface 905: an input section 906 including a keyboard, mouse, etc.; an output section 907 including a cathode ray tube (CRT), liquid crystal display (LCD), etc., and speakers, etc.; a storage section 908 including a hard disk, etc.; and a communication section 909 including a network interface card such as a LAN card, modem, etc. The communication section 909 performs communication processing via a network such as the Internet. A drive 910 is also connected to I / O interface 905 as needed. A removable medium 911, such as a disk, optical disk, magneto-optical disk, semiconductor memory, etc., is installed on drive 910 as needed so that computer programs read from it can be installed into storage section 908 as needed.

[0096] In particular, according to embodiments of the present invention, the above-described flowchart is referenced. Figure 2 The described process can be implemented as a computer software program. For example, embodiments of the present invention include a computer program product comprising a computer program carried on a computer-readable medium, the computer program containing program code for performing the methods shown in the flowchart. In such an embodiment, the computer program contains program code for performing the methods shown in the flowchart. In such an embodiment, the computer program can be downloaded and installed from a network via communication section 909, and / or installed from removable medium 911. When the computer program is executed by central processing unit (CPU) 901, it performs the functions defined in the system of the present invention.

[0097] It should be noted that the computer-readable medium shown in this invention can be a computer-readable signal medium or a computer-readable storage medium, or any combination thereof. A computer-readable storage medium can be, for example,—but not limited to—an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, apparatus, or device, or any combination thereof. More specific examples of a computer-readable storage medium may include, but are not limited to: an electrical connection having one or more wires, a portable computer disk, a hard disk, random access memory (RAM), read-only memory (ROM), erasable programmable read-only memory (EPROM or flash memory), optical fiber, portable compact disk read-only memory (CD-ROM), optical storage device, magnetic storage device, or any suitable combination thereof. In this invention, a computer-readable storage medium can be any tangible medium containing or storing a program that can be used by or in conjunction with an instruction execution system, apparatus, or device. In this invention, a computer-readable signal medium can include a data signal propagated in baseband or as part of a carrier wave, carrying computer-readable program code. Such propagated data signals can take various forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination thereof. Computer-readable signal media can also be any computer-readable medium other than computer-readable storage media, which can send, propagate, or transmit a program for use by or in connection with an instruction execution system, apparatus, or device. The program code contained on the computer-readable medium can be transmitted using any suitable medium, including but not limited to: wireless, wire, optical fiber, RF, etc., or any suitable combination thereof.

[0098] The flowcharts and block diagrams in the accompanying drawings illustrate the architecture, functionality, and operational instructions of possible implementations of systems, methods, and computer program products according to various embodiments of the present invention. In this regard, each block in a flowchart or block diagram may represent a module, segment, or portion of code containing one or more executable instructions for implementing a specified logical function. It should also be noted that in some alternative implementations, the functions indicated in the blocks may occur in a different order than those indicated in the drawings. For example, two connected blocks may actually be executed substantially in parallel, or they may sometimes be executed in reverse order, depending on the functions involved. It should also be noted that each block in a block diagram and / or flowchart, and combinations of blocks in block diagrams and / or flowcharts, can be implemented using a dedicated hardware-based system that performs the specified function or operational instructions, or using a combination of dedicated hardware and computer instructions.

[0099] In another aspect, the present invention also provides a computer-readable storage medium, which may be included in the electronic device described in the above embodiments, or may exist independently and not assembled into the electronic device. The computer-readable storage medium stores one or more programs that, when used by one or more processors, execute the intelligent monitoring method for visual dual-lumen bronchial tube images described in the present invention.

[0100] The above description is merely a preferred embodiment of the present invention and an explanation of the technical principles employed. Those skilled in the art should understand that the scope of disclosure in this invention is not limited to technical solutions formed by specific combinations of the above-described technical features, but should also cover other technical solutions formed by arbitrary combinations of the above-described technical features or their equivalents without departing from the foregoing disclosed concept. For example, technical solutions formed by substituting the above features with (but not limited to) technical features with similar functions disclosed in this invention.

Claims

1. A visual dual-lumen bronchial tube imaging intelligent monitoring system, characterized in that, include: A response module is used to respond to a preset triggering condition and use a visual double-lumen bronchial catheter to acquire a reference image of the relative positional relationship between the second inflatable cuff and the carina at the level of the patient's trachea. The reference image includes the tracheal carina, at least a portion of the bronchial opening on the intubation side at the carina level, and a portion of the second inflatable cuff of the visual double-lumen bronchial catheter. The first detection module is used to perform state data detection on the reference image to obtain reference state data on the relative positional relationship between the second inflatable cuff and the carina in the trachea; the reference state data includes at least one of the following: the first contact arc length between the second inflatable cuff and the bronchial wall on the horizontal intubation side of the carina; and the first image area of ​​the second inflatable cuff in the reference image. The second detection module is used during surgery to acquire, in real time, a detection image of the relative positional relationship between the second inflatable cuff and the carina at the carina level within the patient's trachea using the visual double-lumen bronchial catheter, and to perform state data detection on the detection image to obtain detection state data of the relative positional relationship between the second inflatable cuff and the carina within the trachea; the detection state data includes at least one of the second contact arc length between the second inflatable cuff and the bronchial wall on the intubation side at the carina level, and the second image area of ​​the second inflatable cuff in the detection image; the detection state data corresponds one-to-one with the reference state data; The judgment module is used to determine whether the difference between the detection status data and the reference status data reaches a preset condition. If so, it sends a reminder message that the position of the visual dual-lumen bronchial tube is abnormal. In addition, the patient's respiratory cycle signal is acquired, and in response to the preset triggering condition, the reference time of the reference image in the respiratory cycle is determined, and the reference time is used as the target acquisition time for the detection image acquisition. During the procedure, for each respiratory cycle of the patient, the target acquisition time is identified, and the visual double-lumen endotracheal tube is controlled to acquire the detection image at the target acquisition time. Obtain the actual acquisition time of the detected image during the respiratory cycle; The compensation factor corresponding to the detected image is determined based on the actual acquisition time and the target acquisition time. Based on the compensation factor, calculate the second contact arc length and the second image area after breathing compensation; The calculation based on the second contact arc length after breathing compensation is achieved using the following formula: in, This is the second contact arc length after respiratory compensation. The second contact arc length is calculated directly from the detected image. This refers to the actual data collection time. For the target acquisition time, is the time decay constant.

2. The intelligent monitoring system for visual dual-lumen bronchial tube imaging according to claim 1, characterized in that, When the reference state data is the first contact arc length and the detection state data is the second contact arc length, the first detection module is specifically used for: For the reference image and the detection image respectively, the edges of the second inflatable cuff and the bronchus on the side of the carina horizontal cannulation are extracted to obtain the cuff edge point set and the bronchus wall edge point set on the side of the carina horizontal cannulation. The set of contact points between the second inflatable cuff and the bronchial wall edge point set is determined based on the intersection of the cuff edge point set and the bronchial wall edge point set. Obtain the pixel coordinates of at least two contact points in the set of contact points, and determine the first contact arc length and the second contact arc length based on the pixel coordinates of the at least two contact points.

3. The intelligent monitoring system for visual dual-lumen bronchial tube imaging according to claim 2, characterized in that, The contact arc length is determined based on the pixel coordinates of the at least two contact points using the following formula: in, The contact arc length between the second inflatable cuff and the bronchial wall on the side of the carina horizontal intubation cannula is given. The pixel coordinates of the contact point. , This represents the number of contact points in the contact point cluster.

4. The intelligent monitoring system for visual dual-lumen bronchial tube imaging according to claim 1, characterized in that, When the reference state data is the first image area and the detection state data is the second image area, the first detection module is specifically used for: For the reference image and the detection image respectively, the edge of the second inflatable bladder is extracted to obtain the bladder edge point set; The area of ​​the first image and the area of ​​the second image are determined based on the set of edge points of the sheath.

5. The intelligent monitoring system for visual dual-lumen bronchial tube imaging according to claim 4, characterized in that, The following formula is used to determine the image area based on the set of edge points of the capsule: in, The area of ​​the second inflatable bladder in the image. These are the pixel coordinates of the points on the edge of the capsule. , This represents the number of cuff edge points in the cuff edge point set.

6. The intelligent monitoring system for visual dual-lumen bronchial tube images according to claim 1, characterized in that, The judgment module is also used for: The control and reminder terminal displays the reference image in a first preset area and the detection image in a second preset area, wherein the first preset area and the second preset area are located on the same axis. When sending a reminder message about an abnormal position of the visual double-lumen bronchial tube, the system controls the reminder terminal to send at least one of a preset reminder icon and a prompt text, and controls the reminder terminal to emit an alarm prompt sound at a preset frequency.

Images