Navigation and Control, Assemblies, and Systems for Airway Management Procedures
Patent Information
- Application Number
- JP2024520985
- Authority / Receiving Office
- JP · JP
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2021-10-18
- Filing Date
- 2022-10-07
- Publication Date
- 2024-11-06
Smart Images

Figure 2024540847000001_ABST
Abstract
Description
[Technical field]
[0001] Incorporation by Reference
[0001] This application claims priority to U.S. Provisional Application No. 63 / 253,884, filed October 8, 2021, and U.S. Provisional Application No. 63 / 256,975, filed October 18, 2021, which applications are incorporated by reference in their entireties and for all purposes.
[0002]
[0002] The following applications are hereby incorporated by reference in their entirety and for all purposes: Application No. 63 / 026,963, filed May 19, 2020, Application No. 63 / 150,558, filed February 17, 2021, Application No. 63 / 159,348, filed March 10, 2021, and PCT / US21 / 33015, filed May 18, 2021.
[0003]
[0003] All publications and patent applications mentioned in this specification are herein incorporated by reference to the same extent as if each individual publication or patent application was specifically and individually indicated to be incorporated by reference. [Background technology]
[0004]
[0004] Airway management includes a variety of procedures aimed at treating, supervising, caring for, applying procedures to, manipulating, controlling, establishing, and securing a patient's upper and / or lower airways, and may be performed in a variety of medical settings and locations and with different patient populations. Airway management procedures may include navigating a medical device within a patient, and optionally visualizing the navigation. Some airway management procedures may include establishing an artificial airway within the patient's body. By way of example only, tracheal intubation ("TI") is an airway management procedure that includes the placement of an intubation tube (in this example, an endotracheal tube, "ETT") into a patient's trachea to ventilate the patient's lungs, ensure proper oxygenation and gas exchange, and to help protect the patient's airway from aspiration of material such as gastric contents, blood, secretions, and / or surgical debris. TI may be performed, for example, in the operating room (OR) when a patient is under anesthesia for elective or emergency surgery, or in a wide range of non-OR urgent and / or emergency airway situations, such as in intensive care units (ICUs), emergency departments, out-of-OR procedure and code situations, and out-of-hospital settings (e.g., paramedics, EMS, and other forms of patient transfer, etc.). TI is the most important technique for management of high-risk or difficult cases and is a common rescue technique when other forms of airway management fail.Failure to perform TI on the first or all attempts typically results in significant harm to the patient, such as a hypoxia-related adverse event or complication (e.g., cardiac arrest, brain injury, death) or airway trauma, or may require a more invasive procedure, such as emergency front of neck access (eFONA), to establish an airway. Moreover, even in non-emergency or non-urgent airway management procedures, failure to establish, secure, or control an airway or safely navigate to a desired airway location on the first TI attempt can complicate the procedure and result in harm to the patient.
[0005]
[0005] Difficult or failed TI is usually caused by an operator experiencing difficulty with visualization of the patient's airway anatomy, with navigation of the ETT to the larynx (e.g., glottic opening and vocal cord), and with manual placement of the ETT through and past the vocal cords into the patient's trachea. Each of these critical TI steps (visualization, navigation, placement) can individually or in combination result in difficult / failed TI.
[0006]
[0006] The most commonly used conventional techniques for TI include direct laryngoscopy, video laryngoscopy, and the use of flexible intubation scopes, but their performance remains suboptimal. For example, direct laryngoscopy involves the use of a metal blade to directly visualize the patient's airway and retract the patient's tongue to manually navigate and pass the ETT into the patient's trachea. Direct laryngoscopy is limited by drawbacks such as the need to align the airway axis for better visualization of the patient's larynx and vocal cords, a narrow field of view that is easily obscured by blood or secretions, and challenges in controlling the patient's tongue, making it difficult to visualize, navigate, and pass the ETT up to and through the vocal cords. Direct laryngoscopy also does not allow visual confirmation of proper ETT placement in the trachea, which may lead to unrecognized ETT misplacement (e.g., esophageal intubation) and resulting life-threatening hypoxia.
[0007]
[0007] Video laryngoscopy utilizes a fixed video camera placed inside the patient's upper airway (above the vocal cords) to provide magnified visualization of the anatomy. However, video laryngoscopy does not address all the difficulties in successfully performing TI, as ETT navigation and placement difficulties persist. Navigation of the ETT up to and through the glottic opening is compromised by indirect visualization of the patient's upper airway anatomy on the video monitor and ETT manipulation at an acute angle to the vocal cords. A metal stylet must frequently be placed inside the ETT to facilitate ETT navigation and placement, which causes stylet-induced airway trauma in at least 1.1% of cases. Although visualization of the ETT past the vocal cords is greatly enhanced by video laryngoscopy, ETT misplacement (e.g., esophageal intubation) and resulting life-threatening hypoxia may still occur. Furthermore, video laryngoscopy does not allow for ETT navigation and troubleshooting of placement below the vocal cords (lower airway) where ETT advancement is performed blindly. Furthermore, video laryngoscopy does not allow for immediate confirmation of ETT placement in the trachea. Furthermore, video laryngoscopy still does not allow the user to properly position the ETT inside the patient's trachea to avoid both too deep and too high ETT placement.
[0008] Flexible intubation scopes (FIS), utilizing a steerable video endoscopy camera, may be helpful for patients with severely compromised airways, but are still handicapped by a narrow field of view and the need for complex manual dexterity that requires a high degree of training and expertise. Visualization of the airway anatomy is greatly weakened, providing only a close-up view, with loss of orientation landmarks. Furthermore, such visualization is easily obscured or lost in the presence of even minimal amounts of blood and / or secretions. With FIS, the operator must be highly skilled in maneuvering the device around soft airway tissue obstructions, especially in unconscious patients, when TI must be performed rapidly. Another significant FIS limitation includes the inability to observe and troubleshoot ETT progression from above the vocal cords into the patient's trachea.
[0008]
[0009] Airway management medical procedures (e.g., TI) utilizing existing techniques and devices result in suboptimal success rates and outcomes, such as first-pass success rates. For example, first-pass TI failure rates in difficult airway situations can range between 8% and 54% for conventional techniques depending on the device used, TI location, patient population, and provider expertise. Furthermore, significantly higher first-pass TI failure rates are observed in pediatric patients with difficult airways as well as in some other patient categories, such as obese patients, patients with head and neck cancer, patients with cervical spine (C-spine) problems, etc. Failure to achieve TI on the first attempt causes an increased incidence of major complications, such as major airway trauma, airway swelling, lack of oxygen (hypoxia), cardiac arrest, and brain injury.
[0009]
[0010] There is a need for airway management methods, systems, and devices that can more reliably and consistently provide better outcomes, such as providing higher first pass success rates and / or being able to more reliably navigate medical devices. For example, there is a need for new and improved devices and methods for assisting intubation and improving TI success rates.
[0010]
[0011] Additionally, it may be beneficial to provide a multi-function airway management platform that can be used in a variety of airway management procedures, clinical situations, locations, and environments, and in a variety of patient populations. Summary of the Invention [Means for solving the problem]
[0011]
[0012] One aspect of the present disclosure is a visualization system, optionally an intubation visualization system.
[0012]
[0013] In this aspect, the system may optionally be a dual video intubation system.
[0013]
[0014] In this aspect, the system may optionally include a first imaging member including a first video camera in a distal region of the first imaging member, and a second imaging member including an actuatable elongate introducer sized for disposition in an endotracheal tube and a second video camera disposed in a distal region of the elongate introducer. The system may optionally further include a computer-executable method adapted to receive as input first information indicative of a signal from the first video camera and second information indicative of a signal from the second video camera, and to cause one of the first information or the second information to have a greater influence on actuation of the elongate introducer during at least a period of time.
[0014]
[0015] In this aspect, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer may include assigning a confidence score to the first information and the second information.
[0015]
[0016] In this embodiment, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer may include using only one of the first information and the second information in the operation of the elongate introducer.
[0016]
[0017] In this embodiment, causing one of the first and second information to have a greater influence on operation of the elongate introducer may include reducing a relative confidence in one of the first and second information based on a quality of at least one of the first and second information, wherein the quality in this embodiment may relate to clarity of the image data.
[0017]
[0018] In this aspect, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer may include reducing the reliability of one of the first and second information based on an estimated location of the first or second camera based on the first information or the second information.
[0018]
[0019] In this aspect, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer may include comparing at least one aspect of the anatomical feature that is common to the first information and the second information.
[0019]
[0020] In this embodiment, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer may include determining a proximity between the first camera and the anatomical feature and between the second camera and the anatomical feature.
[0020]
[0021] A second aspect of this disclosure is a video intubation system.
[0021]
[0022] In this second aspect, the system may optionally include a housing sized and configured to be handled by a user, a first imaging member directly or indirectly coupled to the housing, the first imaging member including a first video camera within a distal region of the first imaging member, and an elongated endotracheal tube introducer sized to be disposed within the endotracheal tube.
[0022]
[0023] In this second aspect, the introducer may include a shaft carrying one or more markers, the one or more markers positioned and adapted to be captured by the first imaging member when the one or more markers are within a field of view of the first imaging member.
[0023]
[0024] In this second aspect, the system may include one or more actuators in operable communication with the introducer to facilitate controlled robotic axial movement of the introducer relative to the first video camera.
[0024]
[0025] In this second aspect, the system may include one or more processors configured to receive as input information indicative of a signal from a first video camera of one or more upper airway anatomical landmarks and cause communication to one or more actuators to facilitate automatic, controlled robotic movement of the introducer relative to the first video camera.
[0025]
[0026] In this second embodiment, the system may further comprise a second video camera disposed in a distal region of the introducer.
[0026]
[0027] In this second aspect, the one or more processors may be configured to receive as input one or more of information indicative of a signal from the first video camera and information indicative of a signal from the second video camera of one or more upper airway anatomical landmarks, and communication to one or more actuators to facilitate automatic, controlled robotic movement of the introducer and the second video camera relative to the first video camera.
[0027]
[0028] In this second embodiment, one or more markers may be disposed on the shaft to indicate one or more of the locations or positions of the deflectable region of the introducer.
[0028]
[0029] In this second aspect, the one or more markers may comprise one or more visual markers.
[0029]
[0030] In this second embodiment, the first marker may be different from the second marker, and the difference may indicate a different region of the introducer.
[0030]
[0031] In this second aspect, the first marker may be a first type of marker and the second marker may be a second type of marker that is different from the first type of marker.
[0031]
[0032] In this second aspect, at least one marker of the one or more markers may be adapted to emit a light, optionally adapted to emit a flashing or solid light.
[0032]
[0033] In this second aspect, the at least one marker may extend circumferentially around the entire introducer.
[0033]
[0034] In this second aspect, the at least one marker may extend circumferentially around less than 360 degrees of the introducer.
[0034]
[0035] In this second embodiment, the one or more markers may include one or more reflective materials.
[0035]
[0036] In this second embodiment, the one or more markers may comprise a plurality of markers spaced axially along the introducer, either equally spaced or unequally spaced. [Brief description of the drawings]
[0036] [Figure 1]
[0037] 1A-1C are diagrams of variations of an example of a device for assisting in navigation and / or intubation within a patient. [Figure 2A]
[0038] 13A-13D illustrate variations of an example device for assisting with navigation and / or intubation within a patient. [Figure 2B]
[0039] FIG. 2B is a front view of a variation of the example device shown in FIG. 2A including a cover. [Figure 2C]
[0040] FIG. 2C is a rear view of a variation of the example device shown in FIG. 2B. [Figure 3A]
[0041] 13A-13C are cross-sectional views of variations of an example manual actuation system for guiding an actuation member in a device for assisting in navigation and / or intubation within a patient. [Figure 3B]
[0042] 1 is a perspective view of a variation of an example of an automated actuation system for guiding an actuating member in a device for assisting in navigation and / or intubation within a patient. [Figure 3C]
[0043] 13A-13D show variations of an example of an actuation unit for guiding an actuation member in a device for assisting navigation and / or intubation within a patient. [Figure 3D] 13A-13D show variations of an example of an actuation unit for guiding an actuation member in a device for assisting navigation and / or intubation within a patient. [Figure 4A]
[0044] 13A-13C illustrate example variations of a cover within a device to assist with navigation and / or intubation within a patient. [Figure 4B] 13A-13C illustrate example variations of a cover within a device to assist with navigation and / or intubation within a patient. [Diagram 5]
[0045] 13A-13C show variations of an example of an automated actuation system for articulating a distal end of a scope member in a device to assist in navigation and / or intubation within a patient. [Figure 6] 13A-13C show variations of an example of an automated actuation system for articulating a distal end of a scope member in a device to assist in navigation and / or intubation within a patient. [Figure 7]
[0046] 1 is a flowchart of a variation of an example of a method for tracheal intubation of a patient. [Figure 8A]
[0047] FIG. 1 illustrates an exemplary sequence showing automatic image / landmark recognition. [Figure 8B]
[0048] FIG. 1 illustrates an exemplary sequence showing manual image / landmark recognition. [Figure 9A]
[0049] FIG. 13 illustrates an exemplary sequence for image recognition followed by automated robotic control of the introducer. [Figure 9B]
[0050] FIG. 13 illustrates an exemplary sequence of image recognition followed by manual robotic control of the introducer. [Figure 10]
[0051] FIG. 1 illustrates exemplary steps involving manual robotic control at a point subsequent to automatic robotic control. [Figure 11]
[0052] FIG. 1 illustrates a portion of an exemplary integrated and handheld intubation assembly. [Figure 12]
[0053] FIG. 1 illustrates a portion of an exemplary integrated and handheld intubation assembly. [Figure 13]
[0054] FIG. 1 illustrates a portion of an exemplary integrated and handheld intubation assembly. [Figure 14A]
[0055] FIG. 1 illustrates an exemplary integrated and handheld dual video tracheal intubation assembly. [Figure 14B]
[0056] FIG. 2 illustrates an exemplary housing and first imaging member. [Figure 14C]
[0057] FIG. 2 illustrates an exemplary second imaging member. [Figure 14D]
[0058] FIG. 2 illustrates a portion of an exemplary second imaging member. [Figure 15]
[0059] FIG. 1 illustrates an exemplary integrated and handheld dual video tracheal intubation assembly disposed within the upper airway. [Figure 16A]
[0060] 1 is an exemplary image on an exemplary display of image data from a first image sensor when maintained within the upper airway. [Figure 16B]
[0061] 1 is an exemplary image of image data from a first and second image sensor displayed on an exemplary display. [Figure 16C]
[0062] 1 is an exemplary image displayed on an exemplary display of image data from a first and second image sensor while the first image sensor is maintained within the upper airway. [Figure 16D]
[0063] 1 is an exemplary image displayed on an exemplary display of image data from a first and second image sensor while the first image sensor is maintained within the upper airway. [Figure 17A]
[0064] FIG. 1 is a side view of an exemplary integrated and handheld dual video tracheal intubation assembly (first imaging member not shown) shown in an unassembled state. [Figure 17B] FIG. 2 is a top view of an exemplary integrated and handheld dual video tracheal intubation assembly (first imaging member not shown) shown in an unassembled state. [Figure 17C]
[0065] FIG. 2 is a bottom view of an exemplary integrated and handheld dual video tracheal intubation assembly shown in an assembled state. [Figure 17D]
[0066] FIG. 2 is a side view of an exemplary integrated and handheld dual video tracheal intubation assembly shown in an assembled state. [Figure 17E]
[0067] FIG. 2 is a top view of an exemplary integrated and handheld dual video tracheal intubation assembly shown in an assembled state. [Figure 17F]
[0068] FIG. 1 is a side view of an exemplary integrated and handheld dual video tracheal intubation assembly shown in an unassembled state. [Figure 17G]
[0069] FIG. 1 is a top view of an exemplary integrated and handheld dual video tracheal intubation assembly shown in an unassembled state. [Figure 18A]
[0070] FIG. 2 is a side view of an exemplary housing. [Figure 18B]
[0071] FIG. 18B is a side view of an exemplary cross-sectional view of the housing from FIG. 18A. [Figure 18C]
[0072] FIG. 18B is a top view of the exemplary housing from FIG. 18A. [Figure 18D]
[0073] FIG. 18B is a front end view of the exemplary housing from FIG. [Figure 18E]
[0074] FIG. 18B is a perspective top view of the exemplary housing from FIG. 18A. [Figure 18F] FIG. 18B is a perspective top view of the exemplary housing from FIG. 18A. [Figure 18G]
[0075] 1 illustrates an exemplary housing and optional internal components. [Figure 18H] 1 illustrates an exemplary housing and optional internal components. [Figure 18I]1 illustrates an exemplary housing and optional internal components. [Figure 18J] 1 illustrates an exemplary housing and optional internal components. [Figure 19A]
[0076] FIG. 13 is a bottom view of an exemplary second imaging member including an optional image sensor in a distal end region. [Figure 19B]
[0077] FIG. 2 is a top view of an exemplary second imaging member. [Figure 19C]
[0078] FIG. 2 is a side view of an exemplary second imaging member. [Figure 19D]
[0079] FIG. 13 is a rear end view of a second imaging member coupled to an intubation tube. [Figure 19E]
[0080] FIG. 13 is a front end view of a second imaging member coupled to an intubation tube. [Figure 19F]
[0081] FIG. 2 is a top view of an exemplary second imaging member with the top surface removed to show the internal components. [Figure 19G]
[0082] FIG. 13 is a bottom perspective view of an exemplary housing for a second imaging member. [Figure 19H]
[0083] FIG. 13 is a bottom view of an exemplary housing for the second imaging member. [Figure 19I]
[0084] FIG. 2 is a top perspective view of an exemplary housing for a second imaging member. [Figure 19J]
[0085] FIG. 2 is a front end view of an exemplary housing for a second imaging member. [Figure 19K]
[0086] FIG. 13 is a rear end view of an exemplary housing for the second imaging member. [Figure 20]
[0087] FIG. 2 is a schematic diagram of an exemplary integrated and handheld dual video assembly. [Figure 21]
[0088] FIG. 1 illustrates an exemplary method of using any of the integrated handheld assemblies herein. [Figure 22]
[0089] FIG. 1 shows an example of an image through a laryngoscope. [Diagram 23]
[0090] FIG. 1 shows an example of an introducer scope having a band indicator. [Figure 24]
[0091] FIG. 1 shows an example of an introducer scope having a band indicator. [Diagram 25]
[0092] FIG. 1 shows an example of an introducer scope having a light indicator. [Figure 26]
[0093] FIG. 13 shows an example of a visual display including a video image from a laryngoscope and a video image from an introducer scope with a curvature indicator. [Figure 27]
[0094] FIG. 27 illustrates a visual display similar to that shown in FIG. 26, where the curvature indicator is shown screen within the screen of one of the video images to conserve display space. [Figure 28]
[0095] FIG. 13 illustrates a visual display including an introducer scope tip force indicator. [Figure 29A]
[0096] 1 shows one embodiment of a blade, the blade including a hook that engages the ETT to the blade. [Figure 29B] 1 shows one embodiment of a blade, the blade including a hook that engages the ETT to the blade. [Diagram 30]
[0097] FIG. 1 shows some examples of actual images through a laryngoscope or introducer scope adjacent to their segmented representations. [Diagram 31]
[0098] FIG. 1 is a block diagram of a data processing system. [Diagram 32]
[0099] 1 is an exemplary sequence of steps that may be included in the methods herein. [Diagram 33]
[0100] 1 is an exemplary sequence of steps that may be included in the methods herein. [Diagram 34]
[0101] 1 is an exemplary sequence of steps that may be included in the methods herein. DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
[0037]
[0102] Examples of various aspects and variations of the invention are described herein and illustrated in the accompanying drawings. The following description is not intended to limit the invention to these embodiments, but rather to provide examples to enable those skilled in the art to make and use the invention herein.
[0038]
[0103] The disclosure herein relates to airway management methods, devices, and systems. Although tracheal intubation is provided as an example of tracheal management herein, it is understood that the disclosure is not so limited, and the concepts herein may be applied or applicable to other airway management procedures, locations, and environments. For example, the concepts herein may be used in bronchoscopy procedures, or in endoscopic ENT procedures, such as flexible nasolaryngoscopy, esophagoscopy, intraglottic injection, certain pharyngeal surgical procedures, and other endoscopic procedures involving the upper gastrointestinal (GI) tract (e.g., gastroscopy, esophagoscopy), etc.
[0039]
[0104] Airway management procedures herein may include any of the following exemplary, non-limiting procedures in both adult and pediatric patients: 1) determining whether or not the patient is receiving airway therapy, (a) whether or not the patient is receiving airway therapy, (b) whether or not the patient is receiving airway therapy, (c) whether or not the patient is receiving airway therapy, (d) whether or not the patient is receiving airway therapy, (e) whether or not the patient is receiving airway therapy, (f) whether or not the patient is receiving airway therapy, (g) whether or not the patient is receiving airway therapy, (h) whether or not the patient is receiving airway therapy, (i) whether or not the patient is receiving airway therapy, (j ... (a) endoscopic evaluation of the airway in the patient to determine or establish (b) feasibility of placement of an airway device (e.g., laryngeal mask airway) and likelihood of successful SGA ventilation, (c) whether awakening and / or TI is feasible, (d) the optimal TI navigation route to the larynx, (e) the optimal TI device use and the optimal TI strategy; (e) endoscopic evaluation of the airway in the patient to determine or establish (f) feasibility of placement of an airway device (e.g., laryngeal mask airway) and likelihood of successful SGA ventilation, (f) whether awakening and / or TI is feasible, (g) the optimal TI navigation route to the larynx, (h) the optimal TI device use and the optimal TI strategy; (i) facilitating ETT exchange; (i) assessing ETT positioning and / or patency and / or confirming correct placement of the ETT inside the trachea; (i) facilitating placement of a dual lumen tube and confirming its proper positioning; (ii) facilitating extubation attempts; (iii) performing bronchoscopy; (iv) performing ENT procedures such as endoscopy, esophagoscopy, biopsy, infusion, certain pharyngeal surgical procedures; and (v) performing other airway therapeutic, interventional and / or diagnostic procedures.
[0040]
[0105] As used herein, airway management procedures may be used in any of these non-limiting locations and environments: OR, ICU, ED, out-of-OR locations (e.g., endoscopy suites, imaging scanners, different outpatient and hospital environments, procedure rooms, etc.), and in-the-field (e.g., EMS) and battlefield airway management, both in the field and during patient transport.
[0041]
[0106] Airway management, as used herein, may include or be used in visualization procedures, diagnostic procedures, interventional procedures, surgical procedures, and / or therapeutic and diagnostic procedures.
[0042]
[0107] The airway management concepts described herein may find utility in non-medical applications.
[0043]
[0108] Devices and systems adapted to assist in navigation and / or intubation - Patent application
[0109] Some non-limiting aspects of the disclosure herein are directed to a portable, handheld, integrated, dual-video enhanced visualization and navigation system adapted to guide an ETT into a patient's trachea during a TI procedure. Such a system is adapted and configured to provide and improve all three critical steps required for successful TI: visualization, navigation / movement, and placement. An integrated dual-video system configured, adapted, and sized to be held in a user's one hand provides the benefit of allowing the user to hold and optionally control the dual-video integrated and enhanced visualization and navigation system in one hand, allowing a single operator to reliably facilitate navigation and movement of the ETT introducer guide into the patient's trachea. The integrated dual-video system herein provides enhanced visualization of the patient's airway anatomy, which facilitates enhanced navigation of the ETT in and around the patient's anatomy, as well as improved ETT placement (insertion) through the glottic opening and into the patient's trachea during a TI procedure, all of which helps reduce TI trauma and increase the likelihood of first-pass TI success.
[0044]
[0110] The disclosure herein may refer to navigation when describing movement of an introducer. It is understood that in some cases navigation may also refer to automated determination of how or where the introducer is moved by robotic control (e.g., using image recognition). Navigation may also be performed manually in embodiments where an operator determines how or where to move the introducer, such as, for example, based on observing an image on a display.
[0045]
[0111] Described herein are variations of devices, systems, and methods for robotically assisting navigation and movement of an introducer within an airway or other passageway within a patient, such as during an intubation procedure (e.g., orotracheal intubation, nasotracheal intubation, etc.). In some examples herein, the robotically assisted movement herein may include using artificial intelligence (AI) to enable robotically assisted navigation. As shown in the diagram of FIG. 1, in some variations, an integrated robotic device or system 100 may include a housing 110, a laryngoscope or baton 120 (e.g., a video laryngoscope) coupled to the housing and including a first image sensor, and an actuation member 140 at least partially disposed within the housing. The housing 110 may be an integrated handheld device, for example, to be portable and / or configured to be easily operated by a single person. The actuation member may be movable within the housing, and an introducer, such as an endoscope 150 (e.g., a video endoscope), may extend from the actuation member 140. The introducer may include a second image sensor and may be configured to be slidably coupled to an intubation tube, such as an ETT, where the coupling may include the ETT being slidably disposed about the introducer. When the introducer is robotically moved into the patient's passageway (e.g., trachea), the introducer may act as a steering guide for intubation tube advancement during the intubation procedure. Intubation tube advancement may be performed manually or automatically, for example, by passing the intubation tube over the introducer. Once intubation tube placement (such as in the trachea) is confirmed by real-time images from one or more image sensors (such as an introducer image sensor when the introducer is in the trachea), the intubation tube may be disconnected from the introducer (including sliding the introducer out of and proximally relative to the ETT) and the introducer and remainder of the device 100 may be withdrawn from the patient's anatomy, leaving the intubation tube (e.g., ETT) in place.
[0046]
[0112] In any of the examples and embodiments herein, the robot-assisted navigation / movement may include robot-assisted navigation of an introducer, an example of which is an endoscope (sometimes referred to herein as a scope) as described herein. Although the introducer herein is generally described as including one or more image sensors, in alternative systems, the introducer may not include an image sensor or the image sensor may not be in continuous use. In examples where the introducer does not include an image sensor (or the image sensor is not in continuous use), the introducer may be navigated robotically with AI assistance using images obtained from an integrated image sensor, such as an image sensor associated with a first imaging member, such as a video laryngoscope, exemplary details of which are described herein. When utilizing a non-optical introducer, placement of the intubation tube below the vocal cords (lower airway) is not visualized by the non-optical introducer, and therefore placement of the intubation tube below the vocal cords cannot be immediately confirmed. However, a non-optical introducer may offer simplicity and cost benefits compared to an optical introducer, such as the optical introducer described herein that includes one or more image sensors, depending on the application and clinical situation.
[0047]
[0113] Although the devices, systems, assemblies, and methods are primarily described herein with reference to intubation procedures, it should be understood that the devices and methods may be used to assist other medical airway management procedures involving navigation through one or more passageways, such as endoscopy procedures (e.g., bronchoscopy, etc.). For example, navigation of an introducer may be robotically assisted using devices and methods such as those described herein, except that the introducer may be automatically guided using AI / automation techniques without being coupled to an intubation tube. For example, the devices may robotically assist in navigation of an introducer during any suitable medical endoscopy procedure to provide a faster and / or less traumatic endoscopic procedure compared to traditional manual techniques. As an illustrative example, the devices, systems, assemblies, and methods described herein may automatically guide an introducer (e.g., endoscope 150) based on one or more images acquired by the introducer and / or the first imaging member (e.g., laryngoscope) instead of automatically guiding an intubation tube. In some variations, an introducer (eg, endoscope 150) may include one or more channels, for example, for irrigation, drug delivery, tissue biopsy, and / or deployment of surgical instruments.
[0048]
[0114] Furthermore, in some variations, the devices, systems, assemblies, and methods herein may be used in other applications (e.g., non-medical applications) where automated navigation / movement may be useful, such as navigation within corridors that are otherwise challenging to access.
[0049]
[0115] The exemplary system 100 of FIG. 1 may optionally include at least one display 118 configured to display one or more images from a first image sensor in the first imaging member (e.g., laryngoscope) and / or a second image sensor in the second imaging member (which may comprise an introducer), and may be configured to display images from both the first and second image sensors simultaneously, such as in split screen or picture-in-picture. The images may be displayed continuously or substantially continuously or sequentially during the procedure. The system 100 may further include at least one actuator 116 in the housing configured to automatically guide / move the introducer (e.g., endoscope) by the actuation member 140 based at least in part on one or more images from the first image sensor and / or the second image sensor. In some variations, the system may further include a cover or blade coupled to the housing, the cover may include a first channel sized and configured to receive a first elongated imaging member (such as a video baton) and configured to securely receive at least a portion of an intubation tube (in which an introducer may be disposed). The cover may further include a tongue retraction member (an angled or curved member) configured to retract the patient's tongue during the intubation procedure, examples of which are shown in the figures herein.
[0050]
[0116] In some variations, the one or more actuators may be under operational control by a processor 112 configured to analyze image or image data from one or both of the first and second image sensors in the system using appropriate AI (e.g., machine learning methods). Various electronics 114 (e.g., power source(s), electronic communication lines, etc.) in the system or housing 110 and / or display 118 may power one or more processors, image sensors, light guides, etc. in the system. Real-time or near real-time AI-based image recognition of the patient's upper airway anatomy (above the vocal cords) and / or lower airway anatomy (below the vocal cords) may trigger, for example, robot-assisted tracheal intubation by the system. As described in more detail below, visualization and navigation / movement to or toward the vocal cords may be based, for example, on identifying one or more key anatomical recognition points provided by the image sensor(s) of the first and / or second imaging members. The system may implement robot-assisted navigation that is activated automatically in response to recognizing airway anatomy and / or in response to manual activation (e.g., through user manipulation of user interface elements). For example, in a fully automated mode of the exemplary device or assembly 100, the actuators may automatically steer the endoscope using AI and / or other robot-assisted navigation and electromechanical control of the actuation members.
[0051]
[0117] Additionally or alternatively, the device or system may operate in an automated mode with exemplary manual assistance. In such an automated manual assistance mode, for example, the actuation member and / or introducer may be manually controlled, such as by use of a user interface device (e.g., a joystick) or through the device display 118. Articulation of the distal tip of the introducer when the device is in the automated manual assistance mode may occur automatically, for example, under automated robotic control of one or more actuators in the system.
[0052]
[0118] When used for TI, the system herein may be a user-friendly, portable, handheld, video-triggered, AI-enabled robot-assisted automated intubation system with enhanced capabilities that improve all three critical steps required for successful TI: visualization, navigation, and placement, and increase first-pass intubation success rates, decrease overall intubation time, reduce intubation-related airway trauma, and / or improve patient safety. For example, the system herein may combine multiple imaging (e.g., video) modules that enable the device to perform intubation using AI or robot-assisted introducer navigation in an ergonomic package operable by a single user. The robot-assisted intubation interface may, for example, steer at least a guiding introducer through the glottis and into the patient's trachea, which may serve as a guide for ETT advancement and placement. The ETT may, for example, be preloaded onto the introducer and advanced over the introducer after the introducer has been advanced into the trachea and after proper placement into the trachea has been confirmed.
[0053]
[0119] Among other advantages, such as those described herein, the systems herein may be configured to provide continuous visual feedback and optional closed-loop robotic assistance for real-time troubleshooting and / or intelligent intervention during tracheal intubation from both above and below the vocal cords, thereby improving TI success rates, improving intubation speed, and reducing TI trauma. Additionally, the combined use of the first and second imaging members may enable reliable and faster triggering of the AI and associated robotic interface, due at least in part to the magnified and clear view of the upper airway anatomical landmarks provided by the first imaging member (such as laryngoscope 120). Another advantage of obtaining initial imaging through the first imaging member is that visualization of the patient's anatomy is much less affected by blood and secretions compared to images provided by a second imaging member (e.g., an image sensor in the distal region of the introducer). Furthermore, the combined use of the first and second imaging members, the angular orientation of their respective video cameras, and the placement and maintenance of the video cameras in close axial proximity to each other and to the glottic opening provide the shortest and fastest navigational path for the introducer and ETT to the vocal cords and trachea. Furthermore, actuation of the introducer within the patient's airway is significantly facilitated by the device cover or blade configured to perform tongue retraction, thereby creating a larger pharyngeal space for introducer actuation and manipulation. One optional and significant benefit of some of the systems herein is that the system may be configured to allow the user to observe the intubation procedure as a whole from both above the vocal cords (upper airway) and below the vocal cords (lower airway), and to allow immediate visual confirmation of intubation tube placement within the trachea during intubation using the introducer imaging sensor, ensuring that the intubation tube is optimally positioned within the patient's airway, an exemplary embodiment of which is described below.
[0054]
[0120] Additionally, the integrated dual video capabilities of the systems herein may significantly reduce intubation-related airway trauma and soft tissue damage often associated with conventional devices, even in situations where visualization of upper airway anatomical landmarks is limited (e.g., in the absence of full glottal exposure). For example, after identifying anatomical structures reliably associated with the glottic opening (e.g., epiglottis, arytenoid cartilage, etc.) during initial video image capture by a first image sensor, the system may automatically steer an introducer through the glottic opening and into the patient's trachea, even when the glottic opening cannot be visualized. The device may reduce the risk of esophageal intubation and / or disturbance, defragmentation, bleeding, and / or airway contamination during intubation, such as when a tumor or other space-occupying lesion is present inside the patient's airway.
[0055]
[0121] In some variations, the system may be useful in situations where increased distance from the patient's airway is desirable to reduce the likelihood of airborne and / or contact transmission of infection from the patient to the operator of the device. For example, due to the minimal airway manipulation required and the automated nature of the intubation performed, an operator of the integrated system may be able to hold the system from a suitable distance (e.g., arm's length) and avoid the risk of looking directly inside the patient's airway to reduce the likelihood of transmission of infection (e.g., from patients with contagious bacterial and / or viral diseases such as COVID-19 and others).
[0056]
[0122] The systems herein may be used for routine elective and / or expected and / or unexpected difficult tracheal intubations in any appropriate environment, such as, for example, the OR, ICU, emergency department, out-of-OR locations (e.g., clinics, code situations, etc.), pre-hospital settings (field and battlefield airway management), and / or other elective and / or urgent and / or emergency situations. Additionally, the systems may be used for TI across a wide range of patients, such as patients undergoing interventional endoscopy procedures (bronchoscopy, GI endoscopy, etc.), transesophageal echocardiograms, CT and MRI imaging procedures, any medical procedure that may require sedation and / or airway support and / or airway protection, and across a variety of diagnostic and / or therapeutic procedures, such as when airway support and / or protection of the patient's airway and / or lung hygiene is desired or indicated. The system may be useful for TI in certain patient populations who may expect increased TI difficulties, such as patients who are obese, patients with obstructive sleep apnea, patients with head and neck cancer and other pathologies, elderly patients, patients at high risk for dental damage, patients in whom neck movement is undesirable, trauma patients, patients in whom it is important to minimize adverse cardiovascular responses to intubation (e.g., hypertension, tachycardia, arrhythmia, etc.), critically ill patients, and other patients. The device may, in some variations, be useful for TI among adult and pediatric patients.
[0057]
[0123] 2A-2C are schematic diagrams of merely exemplary portable, handheld, integrated dual video robotic assembly or system 200 that may be adapted for visualization and navigation and placement during an intubation procedure. As shown in FIG. 2A, system 200 may include a handheld housing 210, an electronics system 214 (e.g., including one or more processors, one or more power sources, etc., examples of which are described herein), and one or more actuators 216. The device may further include a first elongated imaging member, such as a laryngoscope having a baton 220 (or other imaging member) having at least one image sensor 222 disposed at a distal region of the first imaging member as shown, and an actuation member 240 movable within housing 210. Additionally, system 200 may include an introducer, such as an endoscope 250 having an image sensor 252 disposed at a distal region of the introducer as shown. Introducer 250 may be configured to be coupled to an intubation tube (e.g., an ETT for use during a TI procedure). In this context, "coupled to" includes that the ETT is axially movable about or on the introducer. As shown in FIGS. 2B, 4A, and 4B, the system 200 may further include a cover 260 including a channel sized and configured to receive a first imaging member (e.g., laryngoscope baton 220) therein, and at least a portion of the ETT and introducer (e.g., endoscope 250). As shown in FIGS. 4A and 4B, the cover 260 may further include a distal region including a member 268 configured to manipulate tissue (e.g., the patient's tongue) during an intubation procedure. Any of the covers herein may include a member similar to the member 268 configured to manipulate tissue (e.g., the patient's tongue) during an intubation procedure. Further exemplary embodiments of the system 200 for enhanced visualization and navigation during intubation are described in further detail below with reference to Figures 2A-2C, 3A-3D, 4A-4B, 5, and 6, although it should be understood that the described embodiments may be applied to other variations of systems and devices having other sizes, shapes, etc.
[0058]
[0124] Handheld Housing
[0125] The exemplary housing 210 may be sized and configured to enclose various software and hardware components for performing robot-assisted TI, such as electronic components (e.g., processor(s), memory, power source(s), motor(s), etc.) and / or actuator(s) for guiding an introducer, such as during an intubation procedure. The housings herein may be further sized and configured to integrate a first imaging member (e.g., a video laryngoscope) and a second imaging member (e.g., an endoscope) into a single user-friendly portable and handheld system that may be operable and controlled by one hand or by a single user. Both the handheld housings herein (e.g., housing 210) and the integrated dual video assemblies herein (which may include handheld housings) may be advantageously sized and configured to be held by one hand of a single operator and provide the benefits described herein.
[0059]
[0126] A housing herein (e.g., housing 210) may be configured as a handheld housing that may be ergonomically held in a user's hand. The handheld housing may be contoured (e.g., with finger grips, etc.) or otherwise configured for a particular hand (e.g., left hand, right hand) or suitable for both hands. For example, as shown in the front view shown in FIG. 2A, the handheld housing may be configured for left-handed use. In some variations, the housing may include one or more other ergonomic features, such as cushioning (e.g., foam or rubber padding, silicone gel, etc.) to improve user comfort, friction features (e.g., rubberized grip, texture features such as ribbing, etc.).
[0060]
[0127] In some examples, the handheld housing may be between about 10 cm and 75 cm in length, e.g., between about 15 cm and 45 cm in length, but may be any suitable size that conforms to device ergonomics that allow the device to be held in one hand of an operator. In some embodiments, the housing is between 2 cm and 15 cm wide, e.g., between 4 cm and 10 cm wide. In some embodiments, the housing is between 5 cm and 20 cm, e.g., between 5 cm and 15 cm, measured from top to bottom.
[0061]
[0128] A housing herein (e.g., housing 210) may be made of any suitable rigid or semi-rigid material. For example, the housing may include plastic formed through a suitable injection molding process. In some variations, the housing may include one or more separate components (e.g., shells) that are coupled together through one or more suitable fasteners (e.g., epoxy or other adhesives, mechanical fasteners) and / or mating features (e.g., threaded or snap-fit or complementary features on different housing components). The housing may enclose within an interior volume various electronic components, actuator(s), and / or other aspects of the device, examples of which are described herein.
[0062]
[0129] Electronics Systems
[0130] The systems or assemblies herein may include an electronics system (e.g., electronics system 214) that may include at least one processor and / or at least one memory device. At least a portion of electronics system 214 may be disposed, for example, in a housing and / or a display coupled to the housing, which will be described in more detail below. The memory device may store instructions (e.g., in the form of software, computer executable methods) for one or more processors to analyze images from the first imaging sensor and / or the second imaging sensor and / or perform AI-based analysis of such images (using smart image recognition techniques and / or machine learning) to automatically navigate the introducer into the trachea during intubation. The processor(s) may similarly be configured to perform automated control of actuators within the device to guide the actuation member and / or at least a portion of the introducer for intubation assistance. The automated navigation may perform the intubation procedure in a user-friendly manner with little user training or experience to enable successful intubation. Further details of such AI or machine learning algorithms are further described below.
[0063]
[0131] The electronics system, conceptually designated as exemplary electronics system 214, may further include other components to support the device, such as at least one power source. In some variations, the power source may include at least one battery as a self-contained power source (e.g., to help facilitate device portability). Additionally or alternatively, the housing and / or display may include a power connector or port 211 that may allow for a wired power connection, such as to an external AC or DC power source. Additionally or alternatively, the housing may include a wired connection (e.g., cable) and / or a wireless communication module to communicate with a freestanding video monitor. Further, in some variations, the housing may include an emergency stop control (e.g., a button) to halt the automated robotic assistance of the device (e.g., abruptly stopping current to the actuator(s)), such as upon operator intent. In some variations, the housing may further include a power button to control power on and off of the system, and / or a port(s) for downloading images and updating software program(s).
[0064]
[0132] Actuating unit(s), actuator, actuating member
[0133] The housing herein (e.g., housing 210) may include one or more actuators 216 configured to automatically guide movement of actuation member 240 for AI or robot-assisted intubation while the introducer is coupled (e.g., releasably coupled) to an intubation tube. In the example of FIG. 2A, advancement of actuation member 240 may similarly extend an effective working length or length of endoscope 250. As described in further detail below, actuator(s) 216 may be integrated within the housing and exert their actuation on actuation member 240 through a coupled interface, whereby the generated movement is transmitted along a longitudinal axis of the actuation member and along a longitudinal axis of endoscope 250 extending from the actuation member. One or more actuators 216 may further be included to manipulate and / or articulate a distal end of endoscope 250, as described further below.
[0065]
[0134] The device may include any suitable actuators and mechanical or electromechanical assemblies for controlling the actuation member 240 and / or introducer. For example, the exemplary actuator(s) 216 and associated controller(s) may include suitable drive electronics, one or more electric motors, hydraulics, and / or pneumatics, as well as suitable mechanical assemblies, connections, couplings, and / or controllers. For example, the control assemblies, connections, and couplings for controlling the actuation member and / or endoscope may include longitudinal elements with bidirectional push-pull cables, wire pulley assemblies, chain drives, hinges, sliding crank mechanisms, piezoelectric elements, pneumatic elements and assemblies, magnetic elements, adjustable couplings, sleeves, belts, gears, pushers, plungers, moveable racks, compression springs, rotary-to-linear and / or linear-to-rotary motion conversion modules, gear drives, or other suitable motors and / or couplings, and the like. Other suitable fasteners and bearing surfaces may further be included in the actuator(s) assembly 216.
[0066]
[0135] The exemplary actuator(s) 216 may be activated automatically and / or manually. For example, in some examples, the actuator(s) 216 may be activated through one or more processors executing image recognition software instructions in response to the processor(s) recognizing one or more anatomical landmarks through such image recognition techniques. This automatic activation may be part of a fully automated mode of the device, for example. Additionally or alternatively, the actuator(s) 216 may be selectively engaged and / or disengaged in response to a user selection of one or more user interface elements. For example, the actuator(s) 216 may be activated by selection of an AI operation button 280 or the like, as shown in FIG. 2C, and stopped by selection of a STOP button 284 or the like, as shown in FIG. 2C. It should be understood that the system may additionally or alternatively include other user interface elements for activating / deactivating the fully automated mode of the device, such as a toggle switch, a touch-sensitive pad, a touch screen, a user interface icon on a display screen, and the like. In some variations, manual actuation of the actuation member 240 (e.g., with a joystick or other user interface element, as described below) may instantly override the fully automated mode. In these variations, the fully automated mode may be allowed to resume thereafter, for example, after the user presses the AI operation button 280. Additionally or alternatively, the fully automated mode may resume after a predetermined period of time (e.g., a period of inactivity or non-movement of the actuation member 240, a predetermined duration, etc.) while in the manually assisted mode. In still other variations, the selected manually assisted mode may override the fully automated mode as long as a clutch (e.g., a button, switch, joystick, or other suitable selectable mechanism) is engaged, while release of the clutch button may allow the fully automated mode to resume.
[0067]
[0136] display
[0137] As shown in exemplary FIGS. 2A-2C, any of the systems or assemblies herein (e.g., system 200) may optionally further include a display, such as display 218, such as a monitor screen, touch screen, or the like. The display may be configured to display image data and / or a user interface. For example, the display may be configured to display a single channel image from only the first image sensor (e.g., laryngoscope image sensor 222) or only the second image sensor (e.g., introducer image sensor 252). As another example, the display herein may be configured to display multi-channel images from both the first and second image sensors (e.g., 222 and 252), such as in a split screen and / or picture-in-picture arrangement of images from the laryngoscope and / or endoscope image sensors, by way of example only. In some variations, the display may be configured with a default or pre-programmed display sequence. As an example of a default display sequence, the display may be configured to initially display a video feed or signal from the video laryngoscope to provide visual feedback of the initial entry into the patient's airway (e.g., the upper airway) and / or of the identified anatomical structure(s) by initiating AI-based operation (automatically or through manual activation, as described above) and / or by pressing a selectable user interface on the device and / or display, and then automatically transition to display a multi-channel set of images (e.g., split screen, picture-in-picture) from the endoscope image sensor (e.g., 252) and / or laryngoscope image sensor (e.g., 222).In some variations, other toggling of video feeds from various image sensors may be accomplished through specific pre-programmed manipulation of user interface elements (e.g., pressing a picture-in-picture button or pressing an icon two or more times in succession may result in a full image of the patient's airway and intubation tube placement (or other anatomical structures) provided from the endoscope image sensor 252).
[0068]
[0138] In some examples, a display herein may be coupled to the housing 210 or other housing herein (e.g., on a proximal portion of the housing). The display may include any suitable display element (e.g., LCD). In some variations, the display may be coupled to the housing by a rotatable or pivoting coupling, such that the display may be swung about a longitudinal axis and / or tilted about a vertical and / or horizontal axis and may be viewable from multiple angles. Alternatively, the systems herein may include a multi-sided (e.g., dual-sided) display to allow for viewing of the displayed content from multiple angles simultaneously. In any of the embodiments herein, the display coupled to the handheld housing may be of a portable size, such as between about 8 cm and 15 cm in height and between about 10 cm and about 18 cm in width, although the display may be of any suitable size and / or shape.
[0069]
[0139] Additionally or alternatively, any of the systems herein may include and be communicatively coupled to a remote display that is not part of the integrated assembly. For example, the systems herein may include one or more ports within any of the housings herein for wired communication to the display device. In another example, the system may include a wireless communication module and antenna to communicate content for display to other screens (e.g., via cellular mobile networks, WiFi, etc.).
[0070]
[0140] A first (elongated) imaging member (e.g., a laryngoscope)
[0141] Any of the integrated dual video systems or assemblies herein may include a first imaging member (e.g., a video laryngoscope) that may include an elongated flexible body and a first image sensor (e.g., a video camera) disposed at a distal region of the elongated body. Any of the first imaging members herein may also be referred to as a first elongated imaging member to generally indicate that the first imaging member includes an elongated configuration. For example, as shown in exemplary FIGS. 2A-2C, system 200 may include a first imaging member (e.g., a video laryngoscope). The first imaging member may include a baton 220 (or other elongated member) extending distally from housing 210 as shown. Baton 220 may include a high resolution image sensor(s) (e.g., a video camera) at a distal region to provide video images, one or more light guides to provide illumination to the image sensor field of view, and electronic signal wires to transmit video data or images for processing and / or display on display 218 (or other suitable display). The image sensor(s) 222 may be located at the distal end of the elongated member and may be adapted to provide a relatively wide angle of view for magnified and clear visualization of the patient's anatomy in both the axial and horizontal planes during the intubation procedure. The relatively wide angle of view and the angular position of the first imaging sensor (relative to the second imaging sensor) may help reliably visualize and identify crucial anatomical landmarks in the upper airway, thus enhancing navigation of the introducer as it is moved distally relative to the first imaging sensor. The combined use of the first and second imaging members, the optionally large angle of view, and the placement and maintenance of the first and second imaging members in close axial proximity to each other and to the glottic opening, provide the shortest and fastest navigation path for the introducer and ETT to the vocal cords and trachea, as described in more detail below. In some examples, which are merely optional but not limiting, the first imaging sensor(s) of the first imaging member may have a wider angle of view than the second imaging sensor of the introducer.Thus, the first imaging member may provide an enlarged and clearer image of the patient's anatomy compared to conventional devices, which may facilitate faster and more reliable AI image recognition and / or triggering of robot-assisted control and movement of the introducer using the system. Any image sensor of the image sensor(s) herein may optionally include a charge-coupled device (CCD), a CMOS sensor, and / or other suitable sensor and may be combined with any suitable optical element, such as an objective lens, etc. In some embodiments, the first and second video cameras of the first and second imaging members may have the same angle of view, while the first image sensor can still provide visualization of a larger anatomical area to the second image sensor, for example, by being maintained proximal to or behind the second image sensor as the introducer is advanced distally toward the glottic opening. Again, in some embodiments, the first video camera may have a smaller angle of view than the second video camera, but the first image sensor can still provide visualization of a larger anatomical area to the second image sensor, for example, by being maintained proximal to or behind the second image sensor as the introducer is advanced distally toward the glottic opening. Exemplary methods of use including utilizing first and second simultaneously presented video signals from the first and second video cameras are described in more detail below.
[0071]
[0142] In any of the systems herein, the first imaging member may comprise a laryngoscope, which may include a baton or other elongated member that is between about 10 cm and about 15 cm in length, but may be any size appropriate for adult and / or pediatric patient populations. As described below, the systems herein may optionally include a universal handheld housing adapted to be interchangeably used with different sized first imaging members for different patient populations (e.g., adults and children), which provides more functionality to the universal handheld housing. As shown in exemplary FIG. 2A, the exemplary laryngoscope baton 220 may generally taper in diameter as it extends outwardly from the housing 210, and / or may be gently curved or flared to accommodate the imaging components and / or provide better angulation during an intubation procedure, etc. However, the first imaging member 220 may have any suitable shape and size for use with a patient anatomy. In some examples, the first imaging member (which may include, for example, a laryngoscope baton) may be flexible and may have a curved configuration at rest, and in some examples, the first imaging member may have a straight or substantially straight configuration adapted to be bent within a cover. The first imaging member 220 may be removably or releasably coupled or integrally or permanently coupled to the housing 210 (e.g., intended for reuse). For example, the first imaging member 220 may remain sterile between uses by use of a disposable cover 260 (described further below), or may be sterilized between uses by a suitable germicide or the like. Alternatively, in some variations, the first imaging member 220 may be modular or detachable from the housing 210 (e.g., snap-fit connection, etc.), may be disposable, and / or may be swapped out and replaced by a different first imaging member 220 between different uses of the system 200.For example, the first imaging member 220 may be swapped and replaced by a different first imaging member 220 to avoid the need to sterilize the baton between uses. As another example, the first imaging member 220 may be removed to facilitate separate sterilization between uses. As another example, different first imaging members 220 may have different lengths, diameters, and / or shapes for different types of patients (e.g., adult patients, pediatric patients), whereby the first imaging member 220 may be replaced by different first imaging members 220 of different desired sizes depending on the patient and / or situation. Additionally, as described in more detail below, the cover (such as cover 260) may be appropriately sized for the dimensions of the first imaging member 220 (e.g., with the channel defining a lumen of appropriate diameter and / or length).
[0072]
[0143] Actuating Members and Introducers (e.g., Endoscopes)
[0144] In some examples, an integrated assembly or system may optionally include one or more actuating members as well as an introducer. For example, in exemplary Figures 2A-2C, device 200 may include actuating member 240 and an introducer (e.g., endoscope 250) extending from actuating member 240. In this non-limiting example, actuating member 240 and endoscope 250 may be joined or coupled together end-to-end, for example, to form a flexible member.
[0073]
[0145] Generally, the combination of actuating member 240 and endoscope 250 or other introducer may include an intubation tube, at least one image sensor 252 disposed at the distal end of the introducer 250, and a soft insertion tube (or a rigid video stylet or the like) for engaging with an articulatable distal tip of the introducer 250, which may be controllable by one or more pulling force elements, such as one or more pull wires secured to a distal region of the introducer or other suitable control mechanism(s).
[0074]
[0146] For example, the introducer (e.g., introducer 250) may include a high-resolution image sensor(s) or video clip camera module at its distal end as shown in exemplary FIG. 2A, such as a CCD or CMOS image sensor(s), an objective lens, and / or other suitable optical configuration. In an exemplary embodiment, the image sensor may be, for example, between about 2 mm and 4 mm in size and provide a wide angle of view (e.g., at least 90 degrees, at least 180 degrees, at least 270 degrees, or at least 360 degrees). One or more light guides (e.g., carrying LEDs or other illumination) may pass through the actuation member and the shaft of the introducer to provide illumination during the airway management procedure. Signal wires along the shaft of the introducer may carry image or image data from the image sensor to an image processor, which may optionally be disposed within the housing and / or display, or may be disposed within an external device. Additionally, the distal end of introducer 250 may include a bendable, articulating structure (e.g., having jointed segments) that may be controlled by angulation pull wires or tension cables or other suitable mechanism(s). Such angulation wires may control, for example, up / down and left / right steering of the articulating tip of introducer 250.
[0075]
[0147] At least a proximal end of optional actuation member 240 may be coupled to and / or located within housing 210 and controlled by one or more actuators. Actuation member 240 may advance longitudinally (e.g., at least partially out of housing 210) and retract and / or rotate back proximally along a longitudinal axis by one or more actuators 216, thus controlling the advancement, retraction, and / or rotation of introducer 250. In some variations, actuation member 240 may extend the working length of introducer 250 in that advancement of actuation member 240 allows the distal end of introducer 250 to be positioned further distally than introducer 250 could alone. Additionally, actuation member 240 may be retractable within housing 210, such as, for example, by selectable button 290 shown in FIG. 2C.
[0076]
[0148] In some variations, the actuating member 240 and the introducer 250 may be connected together, such as in a permanent manner. In other words, the actuating member 240 and the introducer may optionally be structurally and functionally integrated. Thus, in some variations, the entire flexible member, including both the actuating member 240 and the introducer 250, may remain coupled to the housing 210, and the entire flexible member (and possibly the entire device 200) may be completely sterilized between uses. In other variations, the actuating member 240 may be detachable from the housing 210, whereby the actuating member 240 and the introducer 250 may be sterilized separately from the housing 210. For example, the actuating member 240 may be releasably coupled to the housing 210 through a connector attachment, a fastener, a mechanical interfit (e.g., threads, interference fitting), nesting, or in any suitable manner. In some variations, a disposable protective sheath or other covering may be removably placed over at least the introducer 250, which may eliminate the need for full sterilization of the actuation member, introducer, and / or the entire device between uses. In other variations, the actuation member 240 with its connection to the user interface device 270 (e.g., including a guide 217 and / or a control member 274 such as a joystick, as shown in FIGS. 2C and 3) may be integrated into a single module that is removably attached to the housing 210 and actuation controls 216 (e.g., a snap-fit, "plug-and-play" connection, etc.). In another variation, the actuation controls may be included in such a module as well, fully or partially. Such an integrated module with a permanent or detachable connection to the introducer 250 may be easily removed from the housing 210 and replaced with a new instance of a similar module, and / or swapped out for a new and different module including, for example, a different actuation member 240 having a different outer diameter, length, etc.This can further allow the housing to function as a universal handheld adapted for use with different sized introducers, which may allow a single handheld housing to be used to treat different patient populations (e.g., adults and pediatrics).
[0077]
[0149] Alternatively, in some variations, any actuating member and any introducer (e.g., endoscope) herein may be detachable from one another. The actuating member and introducer may be coupled together through a connector attachment, fastener, mechanical interfit (e.g., threads, interference fit), band, nesting, or in any suitable manner. When coupled, the actuating member and introducer may function as a continuous single member. For example, introducer 250 may be removably attached from actuating member 240 or housing 210 such that it may be disposable. In this example, introducer 250 does not need to be sterilized, as it may be optionally discarded after use.
[0078]
[0150] The exterior surfaces of the actuating member and introducer may optionally be covered with a coating (e.g., a polymeric material) that provides an atraumatic, biocompatible, waterproof, smooth surface. In some embodiments, the actuating member and / or introducer may include an outer diameter that is between about 2.5 mm and about 7.0 mm. The proximal part of the actuating member (e.g., between about 0.5 cm and about 6.0 cm in length) or even the entire length of the actuating member may have a larger outer diameter as necessary to accommodate various connections to the actuator(s) and / or user interface devices within the housing in some variations (as described further below). The combined overall length of the actuating member and introducer may be, for example, between about 30 cm and about 70 cm. In some variations, the actuating member may be between about 10 cm and about 40 cm in length and the introducer may be between about 20 cm and about 30 cm in length. However, the diameter and length of the actuating member and / or introducer may vary for different applications (e.g., adult patients vs. pediatric patients, etc.). For example, device variations that may be suitable for assisting nasotracheal intubation may include longer introducers, such as between about 20 cm and about 60 cm, which may contribute to a combined overall length between the actuating member and introducer that is between about 30 cm and about 100 cm in length. Other exemplary structural aspects of the actuating member and introducer are described in further detail below.
[0079]
[0151] Actuating member
[0152] Any of the integrated systems or assemblies herein may optionally include one or more actuation members, and the disclosure that follows may apply to any actuation member herein. At least a proximal end of the exemplary actuation member 240 may be located within the housing 210 and / or the display 218. The actuation member 240 may be driven in multiple degrees of freedom to effect corresponding movement of the introducer (e.g., endoscope 250). For example, the actuation member 240 may be actuated in linear progression (back and forth along the longitudinal axis) and axial rotation (rotation about the longitudinal axis) by electromechanical coupling. Other actuations at or near the actuation member 240, such as by a guidewire as described above, may further articulate the distal end of the introducer in up and down and / or side to side tip movements.
[0080]
[0153] Collectively, the actuation member 240 and introducer may be constructed such that actuation and movement in the actuation member 240 results in the transmission of all desired degrees of freedom to the introducer. Similar to what has been described above, any suitable actuator(s) 216 and associated control system for driving the actuation member 240 may be included within the device, such as suitable drive electronics, one or more electric motors, hydraulics, pneumatics, and / or various mechanical components (assemblies, connectors, couplings, controllers, etc.). The control assemblies, connections, and couplings may be configured for smooth and precise transmission of the desired actuated mechanical motion along the introducer and the actuation member to the distal articulating tip of the introducer.
[0081]
[0154] As shown in exemplary FIG. 2A, in some variations, the actuating member 240 may move along a designated path within the housing 210. For example, as shown in FIG. 2C, the actuating member 240 may be disposed along a guide 217 within the housing 210 (or on a surface of the housing 210). The guide 217 may include, for example, a guide channel (e.g., at least about 0.5 cm to about 1.0 cm wider than the actuating member 240) or any suitable rail, track, or other guide structure. In other words, the actuating member 240 may move within the guide channel in a fully automated mode of the device when driven by one or more actuators 216 as described above. Although the guide 217 is shown as curved in FIG. 2C, it should be understood that in other variations, the guide 217 may be straight or another suitable shape that fits within the housing 210.
[0082]
[0155] 3B-3D show exemplary variations of actuators configured to move the actuating member of the present specification along the guide. FIG. 3B is a schematic diagram of an axial actuator 216a configured to move the actuating member 240 axially or longitudinally (e.g., forward and / or backward), thereby moving the introducer axially in a similar manner. For example, as shown in FIG. 3C, the axial actuator 216a may include one or more matched pairs of opposing drive wheels that engage the actuating member 240 by grooves, friction elements, and / or the like. The drive wheels (Wheel A and Wheel B) in each matched pair of drive wheels may be located on opposite sides of the actuating member 240 or introducer, such that their synchronous rotation in opposite directions urges the introducer actuating member 240 back and forth axially or longitudinally, such as along the guide 217. Other suitable mechanisms, such as slider crank systems, belt or pulley systems, plunger actuators, corkscrew mechanisms, and the like, may additionally or alternatively provide axial actuation of the actuating member 240. Additionally, as shown in Figures 3B and 3D, one or more actuator connections for the rotational actuator 216r may be coupled to an actuation member 240. The rotational actuator 216r may include one or more pull wires or other pulling force element attachments coupled to the actuation member 240 configured to control side-to-side or side-to-side movement similar to the movements described below with respect to Figure 3B. However, any other suitable mechanism, such as rollers or the like, may be used to automatically actuate the rotational movement of the actuation member 240, and thus the guiding introducer.
[0083]
[0156] Additionally or alternatively, the actuation member 240 may move within the guide 217 when driven manually, such as in a manual assist mode, such as via a user interface device 270, a touch screen, a voice command, etc. For example, as shown in FIG. 3A, a user interface device 270 (including a control member 274, such as a joystick, for example) may be coupled to the actuation member 240. The user interface device 270 may be engaged within a control member guide 272, as shown in FIGS. 2C and 3A, which may approximately follow or be parallel to the trajectory of the guide 217 for the actuation member 240. The user interface device 270, including a control member 274, such as a joystick, may be coupled to the actuation member 240 as shown in FIG. 3A via a control wire 276 attached (e.g., by fasteners, by welding, or in any other suitable manner) to connection points 278 and 279. For example, top connection 278 between control member 274 and actuation member 240 may control manual forward movement (F) when a user manually manipulates (e.g., pushes and / or pulls) control member 274 back and forth within guide 272. As another example, side connection 279 between control member 274 and actuation member 240 may control side-to-side or left-right movement (L) and (R) when a user manually manipulates (e.g., pushes side-to-side) control member 274 within guide 272. Thus, user interface device 270 may enable a manually assisted mode (e.g., manual advancement and / or rotation of actuation member 240 and thus introducer (e.g., endoscope 250), but with automated actuation of the distal articulating tip of the endoscope). These connections 278 and 279 may remain inactive in a fully automated mode.2C , selection of which may cause the device to enter a mode in which automated movement is limited to articulation of the distal tip of the introducer (e.g., endoscope 250), while linear and / or rotational endoscope movement is manually controlled (e.g., by user interface device 270) as described above. User interface element 282 may, for example, help the operator activate the manual assist mode if such a mode is desired.
[0084]
[0157] In some variations, any of the actuation members herein may be self-expanding. For example, as shown in FIG. 2A, actuation member 240' may include a self-expanding structure, such as including interlocking rings and / or helical elements that transition from a compressed state to an expanded state. Similar to that described above, actuation member 240' may be oriented along guide 217' and actuated by actuator(s) 216' and / or manually by a suitable user interface device. Although actuation member 240' is shown in FIG. 2A as being compressed within a straight guide channel, it should be understood that other shapes of guide channel may be possible.
[0085]
[0158] Additionally, at least a portion of one or more of any actuation members, any actuators, user interface devices, and / or guides may be within a module (e.g., display 218) coupled to housing 210. For example, as shown in FIG. 2A, in some variations, the proximal end of actuation member 240'' may terminate at a display, and one or more actuators 216'' similar to those described above may automatically move (axially and / or rotationally) the actuation member within guide 217'' within the display to articulate the tip of the endoscope, as described above. Additionally or alternatively, in some variations, the proximal end of actuation member 240'' may terminate at a display or module, and user interface devices similar to those described above may be used to manually move (axially and / or rotationally) actuation member 240'' within a guide within the display. Additionally or alternatively, in some variations, the proximal end of actuation member 240'' may terminate at a display, and the actuation member may self-expand in a manner similar to actuation member 240'', as described above. For example, the actuating member 240'' having a proximal portion within the display may be straight and axially aligned with the endoscope 250, such that self-expansion of the actuating member 240'' results in easier extension of the endoscope working length.
[0086]
[0159] An introducer (e.g., a flexible or rigid endoscope)
[0160] Any of the dual video integrated systems or assemblies herein may include an introducer, which is sized so that it can be used to guide the delivery of an intubation tube, such as an ETT, into the trachea. The ETT may be advanced over any of the introducers herein. Any endoscope described or shown herein may be considered merely an example of an ETT introducer. It is understood that a description of any endoscope or scope herein may be considered a description of an introducer more generally in nature, as that term is used herein. In one example herein, the introducer 250 may be an endoscope, whereby the endoscope 250 may be removably coupled (e.g., telescopically engaged) to an intubation tube for an intubation procedure. The endoscope 250 may be configured to enter and navigate within the patient's airway, serving as an introducer for ETT advancement during an intubation procedure. As explained above, the introducer may have multiple degrees of freedom at its distal end controlled by driving actuation members, including longitudinal front-to-back translation, axial side-to-side rotation, and up-down and side-to-side articulation. For example, as shown in FIG. 5, an arrangement 600 including the distal end of introducer 250 may include one or more sets of antagonist cables 62 and 63 extending from navigation wheel 61 toward distal end region 250d of introducer 250. Each set of antagonist cables may correspond to a degree of freedom for an articulating tip of introducer 250, for example.
[0087]
[0161] As shown in exemplary FIG. 6, for example, the arrangement 650 may include at least a first set 64a of antagonist cables operated by navigation wheel 61a to control left-right articulation, a second set 64b of antagonist cables operated by navigation wheel 61b to control up-down articulation, and / or a third set 64c of antagonist cables operated by navigation wheel 61c to provide pulling force on the actuation member 240. An arrangement for articulating scope tip movement may alternatively include only one or two of these sets (e.g., only set 64b of antagonist cables operated by navigation wheel 61b to control up-down articulation). The cables may be coupled to the actuation member 240, for example, by mechanical fasteners, welding, etc. The navigation wheels 61a-61c may include wheels, sprockets, rotation knobs, and / or the like. In some variations, the length of the distal tip bending section may be about 4-5 cm, and the articulation (steering) of the tip at the bending section may be between about 120 degrees and 180 degrees in all directions (up and down, left and right), and the axial rotation of the introducer may be between about 90 degrees and 180 degrees in both the right and left directions.
[0088]
[0162] In some variations, the introducer (e.g., endoscope) includes a flexible member having the optical, electrical, and mechanical functions described above, including light transmission, video capture, mechanical actuation, and distal tip articulation. Alternatively, in some variations, the introducer may include a video stylet. The stylet may have the same optical, electrical, and mechanical functions, for example, as a flexible scope member, but may be more rigid in material and / or construction (e.g., a more rigid construction including metal). In some variations, at least a portion of the stylet may be ductile. The use of a rigid video stylet instead of a flexible member may be useful in some applications where greater torsional stiffness is desired, for example, to allow better transfer of linear and rotational movement between the actuation member and the introducer, easier maneuverability around the patient's airway (e.g., obstructed glottic lesions), smoother progression during insertion and navigation within the patient's anatomy, and easier progression of the intubation tube.
[0089]
[0163] As described herein, the endoscopes herein are examples of more generalized introducers for intubation tubes, and introducers (e.g., endoscopes) may or may not include an image sensor. Thus, any description herein of a device or system that includes an endoscope or scope is understood to include introducers that may, optionally, not include an imaging sensor.
[0090]
[0164] Transition Area
[0165] Any of the integrated assemblies or systems herein may optionally include a transition region or segment between the actuation member and the introducer. The transition region may have intermediate stiffness and / or other gradual changes in structural properties to help ensure a smooth and uninterrupted transfer of actuation from the actuation member to the introducer. In some variations, the transition region may additionally or alternatively include a series of successively increasing softness segments and / or coil springs to transition from a stiffer actuation member to a softer introducer.
[0091]
[0166] Alternatively and / or additionally, in variants such as where the actuating member and introducer are removably coupled, a relatively rigid transition region (e.g., about 1-2.5 times the length of the outer diameter of the actuating member and / or introducer) may serve between the actuating member and introducer to restore continuity of electromechanical and / or other functions. The transition region may include a coupling that provides the same structural and task functionality (including uninterrupted transmission of light, video capture / analysis, and mechanical actuation, etc.) as described elsewhere in variants where the actuating member and introducer are integrally coupled. Optical / electrical functionality may be maintained between the actuating member and the endoscope using one or more appropriate mating connectors (e.g., connectors associated with respective routing PCBs), etc. Control of the distal tip may similarly be maintained through mechanical solutions such as coaxial cable connectors, push button latches, pin and socket arrangements, wire lugs, plates, pins, screws, articulating joints, etc.
[0092]
[0167] Other structural features
[0168] Any of the integrated systems or assemblies herein may include one or more structural features adapted to help prevent buckling and / or loop formation during its forward and backward travel and / or rotation along a linear axis, which helps improve smooth transfer of movement from the actuation member to the introducer. In some variations, shaft stiffness and torqueability may be increased by incorporating flat helical interlocking metal bands (e.g., bands under an outer polymeric covering) with gaps between the bands to maintain flexibility. These helical bands may be covered by fine strands of stainless steel wire or other suitable material woven into a tubular mesh and covered with an extruded polymer layer to create a smooth outer surface. Some exemplary solutions for improving travel ("pushability") and rotation ("torqueability") are described in more detail below.
[0093]
[0169] For example, the actuation member and / or introducer may be guided through some degree of continuity of physical guides, such as a guide channel (e.g., similar to an overtube environment). This guide channel may help constrain the actuation member and / or introducer and maintain the combined length taut during manipulation, thereby reducing kinks and other issues. For example, as described above, the actuation member 240 may be constrained within a guide 217 within the housing 210 and / or display 218, and the endoscope 250 may itself restrain within an intubation tube, providing a rigid guide channel for the endoscope 250. Additionally, as described below, the endoscope 250 may be constrained within an intubation tube channel 266 within the cover 260. Additionally, as described in more detail below, the overtube environment may provide an active channel through which manipulation (e.g., manual manipulation) of the intubation tube may be easily performed, even while maintaining automated robotic-assisted guidance of the endoscope.
[0094]
[0170] Additionally, the surrounding intubation tube and / or cover may help constrain the introducer in a straight path generally aligned with the patient's airway during intubation, which further reduces buckling and / or loop formation within the actuation member and / or introducer.
[0095]
[0171] Other structural features may help reduce friction. For example, the actuation members, the actuation members themselves, and / or guides for the introducer itself (such as guide 217) may be lubricated (e.g., with a long-lasting commercially available lubricant) and / or may have outer surfaces of a low-friction material to provide reduced friction during actuation of the actuation members.
[0096]
[0172] Additionally or alternatively, the actuation member may have an increased shaft stiffness, which may help prevent buckling and loop formation during its linear progression and rotation within the curved trajectory of the guide. For example, the actuation member 240 may be stiffer than the introducer 250, which may be softer and more flexible to better facilitate steering. In some variations, the shaft stiffness along the length of the combined actuation member 240 and introducer 250 may be varied by varying the outer layer material composition of the actuation member and / or introducer 250. For example, the outer base layer may include a polymer with two types of resin, and the polymer may be extruded onto a wire mesh that forms the outer structure. The stiffness may be varied by varying the composition of the combined resins, and the resulting polymer layer may further provide an atraumatic, biocompatible, and waterproof surface. The shaft stiffness may additionally or alternatively be varied by an adjustable shaft stiffening coil wire or other suitable mechanical element. In some variations, shaft stiffness may additionally or alternatively be increased in actuating member 240, causing at least a portion of actuating member 240 to have a larger outer diameter. For example, the proximal end of actuating member 240 may have a flared diameter, which may advantageously allow for an increased manipulation surface area with actuator(s) 216.
[0097]
[0173] cover
[0174] Any of the systems or assemblies herein may further include a cover (e.g., cover 260) adapted to enable and provide an integrated dual imaging enhanced visualization and navigation system adapted to be held and controlled by one hand of a single operator. The covers herein may be configured to be advanced over the patient's tongue both above the patient's epiglottis (e.g., in or near the vallecular) and below the patient's epiglottis, providing versatile placement of the cover. Additionally or alternatively, the cover may be preferentially configured for placement above or below the epiglottis. In some variations as shown in Figures 4A and 4B, the cover 260 (or any other cover such as the cover shown in Figures 17A-17G) may include a displacement member 268 configured to facilitate retraction of the patient's tongue, thereby improving pharyngeal space for improved scope movement within the airway. The displacement member may be angled, straight, curved, or otherwise shaped, for example, to be atraumatically placed within the patient's mouth. In an example variation, the displacement member may be between about 3 cm and about 4 cm wide (eg, for adult patients and appropriately smaller for pediatric patients).
[0098]
[0175] As shown in FIG. 4A, the cover may comprise two sections including a first channel (e.g., 264) and a second channel (e.g., 266). The first channel may include a lumen sized and configured to receive a first imaging member (e.g., a laryngoscope baton) therein, and the second channel may be sized and configured to releasably secure an intubation tube (e.g., an ETT) to the second channel and limit movement of the tracheal tube relative to the cover in at least one direction. The channels may optionally be form-fit to the received first imaging member and tracheal tube. The first channel 264 may be adapted to be releasably coupled, such as snapped to the housing 210 at connection 262, thereby being removably attached to the housing 210. In some variations, the first channel may be between 15 cm and 20 cm long and angled forward a distance between about 4 cm and about 6 cm from the tip in a manner and direction that will maximize views of different portions of the patient's upper airway anatomy (above the vocal cords) and glottal structures to enhance visualization and movement of the introducer. However, these dimensions may be different for covers adapted for use with pediatric patients.
[0099]
[0176] The second channel 266 is adapted to be releasably secured to an intubation tube (e.g., an ETT) that may be disposed around the introducer (e.g., a preloaded ETT). The intubation tube channel may function to provide a mechanism for secure positioning of the intubation tube near the displacement member 268. The intubation tube channel 266 may optionally be configured to be coupled (e.g., snapped) to the housing 210 at the connection 263. The intubation tube channel may further include one or more latches, clips, or other fasteners 267 to help retain the intubation tube within the intubation tube channel. In an example variation, the intubation tube channel may be between about 15 cm and about 30 cm in length for adult patients, and about half this length for pediatric patients. Various sizes (e.g., diameters) of intubation tubes may be accommodated within the intubation tube channel 266. Additionally, the second channel (the intubation tube channel) need not define an internal lumen, but rather may be partially open on its side (e.g., with a longitudinal slot) to allow for removal of the intubation tube from the cover when intubation is completed. For example, the second channel may be semicircular or comprise a cross-sectional configuration having a groove or depression formed therein (see also 1713 in FIG. 17A) that is sized and configured to be releasably secured to the ETT.
[0100]
[0177] In some examples, as shown in FIG. 4B, the intubation tube channel 266 and the first imaging member channel 264 may be detachable from each other, such as along a detachable junction area 269, optionally having one or more connectors, perforations, etc. This may be useful as one of the options to allow the laryngoscope to provide only a backup intubation option for effective video laryngoscopy, for example, when AI navigation fails or becomes problematic. For example, the intubation tube channel 266 may be detached and removed along the junction area 269, which allows the first imaging member and the remaining part of the cover 260 to be used in a traditional manual video laryngoscope intubation method, where the intubation tube is operated by an operator outside the cover 260 (it should be understood that detachment of the intubation tube channel 266 may not be required for all patients, if a pre-loaded intubation tube can be pushed into the patient's trachea through the intubation tube channel 266 of the cover 260). In another backup intubation option, the intubation tube channel 266 in the cover may be used for a combined video laryngoscopy-flexible endoscopy technique, where one operator performs video laryngoscopy and a second operator manually performs flexible endoscopy-assisted intubation. In yet another variation of the backup intubation technique, the detachable introducer 250 (or any other introducer herein) may be manually used as an intubation tube introducer to facilitate intubation tube placement in the trachea.
[0101]
[0178] At the distal end of the cover 260, the two channels 264 and 266 may terminate adjacent to each other and substantially axially aligned with each other, so that the image sensor of the first imaging member and the introducer are very close to each other. In this way, the location of the distal end of the intubation tube (optionally the coaxial and circumferential introducer 250) may be better localized to the field of view, thereby improving the ability to place the introducer 250 and the intubation tube. Furthermore, the dual channel arrangement may allow for the shortest distance of robotically controlled movement of the introducer into the glottis and into the trachea (compared to other approaches in which the introducers are advanced separately over a longer total distance), resulting in a quicker and more successful intubation on the first attempt. The dual channel cover or blade may cause the first imaging member and the introducer to assume or have a similar curvature along the length of the cover, for example, as generally shown in Figures 17C and 17D. The integrated dual image sensor systems and assemblies herein may optionally, but not necessarily, provide a predictable starting location for the image sensors relative to each other when the introducer or second imaging member (and optionally its housing) is releasably coupled to the housing. The first and second image sensors are generally adapted to be disposed or maintained at an initial distance relative to each other. As used herein, disposed or maintained at an initial distance from each other may refer to any frame of reference and may include any spacing between the two in space. For example, the image sensors may be maintained at a certain horizontal and axial distance relative to each other. In some examples, the sensors may be aligned in one frame of reference but still be maintained at a certain distance from each other with respect to a different reference point or axis. For example, in some exemplary embodiments, the first and second image sensors may be substantially axially aligned (proximal-distal) with each other and spaced apart laterally or horizontally at a certain distance from each other. In these examples, the sensors are considered to be disposed and maintained at an initial distance from each other even when axially aligned. In some exemplary embodiments, the two image sensors may be initially substantially axially aligned with each other when assembled, even if there is some minimal axial offset. The image sensors may be in close proximity to each other, and in some embodiments, the two image sensors may be maintained relative to each other such that when the second imaging member (including the introducer) is releasably coupled to the housing, the axial distance between the two sensors is at most 3 cm. The actual distance between the sensors may differ from the axial spacing between them (if an axial spacing exists) due to the natural horizontal lateral offset of the two sensors when assembled together. Once integrated into an assembly, one hand of an operator can hold the integrated system with the two image sensors disposed or maintained at an initial distance relative to each other, such as an axial distance of at most 3 cm. In some examples, the second image sensor may be initially disposed within the proximal region of the ETT, or even within the second imaging member housing, and not yet advanced into the ETT. In these examples, the assembly is still considered to be adapted to dispose the first video camera at an initial distance from the second video camera prior to actuation of the actuator.
[0102]
[0179] In some examples, the two image sensors may be maintained at a distance relative to one another when the sensors are assembled into an assembly, and at some point during use, the sensors may be axially aligned while the two sensors are disposed in the upper airway. This may occur when, after assembly, the second image sensor is initially proximal to the first image sensor at an initial distance that is maintained, and the second image sensor moves a distance distally relative to the first image sensor until it is axially aligned with the first image sensor. The two sensors in this example may be axially aligned only for a fraction of a second, for example, as the second image sensor continues to move distally.
[0103]
[0180] Exemplary methods for providing enhanced visualization and navigation of an intubation tube introducer in an airway management procedure (optionally during an intubation procedure)
[0181] The disclosure herein includes aspects related to methods of enhanced visualization, navigation, and placement of an intubation tube introducer. Figure 7 illustrates, as a flow chart, a merely exemplary method of positioning an ETT in the trachea during an intubation procedure. As shown in exemplary Figure 7, a method 700 for assisting in the performance of a robot-assisted intubation procedure may include acquiring 710 one or more images with a first imaging member (e.g., laryngoscope) or a second imaging member (e.g., endoscope) by an integrated handheld system or assembly, initializing 720 automatic guidance of an introducer (e.g., endoscope) having an actuating member, automatically guiding 730 the introducer (e.g., endoscope) by the actuating member based on the one or more images, advancing 732 an intubation tube along the introducer (e.g., endoscope), visually confirming 740 intubation tube placement, such as by an introducer image sensor, disconnecting 750 the introducer and intubation tube, and removing 760 the handheld system or assembly (including the introducer 760 and a portion of the first imaging member 710) from the patient's mouth. In some variations, the method 700 may be implemented by one or more variations of the devices described herein.
[0104]
[0182] Acquiring one or more images 710 may include one or more images acquired using one or more image sensors in an integrated system or assembly, such as by a laryngoscope (e.g., video laryngoscope) and / or endoscope that are part of the integrated system or assembly. The images may be interpreted manually, after which auto-guidance of the introducer may be initiated, for example, by a user selection of an automated mode (e.g., activating an "AI" button, such as button 280 shown in FIG. 2C) or by selection of an automated manual-assisted mode as described herein. Additionally or alternatively, the images may be interpreted by one or more processors that apply one or more suitable computer vision and / or machine learning algorithms to identify appropriate anatomical targets and automatically initiate actuated guidance of the endoscope. In some variations, initialization (720) of auto-guidance of the introducer (e.g., endoscope) may be based on one or more images acquired from the laryngoscope, while in some variations such initialization may be based on one or more images acquired from both the laryngoscope and the introducer, and in some instances such initialization may be based on one or more images acquired from the introducer only.
[0105]
[0183] As shown in exemplary FIG. 7, the method may include automatically guiding (730) an introducer (e.g., endoscope) by an actuation member in a handheld housing based on one or more images from a laryngoscope and / or endoscope. Guiding the introducer may include, for example, automatically guiding the introducer in a longitudinal back-and-forth motion and / or an axial side-to-side rotation by the actuation member. Additionally, guiding the introducer may include articulating a distal end of the introducer in at least one of several degrees of freedom including up-down and side-to-side articulation. While in some variations the introducer may be automatically guided using a robotic system utilizing suitable AI image processing techniques, additionally or alternatively the introducer may be robotically controlled manually (e.g., automated manual assist mode) using a suitable user interface device (e.g., joystick), and an actuation mechanism disposed in a handle may robotically control the movement of the introducer in response to an operator's manual interaction with the system (e.g., joystick).
[0106]
[0184] Various AI or machine learning methods may be implemented to automatically guide the introducer. For example, suitable image recognition or processing algorithms may identify anatomical landmarks in images from devices such as those described herein. AI-assisted intubation targeting of the vocal cords may utilize specialized targeting software that analyzes multiple image streams, marks and displays targets (e.g., target crosshairs), analyzes expected intubation tube navigation trajectories, identifies salient characteristics of the tracheal opening visible between the vocal cords, and / or displays this information in real time on a display screen.
[0107]
[0185] Different targeting methods have been described in the literature.One or more modules performing specific functions, including but not limited to real-time computerized image processing, recognition and mapping, visual guidance, guidance information, and interfacing with robotic intubation interface, can be used to achieve fully automated or automated manual-assisted robotic intubation.Special purpose logic circuitry such as FPGA (field programmable gate array) and / or ASIC (application-specific integrated circuit) and / or other applications can be used in methods and devices such as those described herein.
[0108]
[0186] One or more of a variety of computer vision and machine learning algorithms may be used in the present invention, including simultaneous localization and mapping (SLAM), spatial transformer module (STM) inspired techniques, deep neural networks (DNN), and convoluted neural networks (CNN).
[0109]
[0187] When performed during an intubation procedure, the method 700 may further include advancing (732) an intubation tube coupled to (disposed around) an introducer (e.g., an endoscope). The intubation tube may, for example, telescopically engage (e.g., surround) the introducer. The intubation tube may be advanced over the introducer toward the target location while the introducer is manually or automatically guided. In some variations, the intubation tube may be advanced manually. In some variations, the intubation tube may be advanced automatically using another suitable actuation system, such as the systems described herein. Additionally, in some variations, the intubation tube may be advanced manually during some portions of its travel and automatically during other portions of its travel (e.g., as desired by a user).
[0110]
[0188] Additionally, in some variations, the method may include manually advancing the intubation tube while maintaining automated guidance of the introducer. For example, a user may hold the integrated system in one hand and manually manipulate the intubation tube with the other hand (e.g., pushing the intubation tube forward on the introducer and / or rotating the intubation tube and / or introducer together as a unit) toward a location in a target image, such as an image from an introducer image sensor disposed in the trachea. Thus, in some variations, manual advancement of the intubation tube may help, for example, reduce the distance traveled by the intubation tube toward the target location, further improving intubation speed.
[0111]
[0189] Throughout the intubation procedure, images from the first and / or second imaging members may be optionally displayed to the user continuously, in real-time, or near real-time for an epoch or period of time as the introducer and intubation tube are automatically and / or manually advanced to the target location. Images, such as images from the introducer image sensor while in the trachea, may be used to immediately confirm (740) proper intubation tube placement, optionally optimal intubation tube positioning, and / or to allow immediate identification of intubation tube misplacement, and / or to allow the user to troubleshoot the intubation procedure from both above and below the vocal cords, including issues with intubation tube progression that may prompt appropriate intervention(s). For example, the first imaging sensor may be spaced proximally from the introducer image sensor to provide views and identification of a larger anatomical region, and the first imaging sensor may provide additional views of the tracheal tube movement that provide more information regarding placement than simply using the introducer image sensor alone. Once the intubation tube is visually confirmed to be properly placed within the trachea (which is typically confirmed by an introducer imaging sensor that is also placed within the trachea and below the vocal cords), the introducer may then be automatically and / or manually removed from within the intubation tube through robotic actuation (750), and the introducer may be withdrawn (760), leaving the intubation tube in place.
[0112]
[0190] EXAMPLES. Merely exemplary, non-limiting methods of implementing TI using an integrated dual video system or assembly such as that described herein are described below. It will be understood that not all steps need to be performed and that the order may be modified, where appropriate.
[0113]
[0191] 1. A disposable dual channel cover (e.g., 260) is coupled to a handheld housing (e.g., housing 210) and a laryngoscopy baton (e.g., 220) is placed inside the laryngoscopy channel of the cover. The system is powered on. 2. A disposable introducer (e.g., endoscope) is coupled directly or indirectly to the handheld housing, e.g., to an actuation member of the system. The introducer is automatically checked by the device for full functionality upon connection with the handheld housing, e.g., to an actuation member. 3. The introducer is optionally lubricated and placed inside a selected ETT. The ETT is placed inside the intubation tube channel (not necessarily an internal lumen) of the cover. 4. The user performs manual video laryngoscopy using a video laryngoscope (display screen is in default single picture mode showing laryngoscope image feed) and identifies anatomical structure(s) on the system's display. An image recognition and / or AI interface is activated and initiates automated robotic actuation of the actuation member and introducer through the actuation interface. The motion of the actuation member is fully transferred to the introducer. (Actuation may be activated manually by selecting an AI operation mode button on the housing of the device or similarly by using an automated manual assist mode). 5. Upon actuation, a split or picture-in-picture video screen feature is displayed, allowing the user to observe the TI as a whole, optionally continuously and in real-time. This display mode may be activated automatically or manually. 6. In a fully automated mode, the device automatically steers the introducer into the patient's trachea using AI or robot-assisted navigation, including forward and backward movement, axial rotation, and / or steering tip articulation. In some instances, this is performed using video data from only the first image sensor, and in some instances, this may be performed using video data from the first and second image sensors. For example, the initial movement of the introducer may be automatically based, primarily based, or solely based on video data from the first imaging sensor (which may be a video laryngoscope image sensor).7. In the automated manual assist mode, and in the manual assist mode, manual manipulation of the device with a user interface device may, for example, instantly override the fully automated mode. In the manual mode, the back and forth and / or axial rotation of the actuation member may be manually controlled and the articulation of the distal tip of the endoscope may be automated. The fully automated mode may, for example, be allowed to resume after the user presses an AI operation mode button. In the automated manual assist mode, the operator manually exerts control of the automated actuators in the system. 8. During navigation of the introducer, upon recognition of the airway anatomy, a visual indicator (e.g., a square or circle) may optionally appear on the screen around the displayed airway. The introducer articulation may move the tip towards the geometric center point of the detected glottic opening and through the vocal cords. 9. The introducer actuation around the anatomy during the TI sequence may be continuously visualized by the user, for example, by a video laryngoscopy image feed or signal displayed on the display. Visually presenting the video data from the first image sensor (e.g., video laryngoscope image sensor) on a display with a larger angle of view allows the operator / user to better troubleshoot navigation and allow manual intervention or assistance if needed. For example, while observing the video signal from the first image sensor, the user may move the entire integrated system as a unit with one hand, which may provide minor adjustments in the positioning of the integrated system. 10. The introducer may be automatically navigated around the patient's anatomy through the tracheal opening and advanced inside the patient's trachea. 11. The ETT may be manually advanced (or automatically advanced) distally out of the introducer and into the patient's trachea, allowing visual confirmation of proper ETT placement using image data from the introducer image sensor. ETT progression may be continuously observed on the display screen from both above the vocal cords (first image sensor data) and below the vocal cords (image sensor data transmission), and tracheal ETT placement is visually confirmed.Additionally, visual confirmation of tracheal ETT placement can be more closely observed by obtaining a full picture of the patient tracheal anatomy, optionally by pressing the picture-in-picture button twice on the display screen (optionally accomplished by other mechanisms, such as using a remote control, audio command, or touch screen / display). Additionally, the ETT may be optimally positioned in the trachea above the tracheal carina (not too deep, not too high). 12. The ETT can be released from the intubation tube channel 266 of the cover. The system is removed from the patient's mouth, leaving the ETT in place in the trachea. 13. The cuff of the ETT can be inflated, and manual or mechanical ventilation through the ETT is performed using a ventilation bag or an automatic ventilator. ETT tracheal placement can be optionally further confirmed by any suitable means (e.g., breath sounds, EtCO2). 14. One advantage of the integrated dual video system herein is that if the AI / robot assisted TI fails for any reason, the operator has a back-up option to terminate TI using the system only as a video laryngoscope, for example, with various conventional TI options, as described above. In embodiments where the actuating member and introducer are separable, if problems arise while advancing the ETT through the vocal cords (e.g., the ETT repeatedly "catches" on glottal structures), the introducer can be detached from the actuating member and used as a handheld introducer (endoscope) to further facilitate directing the ETT through the glottic opening.
[0114]
[0192] FIG. 15 generally illustrates an integrated dual video handheld intubation assembly (including any of the assemblies described herein) after it has been positioned within a patient's upper airway.
[0115]
[0193] 16A-16D show merely exemplary images that may be captured and / or shown on a display during any of the described intubation procedures, which may include using any of the handheld systems or assemblies herein. The disclosure that follows describes FIGS. 16A-16D in the context of exemplary benefits of the systems herein adapted to display video data or video images displayed on a display during an intubation system, as well as image data from first and second image sensors. FIG. 16A shows an image provided by a first image source disposed at a distal region of a first imaging member, such as a video camera. The epiglottis and larynx are labeled in FIG. 16A, which may optionally, but not necessarily, be a panoramic image as shown. As can be seen, it is difficult or impossible to observe the vocal cords in this image. Any of the methods herein may optionally include receiving as input data indicative of the anatomical image shown in FIG. 16A, and providing an output that initiates an automated robotically controlled movement of an introducer. In an alternative embodiment (described in the context of the exemplary modes herein), the system need not automatically control the movement, but rather the user may manually effect robotic movement of the introducer through operable communication between the disposable introducer and the housing.
[0116]
[0194] 16B shows image (e.g., video) data from a first image sensor on the left and image data from a second image sensor on the right. Image data from the first image sensor on the left provides a visualization of the introducer shown after it has been moved distally relative to its initial position, where the second image sensor (e.g., video camera) is initially maintained at a distance from the first image sensor (e.g., video camera) and relative to the first image source. As can be seen, as the introducer moves distally (and optionally rotates and / or deflects as well), the second image sensor at the distal end of the introducer is also advanced distally relative to the first image sensor. The image data captured by the first image sensor provides an image of the introducer as it is advanced (automatically and / or manually) by robotic control, as well as an image of a larger anatomical region than the image provided by the introducer image sensor, as shown. If the second image data is corrupted (e.g., by blood or secretions near the second image sensor), the image from the first image sensor can advantageously help determine where the introducer is, and may also help further facilitate continued movement of the introducer (atraumatic or manual robotic movement). Figure 16B shows the introducer after it has been robotically moved some distance toward the glottic opening and under the epiglottis, as shown.
[0117]
[0195] Figure 16C shows image data from the first and second image sensors after the introducer has been advanced through the glottic opening, with the second image sensor providing visualization of the trachea as shown in the right image of Figure 16C. The first image sensor (image data on the left of the figure) continues to show the introducer properly positioned, again a benefit of the integrated nature of the dual video intubation assembly herein.
[0118]
[0196] Figure 16D also shows image data from two image sources, showing the endotracheal tube after it has been advanced over the introducer toward, through, and into the trachea as shown. The window or opening shown in the upper left section of the right image of Figure 16D is a standard side opening in the ETT (called Murphy's eye). The generally straight feature extending from the upper right corner is the radiopaque line of the ETT indicating where the main distal opening of the ETT is.
[0119]
[0197] Some of the disclosures discussed above describe identifying or recognizing anatomical landmarks or locations within an image to aid in guiding an introducer toward, through, and into the trachea. For example, landmarks include, but are not limited to, the epiglottis, vocal cords, arytenoid cartilages, pyriform sinus, tongue, geometric center point of the glottic opening, tracheal wall (tracheal rings), areas of the image that are darker than adjacent areas, and the like. In some methods and devices herein, identifying or recognizing anatomical landmarks or locations (which may be generally described herein as image recognition) may be performed or accomplished automatically. For example, without limitation and as discussed above, image or landmark recognition may be performed using AI or image recognition software that is configured and adapted to automatically recognize certain landmarks based on one or more image or image data received while using the system. FIG. 8A shows an exemplary sequence illustrating automatic image / landmark recognition, which recognition may then facilitate robotic control and navigation of an introducer (e.g., a flexible and / or rigid endoscope), further details of which are described herein. In some methods and devices herein, identifying or recognizing anatomical landmarks may be performed or accomplished manually by medical personnel or other operator(s). For example, a physician may provide input (e.g., touch, audio, etc.) to the system to identify or recognize one or more aspects of an image displayed on a screen or display. For example, a physician may touch a touch screen at the location of a recognized vocal cord in a displayed image or where the operator would like to move the introducer thereto. FIG. 8B shows an exemplary sequence illustrating manual image / landmark recognition, which recognition may then facilitate robotic control and navigation of the endoscope, further details of which are described herein. It is understood that aspects of FIGs. 8A and 8B may be combined.For example, and without limitation, automatic recognition may occur (e.g., as part of a device mode) and manual confirmation of the automatically recognized aspects of the image (e.g., manually touching a confirmation icon on the display) may be required before endoscopic navigation is initiated.
[0120]
[0198] Any of the systems herein may include one or more processors having executable method(s) stored therein (e.g., software, firmware, algorithm(s), etc.) adapted to receive instructions or input, direct or indirect, based on user interaction with the display (optionally touch and / or audio interaction and / or haptic feedback) while the display presents at least one image (still or video). The executable method(s) may facilitate robotic control of introducer movement by an actuation member within the housing and / or a first imaging member or other member in operative communication with the introducer.
[0121]
[0199] Some of the disclosures discussed above describe robotic control of the movement of an introducer through the vocal cords and into the trachea. For example, some disclosures herein relate to automated robotic control of an introducer. FIG. 9A illustrates an exemplary sequence of image recognition (any of those shown in FIGS. 8A and 8B) followed by automated control of an introducer into the trachea (or other lumen depending on the medical procedure). For example, the automated movement of the introducer may be performed by any of the actuators and / or actuation members described herein following one or more image recognition and / or processing steps. In some cases, the automated movement of the introducer may be at least partially controlled manually, such as, but not limited to, by user movement of an actuator (which may be in operable communication with an internal housing actuator), such as a joystick, wheel, slider, or other similar actuator, to control one or more types of introducer movement. Further details regarding multiple types of optional movement controls (e.g., distal-proximal, rotation, and / or distal tip deflection) are described elsewhere herein. It will be appreciated that the example robotic control steps of Figures 9A and 9B may be combined with image processing and / or image recognition from Figures 8A and / or 8B.
[0122]
[0200] The methods, devices, and / or systems herein may not include automatic image processing and / or recognition. Alternatively, the methods, devices, and systems herein may be adapted and configured with a mode or may be used in a manner that does not include the use of automatic image processing and / or recognition. Both cases may be generally referred to herein as manual modes. FIG. 8B includes exemplary steps that may be included in a manual mode (other steps, such as any of the steps herein, may be explicitly included in the overall introducer navigation process). The introducer controls of FIG. 9A and / or 9B (or described elsewhere herein) may be included in the manual mode. In some cases, the manual mode may be initiated in response to a user action or triggering event, such as by pressing a button to initiate the manual mode or by touching a touch screen to identify a portion of the image. In some cases, any of the devices herein may default to manual mode or may not accommodate AI or other automatic image processing and / or recognition.
[0123]
[0201] As described herein, the methods, systems, and devices herein may be used or include an automated mode (although it is understood that they may have other modes or be used in other ways). The automated mode may include automated image processing or recognition (e.g., as shown in FIG. 8A) and automated robotic scope control and / or navigation (e.g., as shown in FIG. 9A), which may optionally be implemented in a continuous closed-loop manner. In some cases, the devices and methods work in the automated mode in response to user selection or initiation of the mode, such as by pressing (by way of example only) an AI button (e.g., FIG. 2C) on the handheld. In some cases, the automated mode may be the default and may function in the automated mode without user initiation being required. In some cases, the automated mode may be initiated or occur after any number of modes or steps have already occurred, such as after a manual control mode (e.g., FIG. 9B) where the user wishes to interrupt the automated mode and return to the automated mode. Any of the devices, systems, and methods herein may use or have a mode in which the automated mode continues while and as long as the medical professional continues to activate an actuator, such as a button or switch on the handheld. In these modes, the system may be adapted so that when the user stops activating the actuator (e.g., releases the button or switch), the automated scope control and / or navigation stops. By way of example only, any button on the "AI" button on the handheld may serve as this type of actuator (e.g., a deadman's switch) that, when released, may stop the automated mode. This mode may be used with any other mode or method herein.
[0124]
[0202] Any of the devices and systems herein may be adapted for a user to override or stop automated scope control / navigation by interacting with the handheld (including any display associated with the handheld). FIG. 10 (similar to FIG. 9B) shows exemplary steps involving manual robotic control at a point following the automated robotic control (other steps may of course be included). By way of example only, the operator may use a handheld housing actuator (e.g., joystick, wheel, slider, etc.) to override the automated navigation (optionally to immediately stop or pause the automated mode). User control may provide one or both of forward / backward (distal-proximal) and rotation. Some systems may be adapted such that after user interaction with the handheld (e.g., pressing an "AI" button), the automated mode is again activated. For example, in FIG. 10, after manual control, the method may again revert to automatic control, or may loop back and forth as desired by the operator or device.
[0125]
[0203] Any of the systems, devices, and methods herein may be adapted such that an operator may indicate a navigation path (or a location along the path) on the display, such as by touching a particular location on an image presented on the display, or even by using a voice command for which the system may be adapted to receive, process, and initiate events. The system may be adapted to automatically navigate to or toward that location. This is similar to FIG. 9A, where landmark recognition in this example involves indicating a location or intermediate path location (not necessarily a particular anatomical landmark).
[0126]
[0204] As shown in FIG. 9A, any of the devices and systems herein may be adapted to automatically control introducer navigation (such as by having a mode adapted to provide this functionality). By automatic image processing and / or recognition, the system may be adapted to receive image data and determine a path for the introducer (e.g., scope). By manual image recognition, the system may be adapted to process manual identification and determine a path for the scope. The on-board AI may then communicate instructions that facilitate control of the on-board actuators, thereby facilitating smart, atraumatic, AI-enabled, robot-assisted navigation of the scope into the patient's airway. The sequence may repeat in a closed-loop manner. As described above, once the scope is placed inside the patient's trachea, the operator can manually advance the tracheal tube by following the scope, using the scope as an atraumatic intubation guide, similar to a guidewire in other medical procedures. The tracheal tube progression may be visualized continuously by the operator on a display screen (handheld or fixed monitor) using a single image (which can optionally toggle between two or more images) or at least two images displayed simultaneously, optionally both from above and below the vocal cords.
[0127]
[0205] As the term laryngoscope is used herein, it is understood that the term may refer to a traditional laryngoscope, but may also refer to any type of device adapted to provide at least video imagery, and preferably (although not required) panoramic video, to an operator. Generally, these are referred to herein as first imaging members (or first elongated imaging members). The first imaging members may be manufactured and packaged coupled to a handheld housing, or the first imaging members may be releasably coupled to the housing immediately prior to the procedure by an operator or assistant. The laryngoscopes herein may generally be referred to as video guides ("VG") and optional panoramic video guides ("PVG") and any of the first imaging members, and may also include an image sensor (e.g., a video camera) at its distal end, as well as optical and electrical wiring and communication capabilities. The first imaging members may be functionally similar to the video baton of existing video laryngoscopes and may include any of its features or functions.
[0128]
[0206] It is also understood that any of the video monitors (e.g., displays) herein may be integrated into any of the handheld housings herein, or the video monitor may be a separate, free-standing video monitor as well (including being part of a detachable component that may be releasably secured to a handheld). As described herein, any of the video monitors may include a touch screen that may be adapted to respond to taps, swipes, and any other type of manual command. Any of the video monitors herein may similarly be adapted to respond to audio input (e.g., voice commands) or tactile commands. The terms display, screen, and monitor may be used interchangeably herein.
[0129]
[0207] In any of the systems herein, the introducer may be an endoscope (rigid and / or flexible), sometimes referred to simply as a scope herein. It is understood that the term is not necessarily limiting in function. In some cases, the introducer may be adapted to be robotically controlled (automatically and / or manually) and may include a flexible (optionally at least partially flexible) elongated tubular member or shaft, and one or more of an optional distal camera, electrical wiring, optional optical transmission element(s), or one or more elongated elements (e.g., pull wires) used in articulating the distal end. As described herein, the introducer may optionally be adapted to be releasably secured (indirectly or directly) to any of the housings by a coupler, the coupling creating operative robotic communication between the introducer and the handheld housing to facilitate robotic control of the introducer, which is described in more detail elsewhere herein.
[0130]
[0208] Any of the covers herein (sometimes referred to herein as blades) may include a first elongated channel adapted to receive a first imaging member therein, and the cover may also be adapted to be releasably secured to a tracheal tube to limit movement of the tracheal tube relative to the cover in at least one direction. The cover may include a separate tracheal tube lumen, or the cover may be configured with a tracheal tube stabilizer, such as one or more clips or partial channels, to which the tracheal tube may be releasably secured. The cover is generally configured such that when the tracheal tube is initially releasably secured to the cover, the position of the tracheal tube is generally maintained relative to the first imaging member channel and lumen, further details of which are set forth above.
[0131]
[0209] As described herein, the housing may be packaged with an introducer (e.g., an endoscope) or other elongated tracheal tube already attached or coupled to the housing. In an alternative example, the introducer is not packaged rigidly coupled to the housing, but is releasably secured or coupled to the housing prior to the medical procedure by the operator or assistant. In either scenario, the introducer is in operable communication with the housing to facilitate robotic control of the introducer, and optionally transmit optical data from the introducer to the housing, which may be displayed on a display as described herein. The introducer may optionally be releasably secured to a coupler on the housing, which may be any suitable component or components (including separate components such as an adapter that couples to both the handheld and the introducer) that interact or interface with the guiding introducer and are sized and configured to be releasably secured to the introducer. In this context, releasably secured refers to the ability to secure the introducer to the housing so that the two are not easily separated during normal use of the device during an intubation procedure, and may include a locking mechanism that may be further actuated to lock the introducer to the handheld. For example, the locking mechanism may include an additional step or movement of the introducer to lock the introducer in place relative to the handheld housing. FIG. 2A shows an example of an introducer 250 releasably secured to a coupler of a housing, which may be considered to include an end of an actuating member 240. In the example of FIG. 2A, the actuating member 240 (and other similar internal movable actuating members) may be considered to be a robotic extension of the introducer after the introducer is releasably secured to a coupler of the housing. That is, the actuating member and introducer may move together and may be considered part of the same movable unit, and data may be communicated from the introducer to the housing. FIG. 2C shows a further example of a housing that includes an internal movable robotic extension or actuating member.
[0132]
[0210] As shown in the example of Figure 2C, an internal movable robot extension or actuation member is disposed or positioned within the housing at least partially along and / or within guides 217. As explained above, the guides are sized and shaped to allow the actuation member to move relative to the guides, but still guide movement of the actuation member within the housing.
[0133]
[0211] FIG. 11 illustrates a further example of a robotic handheld device or assembly adapted to facilitate delivery of a tracheal tube (or other device to a different lumen, depending on the procedure) to the trachea. Any other features that can be suitably incorporated into or that can suitably modify the example of FIG. 11 may be included, even if the text is silent to its inclusion. The device or assembly 1100 includes, among other components, a handheld housing 1110, a cover or blade 1160 coupled to the handheld housing 1110, and a display 1118. In this example, the handheld housing 1110 includes a universal docking station 1130 that may be disposed within the housing. An introducer delivered to the patient's trachea (or lumen) may need to be within outer diameter limits depending on the anatomy and / or use. For example, for a pediatric patient, a scope may need to be smaller than an introducer that can be used for an adult patient. Depending on the use of the devices herein, it may be desirable to be able to releasably secure multiple introducers (soft or rigid) to a common (e.g., universal) handheld housing, which may have different outer diameters ("OD") and sizes and / or possible different relative locations of optical transmission lines within the introducers. One consideration is to ensure that an introducer, regardless of its OD and size, can be releasably secured to the handheld housing and be in operative communication with the housing (e.g., robotically movable and optionally facilitating transmission of optical (e.g., image) data). To that end, it may be advantageous for the handheld device to include a universal docking station or other universal coupler (such as station 1130 of FIG. 11 ) adapted to allow a variety of soft and rigid introducers having different ODs and sizes to be releasably secured to the handheld housing and ensure operative communication with the housing.A universal docking station or universal coupler may be adapted to be able to receive differently sized introducers (e.g., having different circular outer cross-sectional dimensions, different introducer lengths, different locations of optional optical transmission elements, etc.) In some examples, the universal docking station may include multiple adapters, each sized and configured to properly interface with a flexible / rigid introducer regardless of its OD and size.
[0134]
[0212] 11, a robotically controllable introducer 1150 is shown already coupled to a housing 1110 and a docking station 1130 that may be within the housing. Once coupled, the introducer 1150 can be moved in any of the manners described herein (e.g., distal-proximal, rotation, tip deflection in at least four different directions) by an actuator within the housing.
[0135]
[0213] FIG. 11 also shows an exemplary scope or introducer guide 1117 that is associated with or near the outer region of the housing (and may extend from the outer housing surface), for example, as compared to the inner guide 217 of FIG. 2C. FIG. 11 shows an introducer 1150 that is stably received within the guide 1117, which is disposed in this example at the top region of the housing. This location allows the introducer to be fixed and movable relative to the top of the housing, but still extend a central introducer region through the tracheal tube ETT. The guide 1117 may have a tubular configuration through which the introducer passes before being coupled to the coupler and universal docking station 1130. Alternative guide configurations may be used as well. For example, the guide 1117 may not form a complete lumen, such as when the guide has an approximately "C" cross-sectional shape, as long as the introducer is movable relative to the guide, and the guide prevents the introducer from becoming detached from the guide.
[0136]
[0214] As noted above, in some embodiments, when the introducer is directly or indirectly releasably coupled to the handheld housing (e.g., intubation procedures), the introducer may be robotically moved, including distal advancement toward the trachea. In some embodiments, the assembly is optionally adapted to allow the introducer to be robotically advanced (by automatic and / or manual robotic navigation) at least 10-12 cm past the tip of the ETT so that the introducer may be advanced to a secure position within the trachea and sufficiently deep into the patient's trachea.
[0137]
[0215] In some embodiments, the handheld assembly is configured to robotically move the introducer 5 cm to 40 cm or 5 cm to 60 cm when the introducer is operably coupled (directly or indirectly) to the housing. By way of example only, the handheld housing may be adapted to move the robotic extension (and thus the introducer) distally 5 cm to 40 cm, optionally at most 40 cm. Alternatively, with reference to FIG. 11, the assembly may optionally be capable of moving the introducer 5 cm to 40 cm distally, or 5 cm to 60 cm distally (if the assembly does not include, for example, an actuating member or robotic extension). In this disclosure, the phrases actuating member, robotic extension, and introducer (or endoscope) extension may be used interchangeably.
[0138]
[0216] The overall length of the introducer may depend on the procedure. For example, in a bronchoscopy procedure, the introducer may optionally have a length that is 50 cm to 60 cm. Additionally, not all procedures utilizing the handheld systems and assemblies herein require the use of a cover and / or first imaging member (e.g., bronchoscopy), and when used in these procedures, the first imaging member and cover may optionally be removed / detached from the handheld to remove unnecessary components and simplify the procedure.
[0139]
[0217] Any of the devices herein may include an introducer distal travel limiter adapted to prevent the introducer (or robotic extension) from moving distally more than a certain distance relative to the starting axial position. This may be done by specific feedback mechanisms from the AI and software to the structure of the assembly and the handheld, which may inherently create a distal travel limiter when the actuator and / or robotic extension structure cannot move the introducer further distally relative to the handheld housing or assembly. As such, the limiter may be considered a passive or active travel limiter.
[0140]
[0218] In some robotic handheld devices and assemblies herein, at least a portion of the robotic functionality of the device may be incorporated into components that are removable from the handheld housing, but may be releasably secured to the handheld housing prior to the procedure. This may allow, for example, some components to be more easily reused, while other components may be discarded after the procedure. This may also allow, for example, some removable components to be used with a variety of handheld devices. This may also aid and / or facilitate manufacturing of certain components. FIGS. 12 and 13 show an example assembly having removable components that include at least some robotic control functionality. FIG. 12 shows a handheld housing 1200 and a removable robotic block 1270 (also referred to herein as a removable introducer controller) that is shown releasably secured to the handheld housing 1200. Block as used in this context is not limited to any particular structure or function, but generally refers to the removable functionality of the component. In this example, removable block 1270 includes introducer coupler 1270, robotic extension or actuation member 1240 at least partially within a housing of block 1270, guide 1217 within block 1270 that allows movement of robotic extension 1240 but may include any feature of any guide herein that maintains extension 1240 within or coupled to guide 1217. Also shown is actuator 1216 that may include any of the functionality or features of any actuator of actuator herein (e.g., a motor control that moves extension 1240 and thereby moves introducer 1250).
[0141]
[0219] In this example, the handheld housing 1210 may include a block coupler 1272 (sometimes referred to herein as an introducer controller coupler) that is sized and configured to be releasably secured to a removable block. The block 1270 may similarly include any type of suitable corresponding mating structure that is sized and configured to releasably but securely interface with the block coupler 1272 on the housing 1210. The block coupler 1272 may include a variety of coupling features (e.g., press fit, male / female, etc.) that allow the block to be releasably secured to the housing 1210. Once the block 1270 is secured to the housing 1210 and the introducer 1250 is releasably secured to the introducer coupler 1222, the device may be used in any other manner described herein (e.g., image processing / recognition, scope movement, light transmission, video capture, mechanical actuation, distal tip articulation, etc.). Any of the removable "blocks" herein may also be referred to herein as an introducer controller, an introducer controller, or a second imaging member including an introducer.
[0142]
[0220] FIG. 12 also illustrates a removable cover 1260 (which may include any cover or blade features or functions described herein) having first and second channels that are releasably secured to the housing 1210.
[0143]
[0221] The handheld housing 1210 in this embodiment may include an integrated or built-in display (e.g., touch screen) 1218, which may include any feature or functionality of any display herein and may be used in accordance with any method or step described herein (e.g., manual anatomical landmark recognition). Alternatively, the system may have a display (integrated or removable) located on a side of the housing 1210 rather than on the top surface of the housing 1210 as shown in FIG.
[0144]
[0222] Aspects of the disclosure herein include optionally utilizing pre-operative information about the patient during the intubation procedure, such as pre-operative imagery (e.g., CT, X-ray, MRI, PET scan, and / or 3D reconstruction images of the airway) or video that may aid or assist in navigating during the intubation procedure. By way of example only, it may be beneficial to utilize pre-operative endoscopic video examination to improve or enhance navigation. Optionally, patient characteristics or conditions may be incorporated into the navigation procedure. For example, if the patient's illness and / or characteristics and / or conditions (all of which may be generally referred to herein as "conditions") can be described in their entirety, the operator may be able to select (e.g., from a software image library) an appropriate condition from multiple selectable conditions that matches the patient's condition(s) prior to the procedure, which the device (e.g., by AI and / or associated trained machine learning algorithms) will then take into account during the intubation procedure to further improve visualization, navigation, and ETT placement, further improving the speed, success rate, accuracy, and safety of intubation. By way of example only, such an interface may include a pull-down application menu presented on any of the displays or screens herein, including a mobile phone or computer (or voice commands to free up the use of hands), which would allow selection of personalized terms for this particular patient's medical care. For example, terms or information regarding the procedure may include "laryngeal cancer," "base of the tongue tumor," or "nasal intubation," or "airway exchange through the intubating LMA."Combinations of procedures and conditions, such as "a nasal intubation for a patient with base of the tongue tumor," may be presented or otherwise selectable as well. Image libraries may be retrieved for any of these conditions and / or procedures from the cloud or on-device software, and optionally stored on the handheld and utilized as part of the navigation.
[0145]
[0223] In some embodiments, existing patient images may be transmitted (e.g., wirelessly) and stored on the handheld device and utilized (e.g., by the AI) during navigation. By way of example, these images may include one or more of pre-operative videos, pictures of the patient's anatomy, or reconstructed images / videos from CT / X-ray / MRI / PET scans and / or other imaging studies.
[0146]
[0224] Any of the handheld devices or assemblies herein may further include a video record button (or other type of actuator) on the device to enable recording of video from either or both of the VG or scope.
[0147]
[0225] Any information (e.g., video and / or image data) from any of the procedures may also be transmitted (automatically or manually) to a central location (e.g., to the cloud). The data may be used to train AI to enhance the navigation capabilities of the system and other systems.
[0148]
[0226] Any information from any of the procedures (e.g., video and / or image data) may also be automatically (e.g., wirelessly) or manually transmitted to the patient's electronic medical record (EMR) to document the intubation procedure, for enhanced record keeping, billing, and / or education purposes.
[0149]
[0227] In any of the examples herein, a tracheal tube (e.g., ETT) may be utilized as an additional manipulation tool for the soft introducer as well. Moving the tracheal tube may be beneficial to help navigate and / or orient a scope coupled to the ETT. Rotating the tracheal tube and / or moving the tracheal tube forward (distally) may help to enhance proper introducer alignment, actuation, and progression when the introducer is automatically robotically navigated (e.g., FIG. 9A) or manually robotically navigated (e.g., FIG. 9B). For example, the tracheal tube may be moved back and forth (proximal-distal) and / or rotated axially to optimize visualization and / or navigation / movement of the introducer toward the target, improving speed of intubation and first-pass success rate. In some uses, the tracheal tube may be moved (e.g., advanced distally and / or rotated axially) before initiating an automatic introducer navigation sequence. In some uses, the tracheal tube may be moved (e.g., advanced distally and / or rotated axially) during an automated scope navigation sequence. In some examples, the assembly is adapted such that if the tracheal tube is manipulated during an automated navigation sequence (e.g., FIG. 9A), the tracheal tube manipulation automatically stops the robotic interface.
[0150]
[0228] One aspect of the disclosure herein relates to an integrated dual video system that includes an introducer guide or guide feature(s). As described herein, the device (in the handheld or removable block portion) may include an introducer guide that allows the introducer (or robotic extension) movement relative to the guide, but restricts movement to a specific or known path (e.g., restricts it within the guide and prevents the introducer from exiting the guide). As partially described above, any of the guides herein may include a guide rail for the proximal portion of the introducer (or robotic introducer extension) within or outside the device housing. Additionally, the guide may be sized and configured to prevent buckling of the proximal portion of the introducer (including the robotic extension). Additionally, the proximal region of the introducer or robotic extension may have a stiffness adapted to prevent scope buckling, which may be greater than the stiffness of the scope shaft disposed outside the housing. Additionally, any of the guides may direct the introducer to a preferred angle and / or a preferred trajectory and / or path within or outside the device housing. Additionally, as explained above, introducer guidance can be enhanced by positioning the distal region of the introducer inside the tracheal tube to keep the scope taut through frictional engagement between the introducer and the tracheal tube.
[0151]
[0229] One aspect of the disclosure relates to an introducer that, when coupled to a handheld housing (either coupled to the handheld or coupled by a removable block), is robotically movable distally, optionally at least a distance. In some merely exemplary uses, the total introducer length (with or without the robotic extension) may be about 25 cm to 70 cm. In some exemplary uses, the device is configured to allow robotic distal introducer travel of at least 5 cm, optionally 10 cm to 40 cm, e.g., 10 cm to 25 cm. This can be facilitated by movement permitted in the handheld by the robotic extension, if the system includes a robotic extension.
[0152]
[0230] In any of the embodiments herein, any introducer guide in a handheld housing may include a coating or other lubricious material (e.g., silicone) that facilitates scope movement relative to the guide and helps prevent buckling or binding.
[0153]
[0231] In any of the embodiments herein, the introducer may include one or more sensors at the distal tip to avoid excessive manipulation forces during navigation (eg, during tip deflection).
[0154]
[0232] In any of the embodiments herein, deflection or steering of the distal scope tip may be facilitated without the use of pull wires or other elongated pulling force structures, e.g., piezoelectric elements, alloys (bimetal, nitinol).
[0155]
[0233] In any of the embodiments herein, the introducer may have a varying stiffness along its length. For example, and without limitation, the introducer herein may include one or more polymeric materials (e.g., PEBAX) with varying stiffness (e.g., different durometers) along its length, optionally providing a distal tip that is softer or deflectable than the proximal region of the scope. The concept of varying stiffness of a polymeric elongate shaft is generally known, and any concept related thereto may be incorporated into the embodiments herein. For example, the robotic extension may include a polymeric material having a higher durometer than the introducer material at the distal end of the introducer. Again, by way of example only, the proximal region of the introducer (such as the region of the introducer that interfaces with the guide outside of the handheld, as shown in FIG. 11) may have a higher durometer than the distal region of the introducer to help prevent buckling during distal movement.
[0156]
[0234] An aspect of the disclosure herein is that the described devices and systems may optionally, but advantageously, be adapted and configured to be a highly user-friendly, handheld, portable, and multi-functional dual video airway management platform that can be operated with one hand of a single user. By way of example only, the handheld housing herein may be adapted to be used in a variety of different airway management procedures and / or with a variety of different introducers and / or a variety of different first imaging members (e.g., video laryngoscopes). In these embodiments, the handheld housing may be considered a universal or generic handheld housing to which a variety of different introducers and / or first imaging members may be interchangeably coupled and utilized. For example, it may be desirable to have a universal platform that can be coupled to an introducer sized for a pediatric patient as well as an introducer sized for an adult patient. Additionally or alternatively, it may be desirable to have a universal platform (e.g., the handheld housing herein) that can be used with introducers having different lengths, such as introducers that are relatively long and may be used in bronchoscopy and other airway management procedures described herein, as well as relatively short introducers that may be used in intubation or intubation-related airway management procedures. The platform technology may be similarly adapted to allow robotic control of different introducers that may be coupled to the platform regardless of the airway management procedure (medical, diagnostic, or surgical). The handheld housing herein may be adapted such that one or more of the introducer, cover or blade, or first imaging member (e.g., video laryngoscope) may be releasably coupled (directly or indirectly) to the handheld housing to provide multifunctionality. Thus, the present disclosure includes devices and systems that may be adapted to provide multifunctionality and versatility not yet observed or provided in existing medical airway management approaches.
[0157]
[0235] Additionally, the devices and systems herein may be adapted such that the introducer is temporarily or permanently removed (or simply not coupled to the housing) if it is not needed for a particular airway management procedure or portion of a procedure. For example, if the introducer is not needed for a procedure or portion of a procedure, it may not be used and, if previously coupled to the housing, may optionally be temporarily or permanently detached from the housing. Additionally, if the first imaging member is not needed for a procedure or portion of a procedure, it may not be used and, if previously coupled to the housing, may optionally be temporarily or permanently detached from the housing. Additionally, the blade may be temporarily or permanently removed or not used if it is not needed for a particular procedure or portion of a procedure (e.g., bronchoscopy).
[0158]
[0236] As such, the devices, assemblies, systems, and methods herein can be adapted and configured to be multifunctional, universal, highly easy to use, handheld, portable platforms adapted to be operated by a single user to provide a multitude of functions not observed or available with respect to existing approaches, including the ability to treat a variety of patient populations in a variety of clinical environments, as well as be used in a variety of airway management procedures, and optionally while robotically controlling the movement of the introducer (e.g., using AI, smart navigation, etc.). Additionally, the devices herein can be rapidly modified (e.g., by temporarily or permanently removing and / or reattaching the introducer or first imaging member) as needed based on the needs of the procedure.
[0159]
[0237] The disclosure herein describes several systems and devices that may be used to generate and view two images (either simultaneously on the same screen or by toggling between images), but also includes the use of the handheld assembly when only one image source is used. By way of example only, the methods and devices herein may be used without an introducer (e.g., a scope) and only with the first imaging member. For example, this may occur in situations where the introducer module malfunctions or is ineffective, such as when blood and secretions interfere in the airway. The assembly may be adapted to allow the operator to use the device as a normal video laryngoscope (or VG) while the introducer is detached or at least not in use. The assembly may have a separate mode that includes the use of video from only the first imaging member (VG).
[0160]
[0238] Another exemplary scenario in which only one video or imaging device may be used includes the use of only the introducer video while the first imaging member is detached or at least not in use. In some cases in which the first imaging member may be removed from the housing, this may include detaching the first imaging member from the housing or at least stopping the first imaging member. One exemplary scenario in airway management in which the introducer may be used without the first imaging member is in transnasal flexible endoscope intubation, including the option to later couple to the first imaging member once the endoscope reaches the oral cavity through the nose, to facilitate endoscopic manipulation. Another exemplary scenario in airway management in which the scope may be used without the first imaging member relates to the use of an endoscope to facilitate intubation through a supraglottic airway device ("SGA"), which is a small mask that is positioned inside the patient's mouth to provide ventilation / oxygenation of the lungs (when connected to a ventilator). SGAs (e.g., laryngeal mask airways, LMAs) are frequently used to stave off difficult airway situations where intubation is deemed difficult or difficult to encounter. Another exemplary scenario of airway management where an introducer can be used without a first imaging member is in diagnostic upper airway endoscopy or bronchoscopy, where the procedure may be performed through or without an indwelling tracheal tube. Another exemplary scenario of airway management where an introducer can be used without a first imaging member is to confirm proper positioning of an indwelling ETT inside a patient's trachea and / or optimize ETT positioning inside a patient's trachea. Another exemplary scenario of airway management where an introducer can be used without a first imaging member is for example, for thoracic surgery, to facilitate placement and positioning of a dual lumen tracheal tube - a special type of ETT used, the placement of which is often difficult.Another exemplary scenario for airway management in which the introducer may be used without the first imaging member is to facilitate endoscope-assisted exchange of an existing (indwelling) ETT in a patient, optionally in an operating room, ICU, emergency department, or elsewhere. Another exemplary scenario for airway management in which the introducer may be used without the first imaging member is to facilitate an extubation attempt. In any of these exemplary airway management procedures in which the introducer may be used without the first imaging member, the cover may be detached from the handheld housing (if the blade is, in fact, already coupled to the handheld housing).
[0161]
[0239] In some alternative uses, the devices or assemblies herein may be used in one or more ENT airway management procedures, such as biopsies or injections (e.g., vocal cord injections). In some alternative uses, the devices herein may be used in one or more other medical and / or surgical endoscopic procedures.
[0162]
[0240] Additionally, although applications herein relate to medical procedures, it is possible that the devices and methods herein may be used in non-medical procedures. For example, the devices herein may be used for industrial applications where an introducer may need to be "snaked" into an orifice, for example, for evaluation of machinery with poor accessibility.
[0163]
[0241] Any of the systems herein may be adapted for optional use in a manner in which a first imaging member, such as a video laryngoscope (which may be referred to herein as a VL or VG), is used and the system may not be coupled to an introducer or an introducer is not used as part of the procedure.
[0164]
[0242] Any of the systems herein may be used in such a manner that the introducer is used without the use of a first imaging member (e.g., a video laryngoscope), or the first imaging member may be detached from the handheld housing and not used in the procedure, or the first imaging member may be reattached to the handheld housing at a later point during the procedure.
[0165]
[0243] Any of the systems herein may be adapted to be coupled to multiple covers, each of the multiple covers may have at least one dimension that differs from the dimension of at least one other cover, which may allow for different size covers for children and adults, for example.
[0166]
[0244] Any of the systems herein may be adapted to be coupled to multiple introducers that may have different sizes and / or lengths, which may, for example, allow the handheld herein to be used with adults and children.
[0167]
[0245] Any of the systems herein may be adapted to be coupled to multiple deflectable introducers, which may be flexible or rigid, or may be partially flexible and partially rigid, and may have different lengths and diameters.
[0168]
[0246] Some exemplary systems or assemblies herein include an introducer (e.g., mechanical guide, flexible endoscope, rigid endoscope, etc.) that may be releasably secured to a handheld housing, whereby the handheld housing is in operable communication with the introducer when the introducer is secured to the housing, whereby the handheld housing is adapted to provide controlled movement of the introducer, and the introducer is adapted to receive and respond to such control. One aspect of the disclosure herein relates to an optionally disposable or single-use introducer that is sized and configured to be releasably secured to a handheld housing. After being releasably secured (directly or indirectly) to the handheld housing, the movement of the introducer can be controlled using the handheld housing. After the procedure is completed or at a time determined by the operator, the introducer may be released from the handheld housing and optionally discarded. The handheld housing may be used again on the same patient or after cleaning and / or sterilization.
[0169]
[0247] After the intubation system is exposed to a patient, it must generally be cleaned and sterilized to be used again on a different patient. Some systems herein may pose challenges in cleaning and / or sterilizing one or more components that facilitate the axial movement of the introducer. Thus, in some uses, it may be desirable to have a disposable or single-use introducer that can be removed after use so that the handheld housing can be cleaned, sterilized, and used with a new introducer in a subsequent use. As such, it may be desirable to utilize a disposable, yet inexpensive, introducer. Any of the introducers herein (e.g., flexible or rigid endoscopes, etc.) may be disposable and / or may be incorporated into a disposable introducer housing assembly, either of which may be sized and configured to be releasably secured to the handheld housing. The introducer housing assembly herein may generally be referred to as a second imaging member.
[0170]
[0248] 14A-14D show an example of an intubation system including an exemplary handheld housing and an exemplary introducer housing assembly (also referred to as a second imaging member) that are sized and configured such that the introducer housing assembly is releasably coupled to the handheld housing to create operative communication between the handheld housing and the introducer housing assembly. The introducer housing assembly in this context may also be referred to simply as an introducer assembly or a second imaging member. The introducer housing assembly herein may be disposable and easily released from the handheld housing as desired by the operator, such as after a procedure or in the event of introducer assembly failure. Once the introducer housing assembly is releasably secured to the handheld housing, the two components together may also be referred to as a handheld device or assembly.
[0171]
[0249] In this example, the intubation system or assembly 1400 includes a handheld housing 1410, which may include any other suitable features described herein with respect to any other handheld housing, such as a display (screen), one or more internal actuators (e.g., one or more motors), electronics, one or more computer executable methods, firmware, a microprocessor, a blade coupler, a laryngoscope, or a laryngoscope coupler, etc. In some examples, the housing 1400 may include an integrated first imaging member (e.g., a laryngoscope), and in some examples, the housing 1400 includes a laryngoscope coupler adapted to be releasably secured to a laryngoscope. In some examples, the housing 1400 is coupled to or includes a video device adapted to provide a video image, although not necessarily considered a laryngoscope. In some examples, the handheld housings herein do not include a laryngoscope or are not adapted to be coupled to a laryngoscope.
[0172]
[0250] In this example, system 1400 optionally includes a removable cover 1460, which in this example includes a first imaging member channel 1462 that defines a lumen and a tracheal tube channel 1461. Any other suitable cover features or descriptions herein (including in any claim) may be incorporated into assembly 1400 of Figures 14A-14D.
[0173]
[0251] The assembly 1400 includes an introducer assembly 1499 (which may be referred to herein as a second imaging member) including an introducer housing 1490 secured to a movable introducer 1450, the introducer housing 1490 being sized and configured to be releasably secured to a handheld housing 1410, the introducer assembly 1499 being disposable.
[0174]
[0252] In this example, the handheld housing 1410 includes a number of electrical connections (FIG. 14B) configured to be placed in electrical communication with corresponding electrical connections 1495 (FIGS. 14C and 14D) on the introducer housing, which may facilitate controlled movement of at least one type of introducer, as described below. The handheld housing 1410 electrical connections are in communication with an on-board handheld housing controller, which may be adapted to effect movement of the introducer by facilitating sending electrical signals to the electrical connections. For example, as described elsewhere herein, the on-board controller may include one or more processors and / or computer-executable methods that facilitate automated movement (e.g., by AI) of the introducer based on automatic or manual image recognition methods. Any of the suitable features of any other handheld housing herein that facilitate controlled movement of the introducer may be incorporated into the handheld housing 1410.
[0175]
[0253] In this example, the handheld housing 1410 contains one or more motors therein that are in rotational communication with or considered part of a motor coupling 1413, which may include a motor shaft that rotates when the motor rotates. In this example, the motor is adapted to, when activated, cause axial movement of the introducer, as described below.
[0176]
[0254] 14C and 14D show exemplary features of the introducer housing 1490 and the introducer 1450. In this embodiment, the introducer housing 1490 includes an electrical coupling 1495 with a plurality of electrical connects shown adapted and positioned to create electrical communication with the electrical connections of the handheld housing (FIG. 14B) when the introducer assembly 1499 is releasably secured to the handheld housing 1410. The electrical coupling between the handheld housing and the introducer housing may provide one or more types of controlled movement of the introducer. It should be noted that the electrical coupling is optional and in alternative designs, the electrical connections may be replaced with one or more motors in the handheld housing. The electrical coupling 1495 may also include connections to communicate image data from the introducer to the handheld housing.
[0177]
[0255] The introducer housing 1490 is adapted to be releasably coupled to the handheld housing, with the coupling creating operative communication between one or more controllers in the handheld housing and the introducer. In this example, the coupling creates both electrical communication and mechanical communication, but in other examples, the coupling may be only mechanical or only electrical. In this example, the mechanical coupling is adapted to control the axial movement of the introducer, and the electrical coupling is adapted to effect deflection of one or more of the articulating sections of the introducer shown in FIG. 14C, which may facilitate 360 degree deflection.
[0178]
[0256] In this example, the motor coupling includes a motor within the handheld housing that is rotatably coupled to a shaft, as shown in FIG. 14B. The motor shaft is sized and configured to be disposed within the motor coupling 1496 within the introducer housing, as shown in FIG. 14C. The motor shaft may be sized and configured to interface with an inner surface of one of the rollers 1494a or 1494b, as shown in FIG. 14D. Thus, a motor actuation drives the rotation of one of the rollers 1494a or 1494b, both of which are adapted to rotate about an axis, in this example. One end region of the introducer 1450 (optionally the end of the flexible introducer shaft) is fixed relative to the housing 1490 at location 1491, while the introducer and housing are adapted to allow the introducer to move axially relative to the housing 1490 at a region distal to location 1491. Introducer 1450 is shown disposed through aperture 1493 in housing body 1492 and through aperture 1497 in housing body 1492 .
[0179]
[0257] The handheld housing may be capable of being used with introducers of different sizes. The motor shaft may be a generic or universal drive element that may be sized and configured to fit within rollers of varying sizes, for example, depending on the dimensions of the roller and / or introducer. This is an example of how a universal handheld may be releasably secured to different introducers that may have at least one difference in size / dimension (e.g., diameter). This may allow the handheld housing to be used in children as well as with adults.
[0180]
[0258] As used herein, an introducer housing may or may not completely surround or enclose the introducer. For example, an introducer housing may have one side that is open to the surrounding environment and still be considered an introducer housing herein.
[0181]
[0259] The introducer 1450 is disposed between rollers or wheels 1494a and 1494b as shown, whereby rotation of the rollers in the opposite direction towards the introducer results in axial movement of the introducer as shown by the arrows in FIG. 14D. Rotation of the rollers in a first manner may result in distal movement, and rotation in the opposite manner may result in proximal movement. Any other disclosure herein regarding controlled axial movement (e.g., axial distance, e.g., 10-40 cm, etc.) may be incorporated into the disclosure of FIGS. 14A-14D. One or both of the rollers may have grooves or other friction interfaces similar to those shown in the top right of FIG. 14D, while in the alternative, one or more rollers may have less pronounced teeth or grooves. In the alternative, one or more of the one or more rollers may be made of a polymer, plastic to reduce the possibility of or avoid damage to the introducer shaft. The rollers may have smooth interface surfaces, or the rollers may have non-smooth interface surfaces.
[0182]
[0260] An introducer housing herein may include a body (such as housing body 1492), which may comprise one or more components, optionally two or more components, secured together (e.g., by adhesive, welding, etc.) to at least partially define the housing body;
[0261] The introducer housing assembly herein may include a plurality of electrical couplings 1495 (e.g., comprising pins and / or vias) that may each be coupled to a wire (three exemplary wires shown in FIG. 14D), each of which may extend through the introducer shaft or may be in electrical communication with a wire extending through the introducer shaft. For example, any of the wires (e.g., 4-9) may communicate a video signal from a camera (e.g., FIG. 14c) at the distal region of the introducer, or the wires may facilitate deflection control of the introducer's articulating section, such as by, for example, a shape memory material (e.g., Nitinol) or a bimetallic wire (e.g., 5-8 wires). The general concept of communicating electrical signals through wires including shape memory material to deflect the shaft has been described, and the basic concept may be used to incorporate one or more of such wires to effect deflection of the introducer's articulating section herein. For example, an electrical signal may be communicated to one or more introducer wires to transition the distal section of the introducer between shape memory states, which can be used to control deflection of the introducer in one or more directions. Any of the wires herein may similarly comprise bimetallic wires, which may similarly be used to effect deflection of the introducer by communicating a signal to and through one or more wires. An additional electrical signal may be sent to the wires to cause the distal region of the wire to change shape back to an original or undeflected or straight shape. An electrical signal may be communicated to any combination of wires to generate and effect any desired deflection or configuration of the articulating section, which may be automatically controlled, for example, by an AI. For example, deflection may be effected by changing the shape of any combination of wires within the introducer, which can be used to generate various shapes and configurations of the deflectable section of the introducer.
[0183]
[0262] 14A-14D show an example of a system that uses a mechanical coupling to control axial movement of the introducer and an electrical coupling to effect deflection of the tip distal end region of the articulating section of the introducer, an example of which is shown in FIG. 14C.
[0184]
[0263] Any of the teachings herein regarding automatic and / or manual introducer control may be incorporated into system 1400. For example, deflection of a distal region of the introducer using one or both of a shape memory material (e.g., Nitinol) or a bimetallic wire may be used to control deflection of the introducer in one or more of any of the automatic and / or manual modes herein, including partially automatic and partially manual.
[0185]
[0264] As can be seen in FIG. 14D, the axial motion (e.g., applied force) of the introducer is controlled at a location that is distal to the proximal end of the introducer shaft (which in this example is coupled to the introducer housing at location 1491). The applied force to the shaft that results in axial motion is applied at a location where the introducer shaft interfaces with a rotatable roller. Although not shown in FIG. 14A, the introducer 1450 is generally adapted to guide the progression of the tracheal tube, for which any relevant disclosure herein may be incorporated into this example. As in this example, by controlling the axial motion (e.g., applied force) of the introducer at a location closer to the tracheal tube, the axial motion of the introducer is less likely to result in buckling of the introducer. Applying a force to the introducer at a location further from the tracheal tube may, for example, increase the likelihood of introducer shaft buckling. A further exemplary advantage of controlling axial introducer movement at one or more specific locations relatively closer to the tracheal tube is that better force feedback may be provided if desired or required.
[0186]
[0265] Any of the handheld housings herein (e.g., 1410) may include an encoder on the motor to control the axial distance the introducer travels. Additionally or alternatively, any of the introducers herein may include a plurality of visual markings (e.g., axially spaced lines) on the introducer that may be used to control the axial movement of the introducer. Additionally or alternatively, any of the blades herein may include an RFID tag (or EEPROM) that may be used to control initial introducer progression and / or to communicate the blade type to the system - since the blade type may affect the first visual.
[0187]
[0266] Any of the components, which may include an introducer housing (e.g., 1490) that may be releasably secured to the handheld housing, may include an RFID tag (or EEPROM) that may be adapted to inform the system or control what type of introducer is being used, such as information related to introducer diameter, introducer length, video resolution, and / or adapted to enable and disable certain features such as reuse.
[0188]
[0267] In any of the examples herein, the introducer housing (eg, 1490) may be adapted to be releasably secured to a rear or side surface of the handheld housing (eg, 1410).
[0189]
[0268] In the embodiment of FIG. 14C, a section of the introducer, referred to in the figure as the extra loop, is shown not encased within the housing (until a portion of the introducer is fed through the housing 1490). In an alternative design, this region of the introducer may be at least partially contained or disposed within a housing, providing protection to the introducer and perhaps reducing the likelihood that an object will become entangled or snagged by the loop region of the introducer. Such a housing may be fixed relative to the housing 1490 or may be part of the housing 1490 such that the introducer moves relative to an additional loop housing. For example, this loop region of the introducer may be disposed within a cylindrical housing in fixed relationship to the housing 1490. Alternatively, the loop region of the introducer may be disposed within a helical housing or container that is fixed to the housing 1490 and the introducer can be movable relative to the helical housing to facilitate axial movement.
[0190]
[0269] In the example of Figs. 14A-14D, the deflection is provided by a wire in the introducer adapted to change shape in response to a signal communicated to the introducer. In an alternative, the deflection of the introducer may instead be driven by an additional motor coupling between the handheld housing and the introducer housing. In these alternatives, the system may include a mechanical coupling for axial movement of the introducer as well as deflection of the introducer. In these alternatives, the wire in the introducer may be in communication with one or more motors, which may be used to tension the wire and effect deflection of the steerable section of the introducer. For example, the system may include two or four motors to facilitate deflection of the deflectable section. For example, the system may include four motors to tension a pull wire (or other elongated pulling force element) to effect deflection and / or transition back to a straightened configuration. Including four additional motors may help maintain tension on the pull wires at different circumferential locations as they are tensioned to deflect the housing, which can help with backlash by reducing slack in other pull wires that were not tensioned for deflection. For example, having four motors may help maintain tension on all pull wires that were not tensioned for deflection at that particular location. Alternatively, the system may include two additional motors, which may be adapted to deflect a deflectable section of the introducer.
[0191]
[0270] Any of the introducer housings herein may also include or house a lumen therein that may be adapted as a working lumen. The housing may include one or more ports in communication with one or more lumens, for example, to allow delivery of one or more substances and / or devices into the working lumen. A schematic of the ports and lumens is shown in FIG. 14D. For example, the housing 1490 may be adapted to couple to or receive a syringe to facilitate delivery of one or more substances, such as one or more therapeutic agents. It may be beneficial to have drug delivery ports and lumens in the housing that may be disposable and may not need to be cleaned. Additionally, the ports and lumens may allow delivery of one or more other devices, such as one or more diagnostic (e.g., ultrasound imaging) and / or therapeutic devices or other medical tools. The one or more delivery ports may be on a side or area of the housing other than that shown in FIG. 14D, such as through the underside or the top side. Additionally, the general location 1491 where the introducer is secured (other secured locations 1491 may be used) may include a port through which a substance or device may be delivered. The secured location may provide more functionality and options at that location - because the introducer does not move relative to the housing at that location. Additionally, any of the introducers herein may also include a working channel or working lumen through which any devices and / or substances may be delivered or retrieved.
[0192]
[0271] As discussed above, an exemplary benefit of some embodiments herein is that the distal end of the introducer and the distal end of the first imaging member may be initially positioned within the patient as a coupled unit (e.g., both coupled to a handheld housing). This initial positioning of the introducer may allow the system to advance the introducer immediately sufficiently distally within the patient's airway and in a manner that would require a substantially shorter distance for the introducer to navigate to the desired location (e.g., laryngeal inlet). This would be the opposite of the standard situation where the introducer was not coupled to the handheld and had to be advanced distally from a starting point located further away from the desired location. For example, in some uses, the introducer as a whole may only enter its initial position when coupled to the first imaging member and assembly, approximately 2-7 cm from the desired location when inserted. The introducer may then be guided to a desired location, optionally utilizing imaging from only the first imaging member and the resulting robotic control - since the first imaging member can provide reliable and stable anatomical landmarks by viewing a larger anatomical region, even in difficult airway situations.One illustrative benefit of these examples is that the introducer and first imaging member may be coupled into a common assembly such that the fields of view of the introducer and first imaging member at least partially overlap.
[0193]
[0272] An exemplary benefit of some embodiments of the present disclosure incorporating a common handheld housing to which the introducer and first imaging member are coupled is that the overall footprint or envelope occupied by the structural device when placed within a patient may be smaller, or at least more reliably controlled, which in the case of tracheal intubation may further improve first-pass success rates, reduce intubation times, and lower the risk of injury to the patient.
[0194]
[0273] Any image processing of the image processing herein may be performed inside or outside the handheld housing. For example, image processing may be performed at least partially within a device that is outside the handheld housing, such as a computer with a graphics processing unit, a smartphone, etc. The handheld may be in communication (wired or wireless) with an external device, and optionally, information related to the acquired optical information is communicated from the handheld to the external device for processing. The external device may also be adapted to communicate information to the handheld housing to facilitate control of the introducer, which will be described in more detail herein.
[0195]
[0274] 17A-17G illustrate at least a portion of an exemplary intubation system 1700, with FIGS. 17A and 17B illustrating an unassembled view of an exemplary integrated and handheld dual video tracheal intubation assembly 1702, and this and other integrated assemblies herein may simply be referred to as assemblies. Any of the individual components of any of the assemblies herein may be assembled together prior to a procedure, thereby assembling and creating an assembly. FIGS. 17C-17E illustrate the assembled assembly 1702. The assembly 1702 includes a housing 1710 including a first imaging member coupler 1712, a second imaging member coupler 1714, and a cover coupler 1716. The housing 1702 is configured to be releasably coupled to a cover 1780, a first elongated imaging member 1730 (examples of which are shown in FIGS. 17F and 17G), and, optionally, a disposable second elongated imaging member 1740. Assembly 1702′ (which may include any suitable features of assembly 1702, and vice versa) includes a first elongated imaging member 1730 having a first coupling region sized and configured to be releasably coupled to first imaging member coupler 1712, as shown in FIGUREs 17F and 17G. First elongated imaging member 1730 includes an elongated flexible body 1732 and a first image sensor 1734 (e.g., a video camera) disposed in a distal region 1736 of elongated body 1732.
[0196]
[0275] The assembly 1702 also includes a second elongated imaging member 1740 including a second coupling region 1742 sized and configured to be releasably coupled to the second imaging member coupler 1714 of the housing 1710. The second elongated imaging member 1740 includes a flexible and navigable elongated endotracheal tube introducer 1770 ("introducer"), at least a portion of which is deflectable. The introducer 1770 is sized to be disposed within the endotracheal tube 1790 and to allow the endotracheal tube 1790 to track axially over the introducer 1770. The second imaging member 1740 includes a second image sensor 1773 (e.g., a video camera) disposed at a distal region 1772 of the introducer 1770. As described in more detail below, the introducer includes a first end or first end region fixed to the housing of the second imaging member and a movable portion that is movable relative to the housing of the second imaging member.
[0197]
[0276] The assembly 1702 also includes a cover 1780 having a cover coupling region 1782 sized and configured to be releasably coupled to the cover coupler 1716 of the housing 1710. The cover includes an elongated channel defining an elongated lumen, the elongated channel being sized and dimensioned such that when the first coupling region of the first imaging member 1730 is releasably coupled to the first imaging member coupler 1712 and when the cover coupling region 1782 is releasably coupled to the cover coupler 1716, at least a portion of the elongated body 1732 of the first imaging member 1730 is disposed within the elongated lumen.
[0198]
[0277] The cover 1780 further includes an endotracheal tube channel 1784 disposed on a side of the cover 1780 as shown, which is sized and dimensioned to interface with an endotracheal tube 1790 and limit movement of the endotracheal tube 1790 in at least one direction relative to the cover 1780. The endotracheal tube channel 1784 is further configured to allow the endotracheal tube 1790 to be moved laterally relative to the endotracheal tube channel 1784. In this example, the channel 1784 includes a recess or trough formed in a side of the cover 1780 that is sized and configured to interface with a portion of an outer wall of the endotracheal tube 1790, and in some embodiments, the channel 1784 may have a cross-sectional configuration that includes a surface that forms a partial circle for interfacing with a circular outer surface of the endotracheal tube 1790.
[0199]
[0278] The endotracheal tube 1790 includes a lumen sized to movably receive the introducer 1770 therein, as shown in FIG. 17C.
[0200]
[0279] The assembly 1720 further includes one or more actuators disposed within the housing 1710 and configured and positioned such that a second coupling region 1742 of the disposable second elongated imaging member 1740 is releasably coupled to a second imaging member coupler 1714 of the housing 1710, the actuators configured to facilitate controlled robotic movement of the introducer 1770 and the second image sensor 1772 (e.g., a video camera) relative to the first image sensor 1734 (e.g., a video camera).
[0201]
[0280] The system 1700 may also include one or more processors, which may or may not be part of the assembly. The one or more processors may be configured to receive as input information indicative of a signal received from a first image sensor (e.g., a video camera) when the first image sensor is disposed in the upper airway of a patient, and to cause communication to an actuator in the housing (e.g., the housing 1710) to control robotic movement of the introducer and the second image sensor 1772 (e.g., a video camera) relative to the first image sensor and toward one or more upper airway anatomical landmarks. Details regarding an exemplary method of use are described in more detail elsewhere herein.
[0202]
[0281] As described in more detail elsewhere herein, an exemplary advantage of the assemblies herein is that, when assembled, the assemblies are sized and configured such that when the first coupling region of the first imaging member 1730 is releasably coupled to the first imaging member coupler 1712, the second coupling region 1742 is coupled to the second imaging member coupler 1714, the cover coupling region 1782 is releasably coupled to the cover coupler 1716, and the endotracheal tube 1790 is releasably coupled to the endotracheal tube channel 1784, the assembly including the first image sensor and the second image sensor is movable as an integrated unit using one hand of the operator.
[0203]
[0282] 17C shows an assembled view of assembly 1702 with reference to a bottom view in which the first and second image sensors can be seen. The horizontal distance between the image sensors is measured in the direction labeled "H" in FIG. 17C.
[0204]
[0283] Figure 17D shows a side assembly view of assembly 1702. When the assemblies are assembled as described herein, the relative axial distance between the image sensors is measured in the axial direction "A" shown in Figure 17D. It is understood that the axial direction A depends on the orientation of the assembled assembly. For example, if the assembly of Figure 17D is rotated 90 degrees counterclockwise, the axial direction "A" will likewise be rotated 90 degrees.
[0205]
[0284] As described herein, an exemplary advantage of some assemblies herein is that some assemblies are sized and configured to be held and moved with one hand of an operator. When assembled, the relative coupling between the housing, cover, first elongated imaging member, and endotracheal tube maintains the first image sensor at a distance from the second image sensor prior to actuation of the actuator, examples of which are shown in FIGS. 17C-17E. In some uses, it may be preferable for the first and second image sensors to be axially aligned, or as close to axially aligned as possible, when the assembly is assembled. In some cases, the image sensors are axially aligned. In some cases, the image sensors are substantially axially aligned. In some cases, the first and second image sensors are maintained within 3 cm of each other in the axial direction "A" when the assembly is assembled. In any of these cases, the horizontal distance H between the first and second image sensors may be within 2 cm when the assembly is assembled. The maintained proximity of the image sensors when assembled may help to provide an overall smaller profile or footprint of the assembly, which helps make it easier and safer for a single operator to hold the dual video intubation assembly in one hand.
[0206]
[0285] 17E shows a top view of the assembled assembly 1702 where the second imaging member 1740 is coupled to the housing 1710 as shown. The first and second image sensors face down or into the page in this top view.
[0207]
[0286] 17F and 17G show an assembly 1702' that may include any of the disclosures from assembly 1702. FIGS. 17F and 17G show a first imaging member 1730 including an elongated flexible body 1732 and a first image sensor (e.g., a video camera) disposed in a distal region 1736 of the flexible body 1732. The first imaging member 1730 may be integrated into or considered a part of the cover in some embodiments, and the first imaging member and cover are releasably coupled to the housing 1710 as a subassembly. In some examples, the first imaging member 1730 may be releasably coupled to the housing prior to use separate from the cover. In some examples, the housing (e.g., housing 1710) and the first imaging member (e.g., first imaging member 1730) are an integrated unit and may not need to be coupled by an operator prior to a medical procedure. It may be advantageous to be able to remove the first imaging member from the housing and reuse the housing, such as when a differently sized first imaging member is needed for a subsequent procedure, the advantages of which are described elsewhere herein. Thus, it is understood that any of the assemblies herein may include a housing and first imaging member that are integrated, a cover and first imaging member that are integrated and coupled to the housing as one unit, or a cover and first imaging member that are separately releasably coupled to the housing. Any component of system 1702' that is not labeled or described is understood to be the same as the corresponding component or subassembly in assembly 1702.
[0208]
[0287] 18A-18J show an exemplary housing 1710. It is understood that any of the housing features described with respect to housing 1710 may be incorporated into any of the housings herein that may be part of any of the assemblies herein. Any of the labels for housing 1710 from FIGS. 17A-17G may be included in FIGS. 18A-18J even if not labeled in the figures.
[0209]
[0288] The housing 1710 includes a communication region 1720 adapted to communicate with an optionally disposable second imaging member 1740. The communication region 1720 may be configured to be in one or more of electrical, mechanical, optical, and / or video communication with the second imaging member 1740 when the second imaging member 1740 is releasably coupled to the housing 1710 (see FIGS. 17C-17E). In this example, the communication region 1720 includes a mechanical interface 1721 and a mechanical interface 1722 adapted to mechanically interface with the second imaging member 1740, as described in more detail below. In this example, the mechanical interfaces 1721 and 1722 are positioned and configured to mechanically interface with corresponding features on the second imaging member 1740 and effect deflection of the introducer via one or more pull wires or other pulling force elements, as described below. Mechanical interfaces 1721 and 1722 may be actuated by one or more motors, which may be disposed, for example, within housing 1710. A motor in this context may be considered part of a robotic control mechanism adapted to robotically control movement of the introducer, optionally in response to image processing as described elsewhere herein. A motor of this type of design may be considered to be an actuator, as that term is used herein, or one or more motors may be considered to be part of an actuator, which may refer, for example, to one or more separate components (e.g., a motor and a drive shaft, etc.) that work together as a mechanical and / or electrical system.
[0210]
[0289] The assemblies herein include one or more actuators 1761 (see FIG. 20) that facilitate (directly or indirectly) the robotically controlled movement of the introducer. The motor in the housing 1710 described in this example is an example of an actuator 1761 in the assembly. The pull wires in this exemplary embodiment are also considered to be actuators, and in this example, the pull wires are disposed in the exemplary second imaging member 1740.
[0211]
[0290] The communication region 1720 may also further include a mechanical interface 1723 positioned to mechanically interface with the second imaging member and effect or facilitate axial movement of the introducer, which is described in more detail below. One or more motors within the housing may effect the mechanical movement of the mechanical interface.
[0212]
[0291] The housing communication region 1720 optionally includes an optical sensor 1724 adapted to optically track the axial movement and / or axial position of an introducer moving axially relative to the optical sensor, as described in more detail elsewhere below. Other sensors may be used to track the axial movement and / or position of the introducer.
[0213]
[0292] The communications area 1720 also optionally includes a plurality of electrical connectors 1725 (e.g., a plurality of electrical connects) that may be adapted to interface with a plurality of corresponding connectors on the second imaging member 1740 to receive data (e.g., video camera signals) communicated from the second image sensor to the housing, which data may be processed or communicated to an external device and / or a display of the device. Exemplary image processing and robotic control (automated and / or manual robotic control) utilizing the second image sensor data are described elsewhere herein.
[0214]
[0293] 18G-18J show housing 1710 with at least one housing body component (e.g., half of a shell) removed to show example internal housing components that may be disposed within any of the housings herein. FIG. 18G is a side view of housing 1710. FIG. 18H is a bottom perspective view of housing 1710. FIG. 18I is a bottom view of housing 1710. FIG. 18J is a top perspective view of housing 1710. In this example, the housing includes a camera control unit 1801, which may be, for example, a camera control unit for any of the first image sensors herein, and may be adapted to translate raw camera signals from the first image sensor to USB. Housing 1710 further includes a second camera control unit 1802, which may be, for example, a camera control unit for any of the second image sensors herein, and may be adapted to translate raw camera signals from the second image sensor to USB. Location 1803 presents an example location for an example USB hub.
[0215]
[0294] FIG. 18G illustrates an exemplary axial drive motor 1804 (which may be referred to herein as an axial actuation mechanism), which may also include an axial drive servo and may be adapted to facilitate axial motion of the introducer herein, which will be described in more detail elsewhere herein. For example, the axial drive motor 1804 may effect rotation of the mechanical interface 1723, which will be described in more detail elsewhere herein and shown in FIG. 18J. The axial drive motor 1804 is an example of an actuator as that term is used herein (and in this example is an example of an actuator disposed within a housing). FIG. 18H illustrates merely exemplary first and second deflection (or articulation) drive motors 1805 (which may be referred to herein as an actuation mechanism), which may also include a deflection servo and may be adapted to facilitate deflection of the introducer, which will be described in more detail elsewhere herein (e.g., may tension a pull wire). For example, first and second deflection drive motors 1805 may effect rotation of mechanical interfaces 1721 and 1722, respectively, which are described in more detail herein and shown in FIG. 18J. The first and second deflection (or articulation) drive motors 1805 are examples of actuators as that term is used herein (and, in this example, are examples of actuators disposed within a housing). FIG. 18I shows an example location for a microcontroller.
[0216]
[0295] 19A-19K illustrate an exemplary second imaging member and exemplary features thereof. Although FIGS. 19A-19K are shown and described in the context of a second imaging member 1740, any suitable aspect of the second imaging member 1740 of FIGS. 19A-19K may be incorporated with any other second elongated imaging member herein, and vice versa. For example, FIG. 14A herein illustrates an exemplary system 1400 that may also be considered an integrated assembly as that term is used herein. System 1400 (or assembly 1400) of FIG. 14A includes an introducer assembly 1499 (which may also be considered to be any second imaging member of the second imaging member herein) including an introducer housing 1490 (which may also be considered to be any second imaging member housing of the second imaging member housing herein) secured to a movable introducer 1450, the introducer housing 1490 being sized and configured to be releasably secured to a handheld housing 1410 (which may also be considered to be any housing of the housing herein), and the introducer assembly 1499 may be disposable.
[0217]
[0296] FIG. 19A is a bottom view of a second imaging member 1740 including a housing 1744 and an introducer 1770. In this example, the introducer 1770 is secured to the housing 1744 at an end (or end region) of the introducer 1770 and is movable relative to the housing 1744 along a section of the introducer 1770 distal to where the introducer 1770 is secured to the housing 1744. This is similar to the introducer 1450 shown in FIGS. 14A-14D herein. The housing 1744 includes a communication region 1746 including one or more communication elements adapted to communicate with the handle when the second imaging member is releasably coupled to the housing. The communication elements may optionally be positioned and configured to communicate mechanically, electrically, video and / or optically with the handle. The communication elements may be configured to communicate information (e.g., image data) and / or operatively communicate with the handle to effect movement of the introducer in one or more directions, as described in more detail herein.
[0218]
[0297] In this exemplary embodiment, communication region 1746 of second imaging member 1740 includes mechanical interfaces 1741 and 1743 disposed relative to housing 1744 and configured to mechanically interface with mechanical interfaces 1721 and 1722 in communication region 1720 of housing 1710 (see FIG. 18C). The mechanical interfaces may include, by way of example only, geared interaction with teeth, whereby rotation of mechanical interfaces 1721 and 1722 of housing 1710 (e.g., in response to actuation of a housing motor) results in rotation of mechanical interfaces 1741 and 1743, respectively. As described in more detail below, one or more pulling force elements (e.g., one or more pull wires) may be operatively coupled to mechanical interfaces 1741 and 1743, such that rotation of interfaces 1741 and 1743 results in a pulling force on one or more pull wires, which may result in deflection of the introducer.
[0219]
[0298] In this example, communication region 1746 of second imaging member 1740 also includes a mechanical interface 1747 disposed relative to housing 1744 and configured to mechanically interface with mechanical interface 1723 in communication region 1720 of housing 1710. The mechanical interface may include, by way of example only, a geared interaction with teeth, such that rotation of mechanical interface 1723 of housing 1710 (e.g., in response to actuation of a housing motor) results in rotation of mechanical interface 1747. In this example, interface 1745 is configured to have a geared interaction with interface 1747, such that rotation of interface 1747 also results in rotation of 1745 (see FIG. 19F). The introducer passes through housing 1744 and is disposed between rotatable mechanical interfaces 1747 and 1745 such that rotation thereof effects axial translation (distal or proximal) of introducer 1770, Figure 19A shows an axial direction "A" indicating axial movement of introducer 1770 relative to housing 1744. Further details of communication region 1746 are described below.
[0220]
[0299] FIG. 19B shows a top of the second imaging member 1740 including the endotracheal tube coupler 1750. FIG. 19C shows a side view of the second imaging member 1740. FIG. 19C shows an introducer having a curved configuration. When one or more system or assembly components are described herein as having a length, the length generally refers to the length along the component (e.g., from a first end or location of the component to a second end or location). For example, the introducer of FIG. 19C may have a length that extends from a first end secured to the housing 1742 to the most distal end of the introducer, and the length of the introducer in this example may be measured from the first fixed end to the second end along the length of the introducer itself, even if one or more curved regions are present.
[0221]
[0300] 19D and 19E show end views of the second imaging member 1740. FIG.
[0222]
[0301] FIG. 19F illustrates a top view of an exemplary second imaging member 1740 with a top surface layer of the housing removed to show exemplary internal components within a communication region 1746 of the housing 1744. The view of FIG. 19F is the same view as FIG. 19B, but with a portion of the housing removed to show the internal components of the housing 1744. FIG. 19A illustrates a bottom view of the second imaging member 1740. FIG. 19F illustrates an exemplary geared interface between the rotatable interfaces 1745 and 1747, as described above. The mechanical interface 1747 may interface with a rotational interface 1723 in the handle, such that rotation of the rotational interface 1723 (e.g., driven by a motor) results in rotation of the mechanical interface 1747. The exemplary geared interface between interfaces 1745 and 1747 causes interface 1745 to rotate in a direction opposite to the rotation of interface 1747, which causes axial movement of introducer 1770 disposed between interfaces 1745 and 1747. The geared relationship between interfaces 1745 and 1747 may amplify the force on the introducer and help prevent slippage during axial movement of the introducer.
[0223]
[0302] In some embodiments, for example, an additional gear similar to an idler gear may be added to the handle in communication with the rotating interface 1723 (driven by a motor) to actively drive both rotatable interfaces 1745 and 1747.
[0224]
[0303] FIG. 19F also shows a number of electrical connectors 1749 disposed and configured within the housing to interface with the electrical connector 1725 in the handle and which may communicate image data from an image sensor at the distal end of the introducer to the housing 1710, which will be described in more detail herein.
[0225]
[0304] 19F also shows a window or opening 1748 aligned with and adjacent to a section of the introducer 1770 as shown. The window 1748 is positioned to align with a sensor 1724 (e.g., an optical sensor) within the housing such that the housing sensor can track the movement or position of the introducer as it moves in the axial direction "A". The introducer may have one or more markers on its outer surface to facilitate position tracking or sensing by the housing sensor 1724. The housing sensor 1724 may communicate sensing information to a processor (directly or indirectly) to track the axial movement and / or position of the introducer.
[0226]
[0305] Figure 19F also shows mechanical interfaces 1741 and 1743 positioned and configured to interface with mechanical interfaces 1721 and 1722 in housing 1710. In this example, mechanical interfaces 1741 and 1743 rotate in response to rotation of mechanical interfaces 1721 and 1722 in housing 1710, which in this example is used to effect deflection of a distal region or tip of the introducer in multiple directions (up, down, left, right, or one or more of a combination thereof). Figure 19F shows just one example of using first and second motors in housing 1710 to effect rotation of interfaces 1741 and 1743, respectively. In this example, interfaces 1741 and 1743 may be coupled to first and second pull wires, respectively, such that when the interfaces are rotated in a first direction, one of the pull wires is tensioned to effect deflection of the introducer distal tip, and when rotated in the opposite direction, the second pull wire is tensioned to effect deflection in a different direction (e.g., 180 degrees relative to the first direction). In one example, rotation of interface 1741 can effect deflection of the introducer in a first plane (each direction 180 degrees relative to the other direction, e.g., left and right), and rotation of interface 1743 can effect deflection of the introducer in a second plane transverse to the first plane (each direction 180 degrees relative to the other direction, e.g., up and down). Interfaces 1741 and 1743 may be separately controlled, such as by different motors within a housing, both in response to robotic control of introducer movement (automated and / or manual robotic control).
[0227]
[0306] 19F example, pull wires (e.g., exemplary and illustrative first and second pull wires 1757 are shown for clarity) may be attached to interfaces 1741 and 1743 at locations 1754 and 1753 using any of a variety of fastening techniques or mechanisms. The pull wires extend from interfaces 1741 and 1743 through pull wire channels generally labeled 1752 and then into introducer 1770. The pull wires may extend through the introducer using existing pull wire routing techniques and approaches and are fastened to a distal region of the introducer to effect deflection of the distal tip of the introducer.
[0228]
[0307] In any alternative, the housing motor may be in operable communication with only one pull wire. For example, in a variation to that shown in FIG. 19F, the housing 1710 may contain four motors therein, each of which pulls an individual pull wire taut.
[0229]
[0308] 19G-19K show an exemplary second imaging member housing, it being understood that any second imaging member housing herein may include any of the exemplary features of the exemplary housing 1744 shown in FIGS. 19G-19K, and vice versa. FIG. 19G is a bottom perspective view of the housing 1744. FIG. 19H is a bottom view of the housing 1744. FIG. 19I is a top perspective view of the housing 1744. FIG. 19J is a front end of the housing 1744, showing first and second windows 1755 and 1756 through which the introducer 1770 extends. FIG. 19K shows a rear end view of the housing 1744 including the endotracheal tube coupler 1750. As discussed herein, a first end of the end region of the introducer may be secured within the housing 1710, and in FIG. 19F, a first end of the introducer 1770 is secured to an element 1751 within the housing 1751. From element 1751, introducer 1770 extends out of the housing through housing opening or window 1756 (see FIG. 19J). Introducer 1770 then forms a loop configuration as shown (e.g., 17B, 17C, 17E, 17G, 19A, 19B, 19E) and then extends back into the housing through housing opening or window 1755 (see FIG. 19J). The introducer then extends through optional endotracheal coupler 1750 in housing 1744, as can be seen in FIG. 19F.
[0230]
[0309] As shown, the housing 1744, in this example, has a generally rectangular configuration (and in this example, the housing 1744 has a generally square configuration) with a width and height that are both greater than the thickness measured from top to bottom. The corresponding mating area of the housing 1710 has a similar rectangular configuration, as shown in the unassembled view of FIG. 17B.
[0231]
[0310] The second imaging member 1740 includes an endotracheal tube coupler 1750, which in this example has a circular cross-section and a cylindrical configuration. As shown in Figure 17A, the endotracheal tube has a first end with a coupler region 1791 shown that is dimensioned and sized to interface with the endotracheal tube coupler 1750 on the housing 1744 of the second imaging member 1740. The endotracheal tube 1790 also has a lumen that is sized to receive an introducer therein when the coupler region 1791 interfaces with the endotracheal tube coupler 1750 of the housing 1744 as shown in Figure 17C.
[0232]
[0311] As shown in FIG. 17A, the body 1711 of the housing 1710 also includes a side endotracheal tube channel 1713 that is positioned and configured such that when the cover 1780 is releasably secured to the housing 1710, the channel 1713 of the housing 1710 and the channel 1784 in the cover form a continuous channel for the endotracheal tube, as shown in FIG. 17D. In this context, the term continuous includes some minimum axial gap (e.g., 0.01 cm to 2 cm) between the two channels when the cover 1780 is coupled to the housing 1710, so long as the endotracheal tube 1790 can interface with the housing channel 1713 and the cover channel 1784. Both channels 1713 and 1784 are open on one side to allow the endotracheal tube to be removed from the channel by removing the channel laterally or horizontally from the endotracheal tube.
[0233]
[0312] While the housing (or housing 1710) or integrated handheld assembly herein may include one or more processors, in some embodiments data may be communicated to components not integrated into the assembly where image processing occurs, such as, for example, an external computer and / or a system display. Any type of connection may be used for data transfer, such as a USB interface.
[0234]
[0313] Any of the assemblies may also include one or more microcontrollers that may optionally be disposed within the housing (e.g., housing 1710). Any of the assemblies may also include one or more motor interfaces (e.g., part of the robotic control of introducer movement) that may optionally be disposed within the housing (e.g., housing 1710). Any of the assemblies herein may also include an electronics control board that may provide power to one or more motors, optionally disposed within the housing, during robotic controlled movement of the introducer.
[0235]
[0314] As shown in FIG. 17D (in combination with FIG. 17C), the first and second image sensors (e.g., video cameras) are maintained at an axial distance relative to each other when the assembly is assembled. In FIG. 17D, the axial locations of the first and second image sensors are labeled L, and in this embodiment, the image sensors are within 3 cm of each other axially, and may also be optionally axially aligned. The image sensors are at most 2 cm horizontal distance "H" (see FIG. 17C) from each other. Thus, when assembled, the first and second image sensors are maintained at a relatively close distance (both axially and horizontally) to each other, the advantages of which are described herein. As such, assembly 1702 is an example of an integrated and handheld dual video tracheal intubation assembly configured such that when the first imaging member is coupled to the housing, when the second imaging member is coupled to the housing, when the cover is releasably coupled to the housing, and when the endotracheal tube is releasably coupled to the assembly, the assembly maintains the first image sensor at a distance from the second image sensor prior to actuation of the actuator, examples of which are shown in Figures 17C and 17D. In this example, the lengths and configurations of the endotracheal tube, introducer, cover, soft body 1732 of first imaging member 1730, and body 1711 of housing 1710 (together and individually) allow and cause the first and second image sensors to be at a maintained distance from one another, while contributing to the overall small profile and footprint of the assembly, which allows it to be held, moved, and manipulated with one hand of an operator.
[0236]
[0315] Assembly 1702 is an example of an assembly that can be used in tracheal intubation. One advantage is that the first and second image sensors are maintained at a relatively close axial distance when the assembly is assembled (e.g., no more than 3 cm, and optionally axially aligned). When in use, the introducer generally needs to be able to be moved axially approximately 3-5 cm by robotic control to move the introducer to or toward the glottic opening. The assembly is similarly adapted to be able to move the introducer axially through the glottic opening and into the trachea. Thus, the assembly herein can provide axial movement of the introducer and the second image sensor that is at least 3 cm relative to the first image sensor that is maintained in the upper airway when in use for tracheal intubation by robotic control.
[0237]
[0316] The assemblies herein may include a distal travel limiter configured to limit distal travel of the introducer relative to an initial position and relative to the first image sensor. For example, the assembly 1720 may include a distal travel limiter configured to limit distal travel of the introducer 1770 relative to an initial position (e.g., as shown in FIGS. 17C and 17D) and relative to the first image sensor of the first imaging member 1730. In this example, the first end of the introducer is fixed to the housing 1744 as shown in FIG. 19F, while the introducer is allowed to be moved axially by robotic control via an axial movement mechanism internal to the housing 1744 (e.g., including mechanical interfaces 1745 and 1747). By fixing the first end of the introducer 1770, there is a limit as to how far the introducer 1770 may be advanced distally in this example. The length of the introducer outside of the housing 1744 between openings 1755 and 1756 in the housing 1744 can also affect how far the introducer may be advanced distally and therefore may be considered part of or affect the distal travel limiter. For example, if the length of introducer 1770 outside of the housing 1744 and between openings 1755 and 1756 is too short, the distal travel limiter will prevent movement of the introducer too far distally relative to the housing 1744.
[0238]
[0317] 20 illustrates an exemplary integrated and handheld dual video assembly 2002 that may incorporate any and all aspects of assembly 1702 and assembly 1702'. Assembly 2002 includes a housing 2010 that may incorporate any and all aspects of any of the housings herein (e.g., housing 1710). Assembly 2002 includes a cover 2080 that may incorporate any and all aspects of any of the covers herein (e.g., cover 1780). Assembly 2002 includes an optionally disposable second imaging member 2040 that may incorporate any and all aspects of any of the second imaging members herein (e.g., second imaging member 1740). Assembly 2002 includes an endotracheal tube 2090 that may incorporate any and all aspects of any of the ETTs herein (e.g., endotracheal tube 1790). Assembly 2002 includes one or more actuators 2061, which may incorporate any and all aspects of any of the actuators of the actuators herein (e.g., one or more actuators 1761 (which may be, for example, in housing 2010 and / or in second imaging member 2040)). Any of the assemblies of the present specification (e.g., 1702, 1702') may be generalized as shown in the schematic diagram of FIG.
[0239]
[0318] It is understood that any description including features and methods of use related to assembly 1702 may be integrated with assembly 1702' and vice versa.
[0240]
[0319] 21 illustrates an exemplary method of using any of the assemblies herein. In the illustrated method, an assembled assembly (e.g., assembly 1702) is positioned in a patient's upper airway at step 2110 (e.g., as shown in FIG. 15). The method may include having a processor of the system receive a signal indicative of image data from a first image sensor (e.g., a video camera) of the assembly at step 2120. The method may include processing the signal indicative of the data from the first image sensor at step 2130. The method may include initiating automated or manual robotically controlled movement of an introducer of the assembly away from a first image source of the assembly and toward at least one upper airway anatomical landmark in response to the processing step while maintaining the first image sensor in the upper airway at step 2140. The method may also include, at step 2150, moving the introducer into the endotracheal tube and through the glottic opening and into the trachea while at least a portion of the cover of the assembly and the first image sensor remain in the upper airway and while the first image sensor receives video data from the first image sensor during the automated movement of the introducer. Any additional method steps may be incorporated into the exemplary method shown in FIG.
[0241]
[0320] Any of the second elongate imaging members (e.g., 1740) may also be referred to herein as a cartridge in that the cartridge may be releasably secured to the housing (e.g., housing 1710).
[0242]
[0321] In a variation on some embodiments of the invention, the system is adapted to allow a remote operator to remotely control the robotically controlled movement of the introducer herein. For example, a first operator would be with, for example, a patient and would place the assembly in the patient's upper airway. The first operator would initiate operation of the first and / or second image sensors. Image data could be communicated (e.g., wirelessly) to a remote location where a second operator could remotely control the introducer (e.g., using a workstation). The second operator could have a display showing video data from the first and / or second image sensors. This type of remote control arrangement could provide the benefits of the integrated dual video intubation assembly herein, except that the first operator would be directly handling the assembly in these examples.
[0243]
[0322] Any of the processors herein may have stored thereon any number of computer-executable methods (e.g., software, algorithms), which may be adapted, alone or in combination, to receive one or more inputs, which may be indicative of image or video data from one or more image sensors herein, and determine or contribute to determining a path for the introducer in any number of directions, where determining a path may include effecting movement of the introducer such that the introducer moves to or toward one or more anatomical landmarks. This type of determining or planning may be referred to herein as navigating or part of a navigation process.
[0244]
[0323] It is understood that any feature, component, or method step described herein in one example may be incorporated in any other suitable example herein, unless the description indicates to the contrary. For example, any feature or method of use in any embodiment or aspect herein may be included with or incorporated in any other suitable embodiment or aspect herein.
[0245]
[0324] The above description, for purposes of explanation, used specific terms to provide a thorough understanding of the inventions herein. However, it will be apparent to one skilled in the art that specific details may not be required to practice one or more of the inventions herein. Thus, the above descriptions of specific embodiments of the inventions herein are presented for purposes of illustration and description.
[0246]
[0325] Even if not specifically indicated, one or more techniques or methods described in this disclosure may optionally be implemented at least in part in hardware, software, firmware, or any combination thereof. For example, various aspects of the techniques or components may be implemented in one or more processors, including one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), or the like, alone or in any suitable combination. The term "processor" or "processing circuitry" may generally refer to any of the circuitry described above alone or in combination with other circuitry or any other equivalent circuitry. Such hardware, software, or firmware may be implemented in the same device or in separate devices to support various operations and functions described in this disclosure. Furthermore, any of the units, modules, or components described may be implemented together or separately as discrete but interoperable logic devices. The depiction of different features as modules or units is intended to emphasize different functional aspects and does not necessarily imply that such modules or units must be realized by separate hardware or software components. Rather, functionality associated with one or more modules or units may be performed by separate hardware or software components or may be integrated within a common or separate hardware or software component.When implemented in software, functionality attributed to the systems, devices, and techniques described in this disclosure may optionally be embodied as instructions on a computer-readable medium, such as, for example, a random access memory (RAM), a read-only memory (ROM), a non-volatile RAM (NVRAM), an electrically erasable programmable ROM (EEPROM), a flash memory, and the like. The instructions (e.g., methods) may be executed by a processor to support one or more aspects of the functionality described in this disclosure.
[0247]
[0326] Further examples
[0327] A first further example is an integrated device for robotically assisting in airway management (e.g., intubation) of a patient, the integrated device comprising: a handheld housing; a laryngoscope coupled to the housing and having a first image sensor; an actuating member movable within the housing; an endoscope extending from the actuating member, the endoscope having a second image sensor and configured to be removably coupled to an intubation tube; and at least one actuator within the housing configured to automatically guide the endoscope by the actuating member based at least in part on one or more images from at least one of the first image sensor and the second image sensor.
[0248]
[0328] In this example, the device may further comprise a cover coupled to the housing, the cover comprising a first channel configured to receive a laryngoscope and a second channel configured to receive at least a portion of an endoscope. The cover may comprise a first portion comprising the first channel and a second portion comprising the second channel, the first and second portions being removably coupled. The cover may comprise a displacement member configured to retract the patient's tongue during an intubation procedure. The displacement member may be angled or curved. The cover may be configured to be advanced over the patient's tongue both within or near the patient's vallecula and below the patient's epiglottis. The distal end of the first channel and the distal end of the second channel may be adjacent and substantially parallel. The cover may be removably coupled to the housing.
[0249]
[0329] In this example, at least one of the first image sensor and the second image sensor may provide an observation angle of at least 40 degrees in both the axial and horizontal planes. The observation angle may be between about 40 degrees and about 180 degrees in both the axial and horizontal planes. The observation angle may be between about 40 degrees and about 360 degrees in both the axial and horizontal planes.
[0250]
[0330] This example may further include a video monitor configured to display at least one image from the first image sensor, the second image sensor, or both. The video monitor may be configured to display the images from the first image sensor and the second image sensor in a split screen or picture-in-picture arrangement.
[0251]
[0331] In this example, the actuation member may be axially extendable. The actuation member may comprise one or more connecting rings or one or more helical elements.
[0252]
[0332] In this example, the actuating member may be movable within the guide. At least a portion of the guide may be within the housing. At least a portion of the guide may be within a video monitor coupled to the housing. At least a portion of the guide may be curved. The guide may be straight. The at least one actuator may be configured to automatically guide the actuating member within the guide. The actuating member may be manually movable within the guide. This example may further include a user input device aligned with the guide, the user input device coupled to the actuating member to enable manual control of movement of the actuating member within the guide. The actuating member may be longitudinally translatable within the guide, thereby longitudinally advancing and retracting the endoscope. The at least one actuator may be configured to automatically articulate the distal end of the endoscope. The at least one actuator may be configured to articulate the distal end of the endoscope in a first plane.
[0253]
[0333] This example may further comprise at least one processor configured to process images acquired by at least one of the first image sensor or the second image sensor. The at least one processor may be configured to process the one or more images by identifying at least one recognizable anatomical feature. The at least one processor may be configured to identify the at least one recognizable anatomical feature by applying a trained machine learning algorithm to the one or more images. The at least one processor may be configured to control at least one actuator to automatically guide the endoscope towards the at least one recognizable anatomical feature. The at least one processor may be configured to initiate control of the at least one actuator based on one or more images from the laryngoscope. The at least one processor may be configured to automatically guide the endoscope towards the at least one anatomical feature based on one or more images from the laryngoscope, one or more images from the endoscope, or both. The at least one processor may be configured to initiate control of the at least one actuator based on one or more images from the endoscope.
[0254]
[0334] In this example, the endoscope may be removably coupled to the actuation member.
[0255]
[0335] In this example, the actuation member may be reusable and the endoscope may be disposable.
[0256]
[0336] In this example, the endoscope may be integrally formed with the actuation member.
[0257]
[0337] In this example, the distal end of the actuation member may be axially aligned with the proximal end of the endoscope.
[0258]
[0338] In this example, the endoscope comprises a flexible member, however, the endoscope may also comprise a rigid stylet having a deflectable distal end.
[0259]
[0339] In this example, the device is operable by a single user.
[0260]
[0340] In this example, the actuation member may be between about 10 cm and about 40 cm in length.
[0261]
[0341] In this example, the endoscope may be between about 20 cm and about 30 cm in length.
[0262]
[0342] In this example, the endoscope may be between about 20 cm and about 60 cm in length.
[0263]
[0343] In this example, the device may be configured for use with adult or pediatric patients.
[0264]
[0344] In this example, the intubation tube may be an endotracheal tube.
[0265]
[0345] In this example, the device may be configured for oral tracheal intubation, or the device may be configured to assist in nasotracheal intubation.
[0346] A second further example is an integrated robotic device adapted for airway management, the integrated robotic device comprising: a handheld housing; a laryngoscope coupled to the housing and having a first image sensor; an actuation member movable within the housing and couplable to an introducer having a second image sensor; and at least one actuator within the housing configured to automatically move the actuation member based at least in part on one or more images from at least one of the first image sensor and the second image sensor.
[0266]
[0347] A third further example is an integrated robotic device adapted for airway management, the integrated robotic device comprising: a handheld housing; an actuating member movable within the housing and coupleable to an introducer comprising an image sensor; and at least one actuator within the housing configured to automatically move the actuating member based at least in part on one or more images from the image sensor.
[0267]
[0348] In some embodiments, navigation of the introducer scope (second imaging member) may be aided by visualization through the laryngoscope (first image sensor) to navigate the introducer scope manually or automatically by a processor. For example, the outer shaft of the introducer scope may include one or more markings or indicators, which may be visible to the first image sensor of the laryngoscope during the procedure. These indicators may indicate the distance from the distal tip of the introducer scope and therefore how far the introducer scope has advanced into the anatomy (or beyond the laryngoscope). This may be useful to prevent the introducer scope from advancing too far or not advancing far enough, which may prevent misplacement of the introducer scope and ultimately the ETT.
[0268]
[0349] In some embodiments, indicators on the introducer scope may indicate a flexible or deflectable zone of the introducer scope (e.g., one or more indicators may be disposed on the shaft and may indicate the location and / or position of a flexible or deflectable zone of the introducer scope).
[0269]
[0350] In some embodiments, the indicator(s) may include one or more bands or dots or markings, which may be black or colored. Different colors, thicknesses, symbols, numbers may be incorporated into the indicators to help distinguish different segments or areas along the length of the introducer scope. The indicator(s) herein may include a combination of different types of indicators on the introducer scope shaft, such that (for example, without limitation) one or more of the indicators may be colored, while one or more other indicators may be symbols.
[0270]
[0351] In some embodiments, light may be used as an indicator.
[0271]
[0352] The indicator may span 360 degrees around the introducer scope shaft or may span only a portion of a circle. By way of example only, the indicator may span or extend 360 degrees around the introducer scope shaft, while in other examples the indicator may span or extend 180 degrees or 90 degrees around the introducer scope shaft.
[0272]
[0353] The outer shaft of the introducer scope may additionally or alternatively be bright or reflective to aid in its visualization during the procedure. By way of example only, the introducer scope shaft may include one or more reflective materials that help reflect light, at least to some extent, during the procedure.
[0273]
[0354] Figure 22 shows an example of an image from a laryngoscope, showing the epiglottis as well as the shaft of an introducer scope 2202. This view is a line drawing representation of the left half of Figure 16C.
[0274]
[0355] FIG. 23 shows an example of an introducer scope having multiple band indicators that may be used to indicate and / or determine the distance the introducer scope has traveled.
[0275]
[0356] FIG. 24 shows an example of an introducer scope having multiple band indicators with varying distances between the indicators (i.e., not equally spaced) to indicate the distance the introducer scope has advanced. Note that band spacing or spacing 2402 is narrower than band spacing or spacing 2404. These spacings may become narrower or wider away from the distal tip of the introducer scope. Spacing may vary in other ways, such as dual bands every centimeter. Additionally or alternatively, one or more characteristics of the bands may be different. For example, only the band thickness (or other dimension) may vary along the length of the introducer scope shaft.
[0276]
[0357] FIG. 25 shows an example of an introducer scope having multiple light indicators. One or more rows of lights may extend or extend (e.g., axially) along the distal tip of the introducer scope as shown in exemplary FIG. 25. Additionally or alternatively, one or more bands of light may surround (extend circumferentially around) the introducer scope. The lights may be adapted to be solid or flashing and may be white or colored. More than one type of indicator may be present on any embodiment of an introducer scope shaft herein.
[0277]
[0358] In some instances, visualization from the introducer scope may be obscured or unavailable. Some embodiments include features to aid in navigating the introducer scope without direct visualization through the introducer scope. However, any of the embodiments disclosed herein may include these features to aid in navigation and safety.
[0278]
[0359] For example, the introducer scope may be controlled by a processor (e.g., any of the processors herein) to automatically straighten, or for the user to indicate that the deflected tip of the introducer scope should be straightened, as the tip crosses the vocal cords. The vocal cords may be visually detected by the processor via a visual signal from the laryngoscope.
[0279]
[0360] The systems and devices herein may include one or more force sensors. By way of example only, in some embodiments, one or more force sensors may be installed or disposed at the distal tip and / or along the distal length of the shaft of the introducer scope. These force sensors may be adapted to transmit or communicate signals to a processor, which may interpret (or may be adapted to interpret) these signals to determine the force of the tip against tissue and / or along the shaft of the introducer scope. Using this information, the processor may modify (or indicate to the user to modify) the deflection curvature, introduction angle, distance introduced, etc., of the introducer scope. By way of example only, based on an excess force signal indicating excess force experienced by the tip of the introducer scope, the processor may automatically straighten (reduce deflection) and withdraw the introducer scope. The straightening and withdrawal may occur simultaneously. In some embodiments, one or more force sensors may alternatively or additionally be disposed within any of the handheld housings herein.
[0280]
[0361] In some embodiments, the force experienced by the tip of the introducer scope may be sensed elsewhere in the system (i.e., not at the tip), for example, by sensing the strain or force experienced by a motor responsible for bending the tip, or by sensing the force experienced by one or more wires connected to the tip of the introducer scope that may be responsible for bending the tip. The current experienced by the motor responsible for bending the tip may similarly be sensed as a proxy for the force experienced by the tip of the introducer scope. Any disclosure of the disclosure herein related to force sensing may be incorporated into any other examples herein.
[0281]
[0362] In some embodiments, the processor may navigate (or the user may signal to navigate) the introducer scope with a pre-programmed set of maneuvers. These maneuvers may be based on decision trees, predefined heuristic steps, or other logic.
[0282]
[0363] In some embodiments, the display (if the system or assembly includes a display) may be configured to help a user understand the status (e.g., configuration) of the introducer scope. For example, the display may include one or more visual indicators (e.g., icons) adapted to indicate the curvature of the deflection of a region, such as the distal end of the introducer scope, in one or more directions. The display may alternatively or additionally include one or more visual indicators (e.g., icons) adapted to indicate a force experienced by the distal end of the introducer scope. In some examples, as shown in FIGS. 26-28, the visual representation on the display (if included) may indicate the degree of curvature of an existing or current state from a plurality of states of curvature, and may indicate or represent the current state, as shown, in a different manner than other possible states (as shown). FIG. 26 shows an example of a visual display that optionally includes a video image from a laryngoscope 2604 and a video image from an introducer scope 2606. Similarly, an optional indicator 2608 of the curvature of an existing or current state of the distal end or distal region of the introducer scope is shown. In this example, a curved indicator 2610 is highlighted from multiple possible states / configurations to indicate the current or existing state of the distal end region of the introducer scope.
[0283]
[0364] FIG. 27 shows a similar visual display to that shown in FIG. 26, where the curvature indicator 2702 is shown screen within a screen within one of the video images to conserve display space.
[0284]
[0365] FIG. 28 shows a visual display including an introducer scope tip force indicator 2802. The force indicator may be a visual indicator with different possible force levels to indicate, where the force levels are indicated by colored or graduated boxes, where one box, box 2804, is highlighted or selected in some way to indicate the current or existing force condition. The force indicator may be indicated by a different color, light, a moving line or bar, may be audible, etc. Any of the indicators disclosed herein may be visual, audible, tactile, etc. Although the force sensor has been discussed as being at the distal end of the introducer scope, it may be anywhere along the introducer scope shaft or elsewhere in the system.
[0285]
[0366] In some embodiments, examples of which are provided herein, the video image from the laryngoscope and the video image from the introducer scope are shown simultaneously on the display, either independently in different display sections or overlaid in the same area of the display. In some embodiments, the video image from the laryngoscope and the video image from the introducer scope are shown independently or individually. In some embodiments, the video image from the laryngoscope and the video image from the introducer scope are shown intermittently, possibly switching from one image to the other, depending on the location of both scopes within the anatomy or on movement within one or the other image or on other factors. In some embodiments, the video image from the laryngoscope and the video image from the introducer scope are shown continuously. In some embodiments, the video image from the laryngoscope and the video image from the introducer scope are shown at different sizes or enhanced in some way, depending on whether the location or movement within the anatomy is detected or on other factors. In some embodiments, the video image from the laryngoscope and / or the video image from the introducer scope may be captured as a still shot and stored in memory.
[0286]
[0367] Some embodiments may include the ability to collect, create, and / or use 3D images for navigation. For example, an introducer scope may be used to collect 3D information. The distal tip of the introducer scope may be rotated, either manually or automatically, as the introducer is introduced into the anatomy to collect 3D image data. Alternatively or additionally, the introducer scope and laryngoscope may include a 360 degree (or 3D) camera to collect 3D image data. The laryngoscope and introducer scope may include a rotating camera to collect 3D image data. The 3D image data may include anatomical landmarks, which the processor can use to help guide, either automatically or by prompting the user, the placement of the blade, laryngoscope, and / or introducer scope. For example, the information may help guide the blade during positioning, resulting in better, safer, and more efficient placement. For example, the 3D image data may be used to aid in the navigation of the blade above and / or below the epiglottis. In some embodiments, the 3D images may be collected by a stereo dual camera.
[0287]
[0368] In some embodiments, the distance between the tip of the laryngoscope and the tip of the introducer scope (or other landmarks, such as the tip of the blade) may be determined by the processor, and / or the location of the tip of the laryngoscope relative to the tip of the introducer scope / landmarks may be determined by the processor. This information is useful in situations where the image from the introducer scope may be blocked or of poor quality. By knowing the relative distance and / or location of the distal tip of the introducer scope relative to the distal tip of the laryngoscope / landmarks, and similarly, knowing the relative distance and / or location of the anatomical structures relative to the distal tip of the laryngoscope / landmarks, the location of the introducer scope can be determined by the processor, and as a result, the processor can automatically or manually guide the navigation of the introducer scope through the anatomical structures, in some instances, without the benefit of a visual signal through the introducer scope.
[0288]
[0369] Different techniques can be used to locate the tip of the introducer scope without a visual image from the introducer scope. For example, the tip location may be based on machine learning of typical anatomy, the distance the introducer scope has traveled beyond the laryngoscope tip / landmarks as seen by the laryngoscope camera (based on markings, size, etc.), the distance the introducer has traveled beyond the laryngoscope tip / landmarks based on the robotic mechanism used to introduce the introducer scope, the flexion of the introducer scope based on the robotic mechanism used to articulate the introducer scope. The size of the introducer scope as visualized through the laryngoscope may be used to determine the distance the introducer scope has traveled. The size of the blade as visualized through the laryngoscope may similarly be used to determine the size of the introducer scope.
[0289]
[0370] Some embodiments may utilize other sensors and / or techniques to help guide the navigation of the blade, laryngoscope, and / or introducer scope. For example, a light, e.g., a very bright light on the device or outside the patient, may be used in conjunction with a light sensor on or off the patient to sense the location of the device relative to a particular location on the patient's exterior. Magnets may be used as well.
[0290]
[0371] In some embodiments, an orientation and / or motion sensor, such as a 6DOF electromagnetic motion tracking sensor or other sensor available from Polhemus, located in Colchester, Vermont.
[0291]
[0372] Any of the embodiments disclosed herein may include use of the blade without a video component, in other words, without a laryngoscope. An introducer scope may still be used and may serve as the primary visualization camera. The blade in these embodiments may be reusable. Alternatively, the blade in these embodiments may be disposable.
[0292]
[0373] Any of the embodiments disclosed herein may include the ability to be used in a manual mode (e.g., the manual mode herein). In the manual mode, force feedback may be used to help navigate the system. The feedback to the user may be visual, audible, tactile, or other. The drive mechanism for the introducer scope may be disengaged in the manual mode so that the introducer scope may be manually advanced and retracted.
[0293]
[0374] In some embodiments, the processor may guide navigation automatically or by user prompts through a predefined sequence of steps that may be triggered based on timing, force, or resistance experienced by components of the system (blade, laryngoscope, introducer scope, etc.), visual cues, motor feedback (e.g., the force required to advance or retract or articulate the introducer scope), message feedback, verbal feedback, touch screen feedback, foot pedal feedback, etc.
[0294]
[0375] In some embodiments, including any of the embodiments disclosed herein, battery power and / or wall power may be used to power the device.
[0295]
[0376] In some embodiments, including any of the embodiments disclosed herein, communication may be wired or wireless between components of the system.
[0296]
[0377] In some embodiments, including any of the embodiments disclosed herein, a visual display may be included in the handle of the device. The display screen may be permanently attached or detachable to the handle or any other component of the device. In some embodiments, the display may be detachable and include a battery to power the device. In some embodiments, the device may alternatively be powered by a battery or wall power when a display with a battery is not attached to the device. In some embodiments, the display may be a mobile phone or tablet.
[0297]
[0378] In some embodiments, the introducer scope may have one or more additional lumens or channels for tools, irrigation, suction, pressure, drug delivery, instruments, additional visualization, and the like.
[0298]
[0379] In some embodiments, the introducer scope is navigated using a joystick. Joystick articulation control may be absolute or relative. By absolute control, it is meant that the user always actively controls the joystick, and as the joystick moves, the introducer scope articulates, and when the joystick is released, the introducer scope relaxes and returns to its natural state. This is a fast and straightforward method of navigation, but it does not allow the user to take his / her hand off the joystick, and similarly can be awkward if the user's hand is not steady.
[0299]
[0380] Alternatively, relative control may be used. By relative control, the user actively varies the articulation using a joystick, meaning that as the joystick is moved, the introducer scope tip moves in one direction, but when the joystick is released, the introducer scope tip stays where it was moved. The advantage of relative control is finer control of the device, as well as the ability to free up the hands to perform steadiness and other tasks. The disadvantage of relative control is that there is a risk of damage to tissue or the ETT if the introducer scope is advanced or retracted while the tip is articulated.
[0300]
[0381] To address these shortcomings, some embodiments of the device may include the ability of the processor to detect when the introducer scope is retracted, such as by a motion sensor, force sensor, visualization, etc. The processor may automatically straighten or loosen the tip of the introducer scope as it is retracted to prevent damage to the tissue and / or ETT. Loosening of the introducer scope tip may follow the natural curvature of retraction. For example, loosening of the tip may occur gradually. Alternatively, loosening may occur all at once when retraction is detected. Loosening of the introducer scope tip may occur automatically, or the processor may prompt the user to do so.
[0301]
[0382] In some embodiments, a sensor at or near the endotracheal tube coupler may detect when the ETT disengages from the coupler, which may trigger a processor to loosen the tip of the introducer scope for withdrawal or may loosen the tip.
[0302]
[0383] In some embodiments, a force sensor may sense the load on the deflection cable to monitor when the force increases, decreases, or exceeds an acceptable level. The processor may use the signal from the force sensor(s) to trigger the processor to loosen the tip of the introducer scope for withdrawal or to loosen the tip.
[0303]
[0384] In some embodiments disclosed herein, the ETT is rigidly but removably attached to the blade by a groove or lumen or channel, which may include tabs or retainers to hold the ETT in place along the blade during insertion, but also to allow removal of the blade while leaving the ETT in place. ETTs of different sizes, curvatures, lengths, etc. may be used. To prevent buckling of the ETT during insertion, it is desirable for the fit of the ETT into the receiving groove, lumen, or channel of the blade to be relatively snug, without excessive play.
[0304]
[0385] To accommodate different ETT lengths, shapes, and sizes, the blade may include features that allow the blade to accommodate different ETTs. For example, the ETT coupler may be of different lengths, dimensions, and / or may include or accommodate spacers to accommodate different ETT lengths. The blade may include a spring-loaded mechanism to accommodate ETTs of different lengths and / or shapes and / or sizes. The blade and / or introducer scope may include one or more alignment mechanisms, such as rods, that may be adjusted or moved up or down to accommodate ETTs of different lengths and / or shapes and / or sizes. For example, the ETT tube coupler may include an adjustable rod or pin. The alignment or spring mechanism may include a locking mechanism to lock the alignment in place so that ETTs of different lengths and / or shapes and / or sizes may be accommodated. Custom length ETTs may be used as well.
[0305]
[0386] In some embodiments, instead of or in addition to detaching the ETT after successful ETT placement, it may be desirable to have the ability to detach the ETT from the blade during ETT placement.
[0306]
[0387] 29A and 29B show an embodiment of an exemplary blade (or cover herein) that includes a hook that engages the ETT to the blade, allowing both to be advanced together until the ETT is slightly retracted, and the hook disengages the ETT from the blade hook, allowing the ETT to be navigated separately from the blade.
[0307]
[0388] The blade 2902 is shown here with a groove 2904 into which the ETT fits. The hook 2906 engages the distal tip of the ETT such that the ETT and blade are introduced together into the anatomy so that the ETT benefits from the stiffness of the blade. During progression of the ETT, if it is desired for the ETT to follow a path different from that of the blade, the user may disengage the ETT by slightly retracting the ETT relative to the blade, disengaging the ETT from the hook. This allows at least the distal tip of the ETT to move independently of the blade, possibly in any direction. The hook 2906 may be designed to accommodate ETTs of different wall thicknesses. In some embodiments, the hook 2906 may be spring loaded.
[0308]
[0389] In some embodiments, the blade may include tabs 2908 that engage the ETT during progression and, in some cases, after the tip of the ETT has disengaged from the hook. The tabs allow for disengagement of the ETT from the blade after successful ETT placement. In some embodiments, tabs may not be required or there may be more or fewer tabs or other reversibly limiting features.
[0309]
[0390] In some embodiments, the introducer scope and ETT may disengage from the blade once the introducer scope is in place, or at any point during the procedure, to allow more freedom of movement for ETT placement. In some embodiments, the introducer scope may disengage from the drive mechanism once the introducer scope is in place, or at any point during the procedure, to allow more freedom of movement for ETT placement.
[0310]
[0391] In some embodiments, the processor uses semantic segmentation to create real organic boundaries around objects such as the trachea or glottic opening for automatic or manual navigation. This approach is particularly useful for automatic or robotic navigation, especially in difficult anatomical cases, because it provides positional and anatomical context. For example, semantic segmentation is particularly useful when an introducer scope needs to navigate around objects such as the epiglottis, where the laryngeal view is very limited or absent. Examples of objects or anatomical structures that may be segmented by the processor include the epiglottis, arytenoid cartilages, glottic opening, vocal cords, larynx, trachea, carina, bronchi, posterior pharyngeal wall, esophagus, epiglottic vallecula, laryngoscope, endotracheal tube, a "black hole" that may indicate an anatomical opening, and the like. Other objects and / or anatomical structures may be identified and segmented in a similar manner.
[0311]
[0392] 30 shows some examples of actual views through a laryngoscope or introducer scope adjacent to their segmented representations, showing the esophagus 3002, glottic opening 3004, the "black hole" 3006, the posterior pharyngeal wall 3008, the larynx 3010, the arytenoid cartilages 3012, the vocal cords 3014, the trachea 3016, and the epiglottis 3018.
[0312]
[0393] In some embodiments, the blade has a working channel or lumen, possibly additional lumens / channels, all for the use of additional tools, injection of substances, fluids, removal of fluids, tissue, additional visualization, etc. These tools may include needles, graspers, RF devices, laser devices, scissors, etc.
[0313]
[0394] In some embodiments, the introducer scope has a working channel or lumen, possibly additional lumens / channels, all for the use of additional tools, injection of substances, fluids, removal of fluids, tissue, additional visualization, etc. These tools may include needles, graspers, RF devices, laser devices, scissors, etc.
[0314]
[0395] In some embodiments, tools such as those listed above may be incorporated into the blade, the introducer scope, or both.
[0315]
[0396] In some embodiments, a disposable protective sheath or other covering may be removably placed over at least the joystick and buttons to keep them sterile during the procedure.
[0316]
[0397] In some embodiments, electrodes or conductivity / impedance sensors may be placed along the distal length of the introducer scope, and additional electrodes or ground pads may be placed elsewhere in the system, for example on the blade or elsewhere on the shaft of the introducer scope, to sense the relative location of the tip of the introducer scope based on the conductivity / impedance signal.
[0317]
[0398] In some embodiments, the navigation of the device is goal-directed. For example, the navigation goal of the ETT may be to place the distal end of the ETT about 5 cm before the carina (close to the mouth opening). Or, for example, the navigation goal of the ETT may be to place the distal end of the ETT about 4 cm before the carina. Or, for example, the navigation goal of the ETT may be to place the distal end of the ETT about 3 cm before the carina. Or, for example, the navigation goal of the ETT may be to place the distal end of the ETT about 2 cm before the carina. Or, for example, the navigation goal of the ETT may be to place the distal end of the ETT about 6 cm before the carina. Or, for example, the navigation goal of the ETT may be to place the distal end of the ETT about 4-6 cm before the carina. Or, for example, the goal of ETT navigation may be to place the distal end of the ETT about 3-7 cm before the carina. Or, for example, the goal of ETT navigation may be to place the distal end of the ETT about 2-5 cm before the carina. Or, for example, the goal of ETT navigation may be to place the distal end of the ETT approximately midway between the clavicle and the carina.
[0318]
[0399] In some embodiments, the device is designed to place the ETT at its target location in 15 seconds or less. In some embodiments, the device is designed to place the ETT at its target location in 20 seconds or less. In some embodiments, the device is designed to place the ETT at its target location in 25 seconds or less. In some embodiments, the device is designed to place the ETT at its target location in 30 seconds or less. In some embodiments, the device is designed to place the ETT at its target location in 45 seconds or less. In some embodiments, the device is designed to place the ETT at its target location in 60 seconds or less.
[0319]
[0400] In some embodiments, navigation of the device is performed with one hand. In some embodiments, navigation of the device is performed by one person. In some embodiments, navigation of the device is performed with a single joystick and two buttons - a joystick for articulation of the introducer scope and two buttons for advancing and retracting the introducer scope. In some embodiments, navigation of the device is performed with a single joystick and one button - a joystick for articulation of the introducer scope and one button for both advancing and retracting the introducer scope.
[0320]
[0401] In some embodiments, the introducer scope includes a second section of articulation in addition to the articulation at the distal tip to allow for three dimensional articulation of the tip.
[0321]
[0402] In some embodiments, the automated robotics may control one or both cameras (introducer scope and laryngoscopy). In some embodiments, the processor may analyze signals from both cameras simultaneously and determine which signal has a higher confidence, a clearer image, or a better image by some metric, and use that signal or primarily that signal for navigation. In some embodiments, the introducer scope image may be the primary image used by the processor for navigation unless it has a reduced confidence or is not of high enough quality, in which case the processor may be adapted to switch to or rely more heavily on the laryngoscopy image and use it or primarily use it for navigation. In some embodiments, the processor may be adapted to primarily use signals from the laryngoscopy image for introducer navigation above the vocal cords and primarily use signals from the introducer scope for introducer navigation above or below the vocal cords.
[0322]
[0403] One aspect of the present disclosure is a dual video intubation system including a first imaging member including a first video camera and a second imaging member including a second video camera (such as any of the first and second imaging members herein). The second imaging member may include a navigable or actuable elongated introducer (such as any of the introducers herein) sized to be disposed in an endotracheal tube. The system may also include a computer-executable method executable by a processor, the method adapted to receive as input first information indicative of a signal from the first video camera and second information indicative of a signal from the second video camera, and cause one of the first information and the second information to have a greater effect on the operation of the elongated introducer during at least a period of time. FIG. 32 illustrates exemplary steps that may be part of one or more computer-executable methods herein and executable by a processor.
[0323]
[0404] In some examples, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer may include assigning a confidence score to the first information and the second information. For example, if an image does not provide sufficient confidence that the image is reliable, the image data may be assigned a lower score or grade. Figure 33 illustrates example steps that may be part of one or more computer-executable methods herein and executable by a processor.
[0324]
[0405] In some examples, allowing one of the first information and the second information to have a greater influence on the operation of the elongated introducer may include using only the first information and only the first information in the operation of the elongated introducer. By way of example only, one video camera may simply not be functioning properly such that image data from only one video camera influences or is taken into account in the robotic navigation of the introducer. Further, by way of example only, image data from one of the cameras may be of such low quality or unusable that image data from the other camera may be used in the navigation of the introducer. This is an example of the benefit of a dual camera system and the redundancy provided by two or more cameras. FIG. 34 illustrates exemplary steps that may be part of one or more computer-executable methods herein and executable by a processor.
[0325]
[0406] In some examples, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer may include decreasing a relative reliability of the first and second information based on a quality of at least one of the first information and the second information, such as clarity of image or video data. The decreasing relative reliability may result from increasing a relative reliability of video data from one of the cameras. FIG. 33 illustrates example steps that may be part of one or more computer-executable methods herein and executable by a processor.
[0326]
[0407] In some examples, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer includes reducing the reliability of one of the first and second information based on an estimated location of the first or second camera based on the first information or the second information. For example, if one of the cameras is so close to tissue that video data is not helpful or cannot be used, the reliability of that video data may be reduced and that video data may be relied upon less in navigation of the introducer.
[0327]
[0408] In some examples, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer includes comparing at least one aspect of an anatomical feature that is common to the first information and the second information. For example, if one of the cameras provides a better or clearer image of a portion of the anatomical structure, the system may be adapted to rely more heavily on that image or have a higher degree of confidence in that video data.
[0328]
[0409] In some examples, causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer includes determining the proximity between the first camera and the anatomical feature and between the second camera and the anatomical feature.
[0329]
[0410] Data Processing System Example
[0411] FIG. 31 is a block diagram of an exemplary data processing system that may be used with any embodiment of the present invention or with embodiments described herein, such as, without limitation, FIGS. 32-34. For example, system 3500 may be used as part of one or more processors herein. Note that while FIG. 31 illustrates various components of a computer system, it is not intended to illustrate any particular architecture or manner of interconnecting the components; as such details are not directly relevant to the present invention. It will also be recognized that network computers, handheld computers, mobile devices, tablets, cell phones, and other data processing systems having fewer or perhaps more components may be similarly used with the present invention.
[0330]
[0412] As shown in Figure 31, an exemplary computer system 3500 in the form of a data processing system includes a bus or interconnect 3502 coupled to one or more microprocessors 3503, as well as a ROM 3507, a volatile RAM 3505, and a non-volatile memory 3506. The microprocessor 3503 is coupled to a cache memory 3504. The bus 3502 interconnects these various components together and also interconnects these components 3503, 3507, 3505, and 3506 to a display controller and display device 3508, and input / output (I / O) devices 3510, which may be a mouse, keyboard, modem, network interface, printer, and other devices well known in the art.
[0331]
[0413] Typically, input / output devices 3510 are coupled to the system through an input / output controller 3509. Volatile RAM 3505 is typically implemented as dynamic RAM (DRAM), which requires continuous power to refresh or maintain the data in the memory. Non-volatile memory 3506 is typically a magnetic hard drive, a magnetic optical drive, an optical drive, or DVD RAM or other type of memory system that retains data even after power is removed from the system. Typically, the non-volatile memory will be random access memory as well, although this is not required.
[0332]
[0414] While FIG. 31 illustrates that the non-volatile memory is a local device directly coupled to the rest of the components in the data processing system, the present invention may utilize non-volatile memory that is remote from the system, such as a network storage device that is coupled to the data processing system through a network interface, such as a modem or an Ethernet interface. Bus 3502 may include one or more buses connected to each other through various bridges, controllers, and / or adapters, as is well known in the art. In one embodiment, I / O controller 3509 includes a Universal Serial Bus (USB) adapted to control USB peripherals. Alternatively, I / O controller 3509 may include an IEEE-1394 adapter, also known as a Firewire adapter, for controlling Firewire devices, serial peripheral interface (SPI), inter-integrated circuit (I2C), or universal asynchronous receiver / transmitter (UART), or any other suitable technology. Wireless communication protocols may include WiFi, Bluetooth, ZigBee, near field, cellular, and other protocols.
[0333]
[0415] Some portions of the preceding detailed descriptions have been presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. These algorithmic descriptions and representations are the method used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. An algorithm is here, and generally, conceived to be a self-consistent sequence of operations leading to a desired result. The operations are those requiring physical manipulations of physical quantities.
[0334]
[0416] It should be borne in mind, however, that all of these and similar terms are associated with and are merely convenient labels applied to the appropriate physical quantities. As is apparent from the above discussion, unless specifically stated otherwise, it will be recognized that throughout the description, discussions utilizing terms such as those set forth in the appended claims refer to acts and processes of a computer system or similar electronic computing device that manipulate and convert data represented as physical (electronic) quantities in the computer system's registers and memory into other data that are similarly represented as physical quantities in the computer system's memories or registers or other such information storage, transmission, or display devices.
[0335]
[0417] The techniques illustrated in the figures herein may be implemented using code (e.g., computer-executable methods, algorithms) and data stored on and executed on one or more electronic devices. Such electronic devices store and communicate (internally and / or with other electronic devices over a network) the code and data using computer-readable media, such as non-transitory computer-readable storage media (e.g., magnetic disks, optical disks, random access memory, read-only memory, flash memory devices, phase-change memory) and transitory computer-readable transmission media (e.g., electrical, optical, acoustic, or other forms of propagated signals-carrier waves, infrared signals, digital signals, etc.).
[0336]
[0418] The processes or methods illustrated in the preceding figures may be performed by processing logic comprising hardware (e.g., circuitry, dedicated logic, etc.), firmware, software (e.g., embodied on a non-transitory computer-readable storage medium), or a combination of both. Although the processes or methods are described above with certain sequential operations, it should be appreciated that some of the operations described may be performed in a different order. Additionally, some operations may be performed in parallel rather than sequentially.
Claims
1. 1. A dual video intubation system, comprising: a first imaging member, the first imaging member including a first video camera within a distal region of the first imaging member; a second imaging member, an operable elongate introducer sized for placement within an endotracheal tube; and a second imaging member including a second video camera disposed at a distal region of the elongate introducer; 1. A computer-executable method comprising: receiving as input first information indicative of a signal from the first video camera and second information indicative of a signal from the second video camera; causing one of the first information or the second information to have a greater effect on the operation of the elongate introducer during at least a period of time. and a computer-executable method adapted to:
2. The system of claim 1 , wherein causing one of the first information and the second information to have a greater influence on operation of the elongate introducer includes assigning a confidence score to the first information and the second information.
3. The system of claim 1, wherein causing one of the first information and the second information to have a greater influence on operation of the elongate introducer includes using only one of the first information and the second information in operating the elongate introducer.
4. 2. The system of claim 1, wherein causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer includes reducing a relative reliability of one of the first and second information based on a quality of at least one of the first information and the second information.
5. The system of claim 4 , wherein the quality relates to clarity of image data.
6. The system of claim 1, wherein causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer includes reducing the reliability of one of the first and second information based on an estimated location of the first or second camera based on the first information or the second information.
7. 2. The system of claim 1, wherein causing one of the first information and the second information to have a greater influence on operation of the elongate introducer includes comparing at least one aspect of an anatomical feature that is common to the first information and the second information.
8. 2. The system of claim 1, wherein causing one of the first information and the second information to have a greater influence on the operation of the elongate introducer includes determining a proximity between the first camera and an anatomical feature and between the second camera and an anatomical feature.
9. 1. A video intubation system comprising: a housing sized and configured to be handled by a user; a first imaging member coupled directly or indirectly to the housing, the first imaging member including a first video camera within a distal region of the first imaging member; an elongated endotracheal tube introducer sized to be disposed within an endotracheal tube, the elongated endotracheal tube introducer including a shaft carrying one or more markers positioned and adapted to be captured by the first imaging member when the one or more markers are within a field of view of the first imaging member; one or more actuators in operable communication with the introducer to facilitate controlled robotic axial movement of the introducer relative to the first video camera; and one or more processors configured to receive as input information indicative of signals from the first video camera of one or more upper airway anatomical landmarks, and to cause communication to the one or more actuators to facilitate automatic, controlled robotic movement of the introducer relative to the first video camera.
10. The system of claim 9 , further comprising a second video camera disposed in a distal region of the introducer.
11. 11. The system of claim 9 or 10, wherein the one or more processors are configured to receive as input one or both of information indicative of the signal from the first video camera and information indicative of the signal from the second video camera of one or more upper airway anatomical landmarks, and to cause communication to the one or more actuators to facilitate automatic, controlled robotic movement of the introducer and the second video camera relative to the first video camera.
12. A system according to any one of claims 9 to 11, wherein the one or more markers are disposed on the shaft to indicate one or both of a location or position of a deflectable region of the introducer.
13. The system of any one of claims 9 to 12, wherein the one or more markers comprise one or more visual markers.
14. A system according to any one of claims 9 to 13, wherein the first marker is different from the second marker, said difference indicating a different region of the introducer.
15. The system of any one of claims 9 to 14, wherein the one marker is a first type of marker and the second marker is a second type of marker different from the first type of marker.
16. The system of any one of claims 9 to 15, wherein at least one marker of the one or more markers is adapted to emit light, optionally adapted to emit a flashing or a steady light.
17. A system according to any one of claims 9 to 16, wherein at least one marker extends circumferentially around the entire introducer.
18. A system according to any one of claims 9 to 17, wherein at least one marker extends circumferentially around less than 360 degrees of the introducer.
19. The system of any one of claims 9 to 18, wherein the one or more markers comprise one or more reflective materials.
20. The system of any one of claims 9 to 19, wherein the one or more markers comprise a plurality of markers spaced axially along the introducer, equally spaced or unequally spaced.
Citation Information
Patent Citations
Intubation support device
JP2014210085A
Multifunctional Visualization Instrument
JP2021502863A
Multifunctional visualization instrument with orientation control
US20200275824A1
Artificial intelligence-based automatic intubation device and method of operating the same
US20210196915A1
